00000001:02000400:0.0F:1782216729.369366:0:3301:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1782216747.962838:0:3524:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1782216750.299128:0:3584:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 507 MB/s 00000001:01000000:1.0:1782216750.549080:0:3584:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 531 MB/s 00000001:01000000:2.0:1782216750.800682:0:3584:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3384 MB/s 00000020:02000000:0.0:1782216751.526097:0:3616:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_83_gf3505cf 00000400:02000000:1.0:1782216752.507727:0:3631:0:(api-ni.c:2752:lnet_startup_lndni()) Added LNI 192.168.203.130@tcp [8/256/0/180] 00008000:02000000:3.0F:1782216756.235998:0:3781:0:(echo_client.c:2573:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1782216810.985313:0:5746:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1782216823.177576:0:6496:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1782216823.177609:0:6496:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1782216823.177611:0:6496:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1782216823.177741:0:6496:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000a2ed9939 00000080:02000400:2.0:1782216823.177750:0:6496:0:(super25.c:154:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1782216823.185954:0:6496:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1782216823.185968:0:6496:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1782216823.186003:0:6496:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000094ab091d) 00000020:00000080:2.0:1782216823.186022:0:6496:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1782216823.242688:0:6496:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1782216823.242755:0:6496:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:3.0:1782216823.277287:0:6496:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1782216823.277570:0:6496:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1782216823.277579:0:6496:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1782216823.277614:0:6496:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x92b8e04cbf5f8e74 00000020:01000004:3.0:1782216823.277620:0:6496:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1782216823.277625:0:6496:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1782216823.277630:0:6496:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000a2ed9939 from MGS 00000020:01000004:3.0:1782216823.277635:0:6496:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1782216823.277653:0:6496:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000b7856cdb) 00000020:00000080:3.0:1782216823.277667:0:6496:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1782216823.277780:0:6496:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000a2ed9939 from MGS, refs=2 00080000:01000000:3.0:1782216823.277786:0:6496:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1782216823.277792:0:6496:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x92b8e04cbf5f8e82 00000100:00100000:3.0:1782216823.277896:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1782216823.278509:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1782216823.278516:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1782216823.279243:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1782216823.279251:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1782216823.281220:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782216823.281421:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1782216823.281427:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1782216823.284560:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1782216823.284576:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1782216823.285049:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1782216823.285057:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1782216823.286576:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216823.286600:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216823.286603:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216823.286973:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216823.286976:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216823.286978:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782216823.287687:0:6496:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1782216823.289967:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1782216823.537641:0:6496:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3071 MB/s 00000001:01000000:2.0:1782216823.789890:0:6496:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3686 MB/s 00000001:01000000:2.0:1782216824.041550:0:6496:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 673 MB/s 00000001:01000000:1.0:1782216824.291132:0:6496:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 731 MB/s 00080000:10000000:1.0:1782216824.297329:0:6496:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:1.0:1782216824.310991:0:6496:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1782216824.315411:0:6510:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 00010000:00010000:2.0:1782216824.315558:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:2.0:1782216824.315611:0:6496:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1782216824.315678:0:6496:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1782216824.315916:0:6496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1782216824.315941:0:6496:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1782216824.316280:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782216824.316435:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1782216824.316442:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1782216824.323221:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1782216824.323231:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1782216824.323777:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1782216824.323838:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1782216824.324370:0:6496:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1782216824.324387:0:6496:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.203.130@tcp' 00000020:01000004:3.0:1782216824.324390:0:6496:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1782216824.324434:0:6496:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.203.130@tcp (typ=mgc) 00000020:00000080:3.0:1782216824.324454:0:6496:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.130@tcp (000000009c70a446) 00000020:00000080:3.0:1782216824.324574:0:6496:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1782216824.324687:0:6496:0:(ldlm_lib.c:102:import_set_conn()) imp 000000008d727a17@MGC192.168.203.130@tcp: add connection 192.168.203.130@tcp at head 00010000:00010000:3.0:1782216824.324842:0:6496:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.130@tcp-0 is initialized 00000040:01000000:3.0:1782216824.324848:0:6496:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.130@tcp ctxt 1 is initialized 00000100:00080000:1.0:1782216824.328424:0:6515:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1782216824.328444:0:6516:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1782216824.331006:0:6496:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.130@tcp (uuid 17bce19a-7a0f-4c9d-b31c-4e0155298487) 00000020:00000080:0.0:1782216824.331031:0:6496:0:(genops.c:1406:class_connect()) connect: client 17bce19a-7a0f-4c9d-b31c-4e0155298487, cookie 0x92b8e04cbf5f8e90 00000100:00080000:0.0:1782216824.331042:0:6496:0:(import.c:512:import_select_connection()) MGC192.168.203.130@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782216824.331048:0:6496:0:(import.c:626:import_select_connection()) MGC192.168.203.130@tcp: import 000000008d727a17 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1782216824.331090:0:6496:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000af6cbfb2 x1868789712945280/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782216824.331111:0:6496:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import 17bce19a-7a0f-4c9d-b31c-4e0155298487->MGS 00000020:01000004:0.0:1782216824.331152:0:6496:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1782216824.331157:0:6496:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1782216824.331176:0:6496:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000002059671) 00000020:00000080:0.0:1782216824.331190:0:6496:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1782216824.336809:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000af6cbfb2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:17bce19a-7a0f-4c9d-b31c-4e0155298487:3646:1868789712945280:0@lo:250: 00000100:00100000:1.0:1782216824.336897:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216824.337569:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712945280 00000100:00100000:2.0:1782216824.337579:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712945280 00000100:00100000:2.0:1782216824.337641:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782216824.337647:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f27efec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3646:x1868789712945280:12345-0@lo:250: 00010000:00080000:2.0:1782216824.337671:0:6513:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 17bce19a-7a0f-4c9d-b31c-4e0155298487@0@lo t0 exp 0000000000000000 cur 187 last 0 00000020:00000080:2.0:1782216824.337702:0:6513:0:(genops.c:1406:class_connect()) connect: client 17bce19a-7a0f-4c9d-b31c-4e0155298487, cookie 0x92b8e04cbf5f8e9e 00000100:00080000:2.0:1782216824.337827:0:6513:0:(import.c:65:import_set_state_nolock()) 00000000c85ba5ea : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782216824.337888:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f27efec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+5:3646:x1868789712945280:12345-0@lo:250: Request processed in 240us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216824.337896:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782216824.337941:0:3646:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.203.130@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1782216824.337949:0:3646:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.203.130@tcp: connect to target with instance 0 00000100:00080000:2.0:1782216824.337956:0:3646:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.203.130@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1782216824.337961:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1782216824.337964:0:3646:0:(import.c:65:import_set_state_nolock()) 000000008d727a17 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1782216824.337966:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1782216824.337977:0:3646:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1782216824.337981:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000af6cbfb2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:17bce19a-7a0f-4c9d-b31c-4e0155298487:3646:1868789712945280:0@lo:250: 00000100:00100000:0.0:1782216824.351024:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782216824.351237:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1782216824.351243:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1782216824.353914:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1782216824.353929:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1782216824.354402:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1782216824.354410:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1782216824.355890:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782216824.360746:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1782216824.360754:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1782216824.361798:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1782216824.361813:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1782216824.440643:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782216824.440887:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1782216824.440894:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1782216824.443788:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1782216824.443802:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1782216824.444429:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782216824.444856:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1782216824.444862:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1782216824.445332:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1782216824.445339:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1782216824.446342:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782216824.446552:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1782216824.446557:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1782216824.447273:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1782216824.447280:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1782216824.448097:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782216824.448263:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1782216824.448268:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1782216824.449043:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1782216824.449050:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1782216824.490190:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782216824.491044:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1782216824.491051:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1782216824.501825:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1782216824.501840:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1782216824.504474:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1782216824.504487:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1782216824.506356:0:6496:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1782216824.506384:0:6496:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1782216824.506390:0:6496:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.130@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1782216824.506758:0:6496:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.130@tcp ctxt 0 is initialized 00000020:01000004:0.0:1782216824.506804:0:6496:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.130@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1782216824.506808:0:6496:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1782216824.506814:0:6496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1782216824.506815:0:6496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782216824.506816:0:6496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782216824.506817:0:6496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782216824.506818:0:6496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782216824.506819:0:6496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1782216824.506820:0:6496:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1782216824.506821:0:6496:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782216824.506822:0:6496:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782216824.506824:0:6496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782216824.506825:0:6496:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1782216824.506827:0:6496:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1782216824.506829:0:6496:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1782216824.506830:0:6496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1782216824.506831:0:6496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782216824.506832:0:6496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782216824.506832:0:6496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782216824.506833:0:6496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782216824.506834:0:6496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1782216824.506835:0:6496:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1782216824.506835:0:6496:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782216824.506836:0:6496:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782216824.506837:0:6496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782216824.506837:0:6496:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1782216824.506863:0:6496:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1782216824.506879:0:6496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000003ecb09b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:6496:1868789712945408:0@lo:253: 00000100:00100000:0.0:1782216824.506956:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216824.507024:0:6496:0:(client.c:2701:ptlrpc_set_wait()) set 00000000110b798d going to sleep for 11 seconds 00000100:00100000:2.0:1782216824.507205:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712945408 00000100:00100000:2.0:1782216824.507213:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712945408 00000100:00100000:2.0:1782216824.507261:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782216824.507269:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000192d1949 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+5:6496:x1868789712945408:12345-0@lo:253: 20000000:01000000:2.0:1782216824.507332:0:6514:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1782216824.507335:0:6514:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1782216824.510013:0:6534:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1782216824.510073:0:6514:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1782216824.510358:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782216824.511507:0:6535:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1782216824.511808:0:6514:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1782216824.511812:0:6514:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1782216824.511818:0:6514:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1782216824.511821:0:6514:0:(mgs_llog.c:3603:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1782216824.511838:0:6514:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1782216824.512016:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782216824.512161:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1782216824.512175:0:6514:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1782216824.512192:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1782216824.512208:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1782216824.512222:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1782216824.512287:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1782216824.512295:0:6514:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1782216824.512318:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1782216824.512324:0:6514:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1782216824.512334:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1782216824.512338:0:6514:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1782216824.512347:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1782216824.512360:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1782216824.512384:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1782216824.512388:0:6514:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1782216824.512396:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782216824.512495:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1782216824.512512:0:6514:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1782216824.512526:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1782216824.512539:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1782216824.512550:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1782216824.512558:0:6514:0:(mgs_llog.c:3120:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1782216824.512617:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1782216824.512627:0:6514:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1782216824.512641:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1782216824.512655:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1782216824.512668:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1782216824.512676:0:6514:0:(mgs_llog.c:3085:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1782216824.512705:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1782216824.512712:0:6514:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1782216824.512757:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1782216824.512774:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1782216824.512824:0:6514:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1782216824.512848:0:6514:0:(mgs_llog.c:3300:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1782216824.512854:0:6514:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1782216824.517904:0:6536:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1782216824.518252:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1782216824.518292:0:6514:0:(mgs_llog.c:3346:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.130@tcp for mdt 20000000:01000000:1.0:1782216824.518295:0:6514:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.130@tcp (null) (null) (null) 00000040:00080000:1.0:1782216824.518320:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1782216824.518327:0:6514:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1782216824.518339:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1782216824.518343:0:6514:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.130@tcp (null) (null) 00000040:00080000:1.0:1782216824.518353:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1782216824.518360:0:6514:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1782216824.518375:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1782216824.518390:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1782216824.518419:0:6514:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1782216824.518422:0:6514:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1782216824.518439:0:6514:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1782216824.518483:0:6514:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1782216824.518485:0:6514:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1782216824.521130:0:6537:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1782216824.521383:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1782216824.521413:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1782216824.521428:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:2.0:1782216824.521439:0:6514:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1782216824.521442:0:6514:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1782216824.521924:0:6538:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1782216824.523030:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1782216824.523061:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1782216824.523099:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1782216824.523114:0:6514:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1782216824.523116:0:6514:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1782216824.523122:0:6514:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1782216824.523124:0:6514:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1782216824.523130:0:6514:0:(mgs_llog.c:5063:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1782216824.523136:0:6514:0:(mgs_llog.c:1376:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1782216824.524481:0:6539:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1782216824.524659:0:6514:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1782216824.543878:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1782216824.543924:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1782216824.543941:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1782216824.543959:0:6514:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1782216824.543981:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d46adbff/0x92b8e04cbf5f8ea5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.543996:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d46adbff/0x92b8e04cbf5f8ea5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.544005:0:6514:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d46adbff/0x92b8e04cbf5f8ea5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.544011:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d46adbff/0x92b8e04cbf5f8ea5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.544016:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d46adbff/0x92b8e04cbf5f8ea5 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.545811:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d46adbff/0x92b8e04cbf5f8ea5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.545819:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d46adbff already unused, calling callback (00000000e53a7aa9) 00010000:00010000:3.0:1782216824.545822:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d46adbff/0x92b8e04cbf5f8ea5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.545829:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d46adbff/0x92b8e04cbf5f8ea5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.545841:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d46adbff/0x92b8e04cbf5f8ea5 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.545864:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d46adbff/0x92b8e04cbf5f8ea5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.545869:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d46adbff/0x92b8e04cbf5f8ea5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1782216824.545889:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1782216824.553814:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000192d1949 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+5:6496:x1868789712945408:12345-0@lo:253: Request processed in 46537us (46850us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216824.553831:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782216824.553929:0:6496:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000003ecb09b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:6496:1868789712945408:0@lo:253: 10000000:01000000:3.0:1782216824.553943:0:6496:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1782216824.553946:0:6496:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782216824.553948:0:6496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782216824.553949:0:6496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782216824.553950:0:6496:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1782216824.553952:0:6496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782216824.553953:0:6496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782216824.553954:0:6496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782216824.553955:0:6496:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782216824.553956:0:6496:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1782216824.553958:0:6496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782216824.553959:0:6496:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1782216824.553979:0:6496:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000a2ed9939 from lustre-MDT0000 10000000:01000000:3.0:1782216824.554008:0:6496:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1782216824.554012:0:6496:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1782216824.554016:0:6496:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff952e5021b380 10000000:01000000:3.0:1782216824.554020:0:6496:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782216824.554027:0:6496:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff952e5021b380 from 1 10000000:01000000:3.0:1782216824.554030:0:6496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1782216824.554089:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 00000000bfc4eaae/0x92b8e04cbf5f8eac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.554099:0:6496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 00000000bfc4eaae/0x92b8e04cbf5f8eac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.554118:0:6496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 00000000bfc4eaae/0x92b8e04cbf5f8eac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216824.554137:0:6496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006cd3b965 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:6496:1868789712945536:0@lo:101: 00000100:00100000:3.0:1782216824.554190:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216824.554233:0:6496:0:(client.c:2701:ptlrpc_set_wait()) set 00000000656aa574 going to sleep for 11 seconds 00000100:00100000:2.0:1782216824.554698:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712945536 00000100:00100000:2.0:1782216824.554705:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712945536 00000100:00100000:2.0:1782216824.554742:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782216824.554750:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004b6810f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+5:6496:x1868789712945536:12345-0@lo:101: 00010000:00010000:2.0:1782216824.554762:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782216824.554776:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d8da30e3/0x92b8e04cbf5f8eb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f8eac expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216824.554796:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d8da30e3/0x92b8e04cbf5f8eb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f8eac expref: 6 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216824.554805:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d8da30e3/0x92b8e04cbf5f8eb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f8eac expref: 6 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216824.554813:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d8da30e3, rc 0) 00000100:00100000:2.0:1782216824.554847:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004b6810f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+6:6496:x1868789712945536:12345-0@lo:101: Request processed in 98us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216824.554863:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782216824.554951:0:6496:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006cd3b965 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:6496:1868789712945536:0@lo:101: 00010000:00010000:3.0:1782216824.554965:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 00000000bfc4eaae/0x92b8e04cbf5f8eac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f8eb3 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.554973:0:6496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 00000000bfc4eaae/0x92b8e04cbf5f8eac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f8eb3 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216824.555027:0:6496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006cd3b965 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:6496:1868789712945664:0@lo:501: 00000100:00100000:3.0:1782216824.555053:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216824.555082:0:6496:0:(client.c:2701:ptlrpc_set_wait()) set 00000000656aa574 going to sleep for 11 seconds 00000100:00100000:2.0:1782216824.555124:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712945664 00000100:00100000:2.0:1782216824.555128:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712945664 00000100:00100000:2.0:1782216824.555159:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782216824.555164:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002b56d78e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+6:6496:x1868789712945664:12345-0@lo:501: 00000100:00100000:2.0:1782216824.555231:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002b56d78e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+6:6496:x1868789712945664:12345-0@lo:501: Request processed in 67us (177us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782216824.555237:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782216824.555473:0:6496:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006cd3b965 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:6496:1868789712945664:0@lo:501: 10000000:01000000:3.0:1782216824.555500:0:6496:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1782216824.555515:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 00000000bfc4eaae/0x92b8e04cbf5f8eac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f8eb3 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.555522:0:6496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: 00000000bfc4eaae/0x92b8e04cbf5f8eac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f8eb3 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782216824.555530:0:6496:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff952e70905800 10000000:01000000:3.0:1782216824.555534:0:6496:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1782216824.555546:0:6496:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff952e70905800 10000000:01000000:3.0:1782216824.555549:0:6496:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1782216824.555552:0:6496:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff952e70905800 from 1 10000000:01000000:3.0:1782216824.555554:0:6496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1782216824.555572:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 00000000cdb60127/0x92b8e04cbf5f8eba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.555579:0:6496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 00000000cdb60127/0x92b8e04cbf5f8eba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.555686:0:6496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 00000000cdb60127/0x92b8e04cbf5f8eba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216824.555698:0:6496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006cd3b965 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:6496:1868789712945792:0@lo:101: 00000100:00100000:3.0:1782216824.555725:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216824.555749:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712945792 00000100:00100000:3.0:1782216824.555753:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712945792 00000100:00100000:3.0:1782216824.555776:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782216824.555780:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008fc85ad4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+6:6496:x1868789712945792:12345-0@lo:101: 00010000:00010000:3.0:1782216824.555788:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782216824.555797:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000008060cfd/0x92b8e04cbf5f8ec1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f8eba expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.555810:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000008060cfd/0x92b8e04cbf5f8ec1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f8eba expref: 7 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.555817:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000008060cfd/0x92b8e04cbf5f8ec1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f8eba expref: 7 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.555822:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000008060cfd, rc 0) 00000100:00100000:3.0:1782216824.555850:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008fc85ad4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+7:6496:x1868789712945792:12345-0@lo:101: Request processed in 70us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216824.555855:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782216824.555878:0:6496:0:(client.c:2701:ptlrpc_set_wait()) set 00000000656aa574 going to sleep for 11 seconds 00000100:00100000:3.0:1782216824.555890:0:6496:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006cd3b965 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:6496:1868789712945792:0@lo:101: 00010000:00010000:3.0:1782216824.555898:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 00000000cdb60127/0x92b8e04cbf5f8eba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f8ec1 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.555905:0:6496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 00000000cdb60127/0x92b8e04cbf5f8eba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f8ec1 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782216824.555914:0:6496:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1782216824.555917:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 00000000cdb60127/0x92b8e04cbf5f8eba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f8ec1 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.555923:0:6496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: 00000000cdb60127/0x92b8e04cbf5f8eba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f8ec1 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782216824.555927:0:6496:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1782216824.555930:0:6496:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782216824.555934:0:6496:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff952e70905800 10000000:01000000:3.0:1782216824.555936:0:6496:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1782216824.555939:0:6496:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1782216824.555940:0:6496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1782216824.555952:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 00000000baa50e3c/0x92b8e04cbf5f8ec8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.555957:0:6496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 00000000baa50e3c/0x92b8e04cbf5f8ec8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.555973:0:6496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 00000000baa50e3c/0x92b8e04cbf5f8ec8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216824.555983:0:6496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006cd3b965 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:6496:1868789712945920:0@lo:101: 00000100:00100000:3.0:1782216824.556006:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216824.556025:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712945920 00000100:00100000:3.0:1782216824.556028:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712945920 00000100:00100000:3.0:1782216824.556049:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782216824.556054:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000984c9e6f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+7:6496:x1868789712945920:12345-0@lo:101: 00010000:00010000:3.0:1782216824.556060:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782216824.556068:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000aff09b4c/0x92b8e04cbf5f8ecf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f8ec8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.556078:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000aff09b4c/0x92b8e04cbf5f8ecf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f8ec8 expref: 8 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.556085:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000aff09b4c/0x92b8e04cbf5f8ecf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f8ec8 expref: 8 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.556090:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000aff09b4c, rc 0) 00000100:00100000:3.0:1782216824.556111:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000984c9e6f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+8:6496:x1868789712945920:12345-0@lo:101: Request processed in 57us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216824.556117:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782216824.556138:0:6496:0:(client.c:2701:ptlrpc_set_wait()) set 00000000656aa574 going to sleep for 11 seconds 00000100:00100000:3.0:1782216824.556149:0:6496:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006cd3b965 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:6496:1868789712945920:0@lo:101: 00010000:00010000:3.0:1782216824.556158:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 00000000baa50e3c/0x92b8e04cbf5f8ec8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f8ecf expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.556174:0:6496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 00000000baa50e3c/0x92b8e04cbf5f8ec8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f8ecf expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216824.557540:0:6496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006cd3b965 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:6496:1868789712946048:0@lo:501: 00000100:00100000:3.0:1782216824.558496:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216824.558547:0:6496:0:(client.c:2701:ptlrpc_set_wait()) set 00000000656aa574 going to sleep for 11 seconds 00000100:00100000:2.0:1782216824.558716:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712946048 00000100:00100000:2.0:1782216824.558723:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712946048 00000100:00100000:2.0:1782216824.558771:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782216824.558777:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000087533ac7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+8:6496:x1868789712946048:12345-0@lo:501: 00000100:00100000:2.0:1782216824.558905:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000087533ac7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+9:6496:x1868789712946048:12345-0@lo:501: Request processed in 128us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216824.558913:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782216824.558996:0:6496:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006cd3b965 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:6496:1868789712946048:0@lo:501: 00000100:00100000:0.0:1782216824.559045:0:6496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c80dfd6c pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:6496:1868789712946176:0@lo:503: 00000100:00100000:0.0:1782216824.559108:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216824.559139:0:6496:0:(client.c:2701:ptlrpc_set_wait()) set 000000003aaf3e11 going to sleep for 11 seconds 00000100:00100000:2.0:1782216824.559334:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712946176 00000100:00100000:2.0:1782216824.559340:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712946176 00000100:00100000:2.0:1782216824.559372:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782216824.559388:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008adacef2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+9:6496:x1868789712946176:12345-0@lo:503: 00000100:00100000:2.0:1782216824.559472:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008adacef2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+9:6496:x1868789712946176:12345-0@lo:503: Request processed in 94us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216824.559478:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782216824.559536:0:6496:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c80dfd6c pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:6496:1868789712946176:0@lo:503: 00000100:00100000:2.0:1782216824.561717:0:6540:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000003adddb17 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:6540:1868789712946304:0@lo:502: 00000100:00100000:2.0:1782216824.561787:0:6540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216824.561827:0:6540:0:(client.c:2701:ptlrpc_set_wait()) set 000000007b98352d going to sleep for 11 seconds 00000100:00100000:3.0:1782216824.561900:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712946304 00000100:00100000:3.0:1782216824.561908:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712946304 00000100:00100000:3.0:1782216824.561953:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782216824.561960:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f4c5bd12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+9:6540:x1868789712946304:12345-0@lo:502: 00000100:00100000:3.0:1782216824.562077:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f4c5bd12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+9:6540:x1868789712946304:12345-0@lo:502: Request processed in 118us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216824.562085:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782216824.564464:0:6540:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000003adddb17 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:6540:1868789712946304:0@lo:502: 00000020:01000000:1.0:1782216824.564623:0:6540:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782216824.564637:0:6540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782216824.564639:0:6540:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1782216824.564645:0:6540:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1782216824.564648:0:6540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782216824.564677:0:6540:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000005e5c3928) 00000020:00000080:1.0:1782216824.564698:0:6540:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1782216824.564705:0:6540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1782216824.564996:0:6540:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:1.0:1782216824.565004:0:6540:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x92b8e04cbf5f8edd 00000020:00000080:1.0:1782216824.565222:0:6540:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1782216824.565227:0:6540:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782216824.565230:0:6540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782216824.565232:0:6540:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1782216824.565234:0:6540:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782216824.565238:0:6540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782216824.565239:0:6540:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1782216824.565242:0:6540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782216824.565249:0:6540:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000004af72026) 00000020:00000080:1.0:1782216824.565257:0:6540:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1782216824.565260:0:6540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1782216824.565262:0:6540:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1782216824.565264:0:6540:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1782216824.565270:0:6540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1782216824.566460:0:6540:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000a2ed9939 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1782216824.566480:0:6540:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000d17bd941) 00000020:00000080:1.0:1782216824.566648:0:6540:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1782216824.566728:0:6540:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1782216824.566734:0:6540:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x92b8e04cbf5f8ef2 00000020:00000080:1.0:1782216824.567072:0:6540:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1782216824.567079:0:6540:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1782216824.567084:0:6540:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x92b8e04cbf5f8ef9 00080000:01000000:1.0:1782216824.567091:0:6540:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1782216824.567095:0:6540:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x92b8e04cbf5f8f00 00080000:10000000:1.0:1782216824.568149:0:6540:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1782216824.569458:0:6540:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1782216824.579120:0:6540:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1782216824.709919:0:6540:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1782216824.710248:0:6540:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1782216824.718903:0:6540:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1782216824.720651:0:6540:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1782216824.725123:0:6540:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000de266598) 00000020:00000080:2.0:1782216824.725146:0:6540:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1782216824.725248:0:6540:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:2.0:1782216824.725255:0:6540:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x92b8e04cbf5f8f0e 00000020:00000080:0.0:1782216824.726780:0:6540:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1782216824.727637:0:6540:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:0.0:1782216824.730826:0:6540:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:1.0:1782216824.734284:0:6540:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:1.0:1782216824.736959:0:6540:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:1.0:1782216824.744389:0:6540:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:1.0:1782216824.746796:0:6540:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:1.0:1782216824.748953:0:6540:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x92b8e04cbf5f8f15 00000020:00000080:1.0:1782216824.749218:0:6540:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1782216824.749228:0:6540:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782216824.749234:0:6540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782216824.749236:0:6540:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1782216824.749239:0:6540:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782216824.749243:0:6540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782216824.749244:0:6540:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:1.0:1782216824.749247:0:6540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1782216824.749249:0:6540:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1782216824.749251:0:6540:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782216824.749253:0:6540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782216824.749255:0:6540:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:1.0:1782216824.749257:0:6540:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782216824.749261:0:6540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782216824.749262:0:6540:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1782216824.749266:0:6540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1782216824.749312:0:6540:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1782216824.749382:0:6540:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008d6588d1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:6540:1868789712946432:0@lo:502: 00000100:00100000:1.0:1782216824.749452:0:6540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216824.749613:0:6540:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e5136f50 going to sleep for 11 seconds 00000100:00100000:3.0:1782216824.752877:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712946432 00000100:00100000:3.0:1782216824.752891:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712946432 00000100:00100000:3.0:1782216824.752951:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782216824.752959:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000096b3d86c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+9:6540:x1868789712946432:12345-0@lo:502: 00000100:00100000:3.0:1782216824.753133:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000096b3d86c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+9:6540:x1868789712946432:12345-0@lo:502: Request processed in 174us (3681us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216824.753141:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782216824.753638:0:6540:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008d6588d1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:6540:1868789712946432:0@lo:502: 00000020:01000000:2.0:1782216824.753674:0:6540:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782216824.753680:0:6540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782216824.753682:0:6540:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1782216824.753687:0:6540:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1782216824.754706:0:6496:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1782216824.754732:0:6496:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1782216824.754747:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 00000000baa50e3c/0x92b8e04cbf5f8ec8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f8ecf expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.754758:0:6496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: 00000000baa50e3c/0x92b8e04cbf5f8ec8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f8ecf expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782216824.754779:0:6496:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff952e70905800 from 1 10000000:01000000:3.0:1782216824.754782:0:6496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1782216824.754816:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 00000000d46adbff/0x92b8e04cbf5f8f1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.754822:0:6496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 00000000d46adbff/0x92b8e04cbf5f8f1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.754831:0:6496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 00000000d46adbff/0x92b8e04cbf5f8f1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216824.754849:0:6496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000531c6e78 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:6496:1868789712946560:0@lo:101: 00000100:00100000:3.0:1782216824.754895:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216824.755286:0:6496:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e4034c02 going to sleep for 11 seconds 00000100:00100000:1.0:1782216824.756049:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712946560 00000100:00100000:1.0:1782216824.756060:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712946560 00000100:00100000:1.0:1782216824.756140:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782216824.756148:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000abeaf872 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+9:6496:x1868789712946560:12345-0@lo:101: 00010000:00010000:1.0:1782216824.756161:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782216824.756176:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d15b8f7d/0x92b8e04cbf5f8f23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f8f1c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216824.756198:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d15b8f7d/0x92b8e04cbf5f8f23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f8f1c expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216824.756207:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d15b8f7d/0x92b8e04cbf5f8f23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f8f1c expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216824.756216:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d15b8f7d, rc 0) 00000100:00100000:1.0:1782216824.756271:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000abeaf872 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+10:6496:x1868789712946560:12345-0@lo:101: Request processed in 124us (1376us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216824.756278:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782216824.756355:0:6496:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000531c6e78 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:6496:1868789712946560:0@lo:101: 00010000:00010000:0.0:1782216824.756370:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 00000000d46adbff/0x92b8e04cbf5f8f1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f8f23 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216824.756377:0:6496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 00000000d46adbff/0x92b8e04cbf5f8f1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f8f23 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216824.757003:0:6496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c80dfd6c pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:6496:1868789712946688:0@lo:256: 00000100:00100000:0.0:1782216824.757046:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216824.757463:0:6496:0:(client.c:2701:ptlrpc_set_wait()) set 00000000110b798d going to sleep for 11 seconds 00000100:00100000:3.0:1782216824.757773:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712946688 00000100:00100000:3.0:1782216824.757780:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712946688 00000100:00100000:3.0:1782216824.757814:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782216824.757822:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ffcc7f63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+10:6496:x1868789712946688:12345-0@lo:256: 20000000:01000000:3.0:1782216824.757839:0:6511:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1782216824.757844:0:6511:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1782216824.758023:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ffcc7f63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+10:6496:x1868789712946688:12345-0@lo:256: Request processed in 201us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216824.758031:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782216824.758133:0:6496:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c80dfd6c pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:6496:1868789712946688:0@lo:256: 10000000:01000000:0.0:1782216824.758996:0:6496:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1782216824.759053:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 00000000d46adbff/0x92b8e04cbf5f8f1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f8f23 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216824.759063:0:6496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: 00000000d46adbff/0x92b8e04cbf5f8f1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f8f23 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782216824.759216:0:6496:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff952e70905800 from 1 10000000:01000000:1.0:1782216824.759219:0:6496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782216824.759255:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 000000009d542441/0x92b8e04cbf5f8f2a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216824.759262:0:6496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 000000009d542441/0x92b8e04cbf5f8f2a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216824.759270:0:6496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 000000009d542441/0x92b8e04cbf5f8f2a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216824.759309:0:6496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000399646c1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:6496:1868789712946816:0@lo:101: 00000100:00100000:1.0:1782216824.759350:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216824.759414:0:6496:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ecd81f84 going to sleep for 11 seconds 00000100:00100000:3.0:1782216824.759448:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712946816 00000100:00100000:3.0:1782216824.759454:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712946816 00000100:00100000:3.0:1782216824.759812:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782216824.759821:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003a476381 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+10:6496:x1868789712946816:12345-0@lo:101: 00010000:00010000:3.0:1782216824.759831:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782216824.759846:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d5796596/0x92b8e04cbf5f8f31 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f8f2a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.759864:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d5796596/0x92b8e04cbf5f8f31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f8f2a expref: 11 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.759872:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d5796596/0x92b8e04cbf5f8f31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f8f2a expref: 11 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.759880:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d5796596, rc 0) 00000100:00100000:3.0:1782216824.759923:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003a476381 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+11:6496:x1868789712946816:12345-0@lo:101: Request processed in 104us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216824.759931:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782216824.760000:0:6496:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000399646c1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:6496:1868789712946816:0@lo:101: 00010000:00010000:2.0:1782216824.760012:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 000000009d542441/0x92b8e04cbf5f8f2a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f8f31 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216824.760019:0:6496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 000000009d542441/0x92b8e04cbf5f8f2a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f8f31 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216824.760079:0:6496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e15b6b32 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:6496:1868789712946944:0@lo:501: 00000100:00100000:2.0:1782216824.760104:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216824.760128:0:6496:0:(client.c:2701:ptlrpc_set_wait()) set 00000000760bcbda going to sleep for 11 seconds 00000100:00100000:1.0:1782216824.760165:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712946944 00000100:00100000:1.0:1782216824.760169:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712946944 00000100:00100000:1.0:1782216824.760201:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782216824.760207:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000779abeb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+11:6496:x1868789712946944:12345-0@lo:501: 00000100:00100000:1.0:1782216824.760350:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000779abeb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+11:6496:x1868789712946944:12345-0@lo:501: Request processed in 144us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216824.760357:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782216824.760413:0:6496:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e15b6b32 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:6496:1868789712946944:0@lo:501: 00000100:00100000:1.0:1782216824.760439:0:6496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006a01a77d pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:6496:1868789712947072:0@lo:503: 00000100:00100000:1.0:1782216824.760475:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216824.760666:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712947072 00000100:00100000:2.0:1782216824.760670:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712947072 00000100:00100000:2.0:1782216824.760688:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782216824.760694:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006f705b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+11:6496:x1868789712947072:12345-0@lo:503: 00000040:00080000:2.0:1782216824.760725:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782216824.760758:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006f705b82 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+11:6496:x1868789712947072:12345-0@lo:503: Request processed in 63us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216824.760773:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782216824.760839:0:6496:0:(client.c:2701:ptlrpc_set_wait()) set 000000009d7787fb going to sleep for 11 seconds 00000100:00100000:1.0:1782216824.760854:0:6496:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006a01a77d pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:6496:1868789712947072:0@lo:503: 00000040:00080000:1.0:1782216824.761884:0:6544:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1782216824.762154:0:6496:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1782216824.762183:0:6496:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782216824.762231:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 000000009d542441/0x92b8e04cbf5f8f2a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f8f31 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216824.762242:0:6496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: 000000009d542441/0x92b8e04cbf5f8f2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f8f31 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782216824.762292:0:6496:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1782216824.762295:0:6496:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff952e70905800 10000000:01000000:2.0:1782216824.762306:0:6496:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff952e70905800 10000000:01000000:2.0:1782216824.762310:0:6496:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1782216824.762315:0:6496:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff952e70905800 from 1 10000000:01000000:2.0:1782216824.762318:0:6496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782216824.762347:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 00000000c9d20577/0x92b8e04cbf5f8f38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216824.762355:0:6496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 00000000c9d20577/0x92b8e04cbf5f8f38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216824.762364:0:6496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 00000000c9d20577/0x92b8e04cbf5f8f38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216824.762382:0:6496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000000d969237 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:6496:1868789712947200:0@lo:101: 00000100:00100000:2.0:1782216824.762433:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216824.762472:0:6496:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e010eeb2 going to sleep for 11 seconds 00000100:00100000:3.0:1782216824.762996:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712947200 00000100:00100000:3.0:1782216824.763003:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712947200 00000100:00100000:3.0:1782216824.763052:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782216824.763060:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009744d96e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+11:6496:x1868789712947200:12345-0@lo:101: 00010000:00010000:3.0:1782216824.763071:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782216824.763082:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f60bdbf1/0x92b8e04cbf5f8f3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f8f38 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.763103:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f60bdbf1/0x92b8e04cbf5f8f3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f8f38 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.763112:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f60bdbf1/0x92b8e04cbf5f8f3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f8f38 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.763120:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f60bdbf1, rc 0) 00000100:00100000:3.0:1782216824.763159:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009744d96e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+12:6496:x1868789712947200:12345-0@lo:101: Request processed in 100us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216824.763179:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782216824.763371:0:6496:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000000d969237 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:6496:1868789712947200:0@lo:101: 00010000:00010000:2.0:1782216824.763387:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 00000000c9d20577/0x92b8e04cbf5f8f38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f8f3f expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216824.763403:0:6496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 00000000c9d20577/0x92b8e04cbf5f8f38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f8f3f expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216824.763453:0:6496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000000d969237 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:6496:1868789712947328:0@lo:501: 00000100:00100000:2.0:1782216824.763489:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216824.763789:0:6496:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e010eeb2 going to sleep for 11 seconds 00000100:00100000:3.0:1782216824.763886:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712947328 00000100:00100000:3.0:1782216824.763891:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712947328 00000100:00100000:3.0:1782216824.763950:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782216824.763958:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000023005c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+12:6496:x1868789712947328:12345-0@lo:501: 00000100:00100000:3.0:1782216824.764072:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000023005c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+12:6496:x1868789712947328:12345-0@lo:501: Request processed in 115us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216824.764079:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782216824.764136:0:6496:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000000d969237 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:6496:1868789712947328:0@lo:501: 00000100:00100000:1.0:1782216824.764164:0:6496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006a01a77d pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:6496:1868789712947456:0@lo:503: 00000100:00100000:1.0:1782216824.764201:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216824.764312:0:6496:0:(client.c:2701:ptlrpc_set_wait()) set 000000002e6b772c going to sleep for 11 seconds 00000100:00100000:2.0:1782216824.764386:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712947456 00000100:00100000:2.0:1782216824.764390:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712947456 00000100:00100000:2.0:1782216824.764411:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782216824.764416:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c6e331b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+12:6496:x1868789712947456:12345-0@lo:503: 00000100:00100000:2.0:1782216824.764696:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c6e331b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+12:6496:x1868789712947456:12345-0@lo:503: Request processed in 279us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216824.764702:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1782216824.764907:0:6496:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006a01a77d pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:6496:1868789712947456:0@lo:503: 00000100:00100000:3.0:1782216824.765200:0:6545:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007cd86ed5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:6545:1868789712947584:0@lo:502: 00000100:00100000:3.0:1782216824.765241:0:6545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216824.765271:0:6545:0:(client.c:2701:ptlrpc_set_wait()) set 000000003320988f going to sleep for 11 seconds 00000100:00100000:2.0:1782216824.765318:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712947584 00000100:00100000:2.0:1782216824.765322:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712947584 00000100:00100000:2.0:1782216824.765352:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782216824.765359:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000097c33f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+12:6545:x1868789712947584:12345-0@lo:502: 00000100:00100000:2.0:1782216824.765440:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000097c33f5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+12:6545:x1868789712947584:12345-0@lo:502: Request processed in 81us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216824.765446:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782216824.765799:0:6545:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007cd86ed5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:6545:1868789712947584:0@lo:502: 00000020:01000004:1.0:1782216824.765851:0:6545:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1782216824.765870:0:6545:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000027a5c08c) 00000020:00000080:1.0:1782216824.765886:0:6545:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1782216824.766095:0:6545:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000a2ed9939 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1782216824.766099:0:6545:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000a2ed9939 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1782216824.766101:0:6545:0:(obd_mount.c:701:lustre_put_lsi()) put 00000000a2ed9939 4 00010000:00080000:1.0:1782216824.766127:0:6545:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000226bf9f2@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.130@tcp at head 00010000:00010000:1.0:1782216824.770776:0:6545:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1782216824.781385:0:6545:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1782216824.781431:0:6545:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1782216824.781443:0:6545:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x92b8e04cbf5f8f4d 00000100:00080000:1.0:1782216824.781453:0:6545:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782216824.781459:0:6545:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000226bf9f2 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1782216824.783345:0:6545:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006a01a77d x1868789712947712/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782216824.783386:0:6545:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1782216824.783689:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006a01a77d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1868789712947712:0@lo:38: 00000100:00100000:2.0:1782216824.783760:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216824.784056:0:6545:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c80dfd6c pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:6545:1868789712947840:0@lo:502: 00000100:00100000:0.0:1782216824.784113:0:6545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216824.784138:0:6545:0:(client.c:2701:ptlrpc_set_wait()) set 000000009094c586 going to sleep for 11 seconds 00000100:00100000:2.0:1782216824.787862:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712947840 00000100:00100000:2.0:1782216824.787877:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712947840 00000100:00100000:2.0:1782216824.787937:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1782216824.787946:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a904656 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+12:6545:x1868789712947840:12345-0@lo:502: 00000100:00100000:2.0:1782216824.788128:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a904656 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+12:6545:x1868789712947840:12345-0@lo:502: Request processed in 184us (4015us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216824.788136:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782216824.788157:0:6545:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c80dfd6c pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:6545:1868789712947840:0@lo:502: 00000040:00080000:0.0:1782216824.788192:0:6545:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000100:00100000:3.0:1782216824.791710:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712947712 00000100:00100000:3.0:1782216824.791724:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712947712 00000100:00100000:3.0:1782216824.791774:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782216824.791781:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003504a6f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1868789712947712:12345-0@lo:38: 00000100:00100000:0.0:1782216824.791784:0:6519:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1782216824.791792:0:6519:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1782216824.791873:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003504a6f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1868789712947712:12345-0@lo:38: Request processed in 91us (8113us total) trans 0 rc -11/-11 00000100:00100000:3.0:1782216824.791880:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782216824.791932:0:3646:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1782216824.791939:0:3646:0:(import.c:65:import_set_state_nolock()) 00000000226bf9f2 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782216824.791944:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1782216824.791947:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006a01a77d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1868789712947712:0@lo:38: 00000020:01000000:1.0:1782216824.792563:0:6496:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1782216824.792615:0:6496:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1782216824.792630:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 00000000c9d20577/0x92b8e04cbf5f8f38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f8f3f expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216824.792640:0:6496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: 00000000c9d20577/0x92b8e04cbf5f8f38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f8f3f expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1782216824.792688:0:6496:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1782216824.792690:0:6496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1782216824.792691:0:6496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782216824.792692:0:6496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782216824.792693:0:6496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782216824.792695:0:6496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782216824.792696:0:6496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1782216824.792697:0:6496:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1782216824.792702:0:6496:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782216824.792703:0:6496:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782216824.792704:0:6496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782216824.792705:0:6496:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1782216824.792708:0:6496:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1782216824.792710:0:6496:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1782216824.792711:0:6496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1782216824.792712:0:6496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782216824.792713:0:6496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782216824.792714:0:6496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782216824.792714:0:6496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782216824.792715:0:6496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1782216824.792716:0:6496:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1782216824.792717:0:6496:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782216824.792717:0:6496:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782216824.792718:0:6496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782216824.792719:0:6496:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1782216824.792738:0:6496:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1782216824.792754:0:6496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001fbe8659 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:6496:1868789712947968:0@lo:253: 00000100:00100000:1.0:1782216824.792802:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216824.792840:0:6496:0:(client.c:2701:ptlrpc_set_wait()) set 00000000d577f27d going to sleep for 11 seconds 00000100:00100000:3.0:1782216824.795599:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712947968 00000100:00100000:3.0:1782216824.795611:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712947968 00000100:00100000:3.0:1782216824.795669:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782216824.795676:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000052559734 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+12:6496:x1868789712947968:12345-0@lo:253: 20000000:01000000:3.0:1782216824.795723:0:6514:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1782216824.795737:0:6514:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1782216824.803128:0:6514:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1782216824.803147:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1782216824.803483:0:6534:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1782216824.803488:0:6534:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1782216824.803508:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000008e2888b/0x92b8e04cbf5f8f54 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216824.803525:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d15b8f7d/0x92b8e04cbf5f8f23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f8f1c expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216824.803534:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000008e2888b/0x92b8e04cbf5f8f54 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216824.803571:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d15b8f7d/0x92b8e04cbf5f8f23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5f8f1c expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216824.803631:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d15b8f7d/0x92b8e04cbf5f8f23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5f8f1c expref: 12 pid: 6514 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216824.803645:0:6534:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c80dfd6c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1868789712948096:0@lo:104: 00000100:00100000:0.0:1782216824.803679:0:6534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216824.803689:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000052559734 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+12:6496:x1868789712947968:12345-0@lo:253: Request processed in 8012us (10886us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216824.803698:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782216824.803718:0:6534:0:(client.c:2701:ptlrpc_set_wait()) set 000000008cb187f6 going to sleep for 11 seconds 00000100:00100000:2.0:1782216824.803811:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712948096 00000100:00100000:2.0:1782216824.803818:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712948096 00000100:00100000:2.0:1782216824.803859:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782216824.803867:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000056503a19 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+3:6534:x1868789712948096:12345-0@lo:104: 00010000:00010000:2.0:1782216824.803878:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: 00000000d46adbff/0x92b8e04cbf5f8f1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f8f23 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216824.803919:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782216824.803924:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000056503a19 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+3:6534:x1868789712948096:12345-0@lo:104: Request processed in 59us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216824.803930:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782216824.804032:0:6496:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001fbe8659 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:6496:1868789712947968:0@lo:253: 10000000:01000000:1.0:1782216824.804044:0:6496:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1782216824.804047:0:6496:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1782216824.804049:0:6496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1782216824.804050:0:6496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782216824.804051:0:6496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782216824.804052:0:6496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782216824.804053:0:6496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782216824.804054:0:6496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1782216824.804056:0:6496:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1782216824.804057:0:6496:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782216824.804058:0:6496:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782216824.804060:0:6496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782216824.804061:0:6496:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1782216824.804075:0:6496:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1782216824.804104:0:6534:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c80dfd6c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1868789712948096:0@lo:104: 00010000:00010000:0.0:1782216824.804117:0:6534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000008e2888b/0x92b8e04cbf5f8f54 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.807568:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782216824.807602:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: 00000000d46adbff/0x92b8e04cbf5f8f1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f8f23 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.807616:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d46adbff already unused, calling callback (000000002754abcf) 10000000:00010000:3.0:1782216824.807619:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: 00000000d46adbff/0x92b8e04cbf5f8f1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5f8f23 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.807629:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: 00000000d46adbff/0x92b8e04cbf5f8f1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5f8f23 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782216824.807636:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: 00000000d46adbff/0x92b8e04cbf5f8f1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5f8f23 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782216824.807642:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1782216824.807692:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: 00000000d46adbff/0x92b8e04cbf5f8f1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f8f23 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.807699:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782216824.807721:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: 00000000d46adbff/0x92b8e04cbf5f8f1c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f8f23 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.807727:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: 00000000d46adbff/0x92b8e04cbf5f8f1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f8f23 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.807763:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216824.807765:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216824.807771:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782216824.808698:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782216824.808717:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000af66a1c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789712948224:0@lo:103: 00000100:00100000:0.0:1782216824.808780:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216824.810332:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712948224 00000100:00100000:3.0:1782216824.810342:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712948224 00010000:00010000:3.0:1782216824.810381:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d15b8f7d/0x92b8e04cbf5f8f23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f8f1c expref: 12 pid: 6514 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216824.810419:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782216824.810427:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c80dfd6c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+12:3647:x1868789712948224:12345-0@lo:103: 00010000:00010000:3.0:1782216824.810440:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782216824.810445:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d15b8f7d/0x92b8e04cbf5f8f23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f8f1c expref: 12 pid: 6514 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.810455:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d15b8f7d/0x92b8e04cbf5f8f23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5f8f1c expref: 12 pid: 6514 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.810470:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d15b8f7d/0x92b8e04cbf5f8f23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5f8f1c expref: 12 pid: 6514 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.810481:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000008e2888b/0x92b8e04cbf5f8f54 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.810488:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000008e2888b/0x92b8e04cbf5f8f54 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1782216824.810514:0:6504:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007026663s 00010000:00010000:3.0:1782216824.810517:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000008e2888b/0x92b8e04cbf5f8f54 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.810534:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000008e2888b/0x92b8e04cbf5f8f54 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.810539:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000008e2888b/0x92b8e04cbf5f8f54 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.810544:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000008e2888b/0x92b8e04cbf5f8f54 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.810549:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000008e2888b already unused, calling callback (00000000e53a7aa9) 00010000:00010000:3.0:1782216824.810553:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000008e2888b/0x92b8e04cbf5f8f54 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.810560:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000008e2888b/0x92b8e04cbf5f8f54 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.810579:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000008e2888b/0x92b8e04cbf5f8f54 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216824.810609:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782216824.810662:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c80dfd6c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+11:3647:x1868789712948224:12345-0@lo:103: Request processed in 236us (1882us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216824.810671:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782216824.810709:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000af66a1c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789712948224:0@lo:103: 00010000:00010000:0.0:1782216824.810893:0:6534:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000008e2888b/0x92b8e04cbf5f8f54 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216824.810902:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000008e2888b/0x92b8e04cbf5f8f54 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216824.810913:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000008e2888b/0x92b8e04cbf5f8f54 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1782216824.814207:0:6496:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:0.0:1782216824.814776:0:6496:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1782216824.815006:0:6496:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:0.0:1782216824.815169:0:6496:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1782216824.816097:0:6496:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:0.0:1782216824.816453:0:6496:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1782216824.817360:0:6496:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:0.0:1782216824.817817:0:6496:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1782216824.818092:0:6496:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:0.0:1782216824.818363:0:6496:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1782216824.818802:0:6496:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:0.0:1782216824.819065:0:6496:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:2.0:1782216824.824479:0:6496:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1782216824.833183:0:6496:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1782216824.833621:0:6552:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1782216824.834991:0:6496:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1782216824.835111:0:6496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1782216824.836087:0:6496:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1782216824.836113:0:6496:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1782216824.836254:0:6496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:3.0:1782216824.836460:0:6551:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1782216824.836464:0:6551:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:0.0:1782216824.841008:0:6496:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1782216824.841656:0:6496:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1782216824.841694:0:6496:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1782216824.841945:0:6496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1782216824.842195:0:6496:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:0.0:1782216824.842938:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1782216824.843077:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1782216824.843233:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1782216824.843412:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1782216824.843564:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1782216824.843747:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1782216824.843906:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1782216824.844055:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1782216824.844224:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00000040:00080000:3.0:1782216824.848864:0:6552:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:0.0:1782216824.849789:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1782216824.853623:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1782216824.853805:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1782216824.853938:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1782216824.854081:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1782216824.854249:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1782216824.854408:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1782216824.854735:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1782216824.854891:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1782216824.855040:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1782216824.855178:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1782216824.855347:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1782216824.855512:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1782216824.855682:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1782216824.855819:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1782216824.855976:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1782216824.856131:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1782216824.856289:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00000040:00080000:2.0:1782216824.860476:0:6552:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1782216824.860571:0:6552:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1782216824.860576:0:6552:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:0.0:1782216824.864012:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1782216824.864172:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1782216824.864337:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1782216824.867128:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1782216824.867341:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1782216824.868083:0:6496:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:1.0:1782216824.872867:0:6496:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1782216824.872911:0:6496:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa4bf81947988 00100000:10000000:1.0:1782216824.872919:0:6496:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1782216824.873867:0:6496:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1782216824.873883:0:6496:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.130@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1782216824.873904:0:6496:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1782216824.873922:0:6496:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1782216824.874846:0:6496:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782216824.875026:0:6496:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1782216825.337491:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216826.365265:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216827.384758:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216828.410729:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782216828.623476:0:6797:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:2.0:1782216829.365124:0:6849:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782216829.365293:0:6849:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1782216829.433893:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1782216830.010376:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1782216830.010408:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1782216830.010411:0:36:0:(import.c:65:import_set_state_nolock()) 00000000226bf9f2 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782216830.010429:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000226bf9f2 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1782216830.010457:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000075ad30e4 x1868789712948480/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782216830.010507:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000075ad30e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1868789712948480:0@lo:38: 00000100:00100000:3.0:1782216830.011095:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216830.011255:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000af66a1c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789712948352:0@lo:400: 00000100:00100000:1.0:1782216830.011313:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216830.011422:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712948352 00000100:00100000:1.0:1782216830.011430:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712948352 00000100:00100000:1.0:1782216830.011475:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782216830.011483:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d328cc40 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+11:3649:x1868789712948352:12345-0@lo:400: 00000100:00100000:1.0:1782216830.011537:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d328cc40 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+11:3649:x1868789712948352:12345-0@lo:400: Request processed in 55us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216830.011542:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782216830.012479:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000af66a1c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789712948352:0@lo:400: 00000100:00100000:2.0:1782216830.017365:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712948480 00000100:00100000:2.0:1782216830.017383:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712948480 00000100:00100000:2.0:1782216830.017453:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782216830.017462:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000122d957d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1868789712948480:12345-0@lo:38: 00010000:00080000:2.0:1782216830.017510:0:6520:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 192 last 0 00000020:00000080:2.0:1782216830.017557:0:6520:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x92b8e04cbf5f8f5b 00000004:00100000:2.0:1782216830.017758:0:6520:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1782216830.017945:0:6520:0:(import.c:65:import_set_state_nolock()) 000000007cf4035f : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782216830.018029:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000122d957d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1868789712948480:12345-0@lo:38: Request processed in 566us (6941us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216830.018041:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1782216830.018070:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000075ad30e4 x1868789712948480/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782216840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1782216830.018087:0:3646:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1782216830.018095:0:3646:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1782216830.018101:0:3646:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1782216830.018103:0:3646:0:(import.c:65:import_set_state_nolock()) 00000000226bf9f2 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1782216830.018113:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000075ad30e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1868789712948480:0@lo:38: 00010000:00010000:1.0:1782216830.458851:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216831.481333:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1782216831.953518:0:6950:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782216831.953951:0:6950:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1782216832.506202:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782216832.568849:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1782216832.568857:0:6516:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff952e70905800 from 3 10000000:01000000:2.0:1782216832.568862:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1782216832.568906:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 000000003a7b1a0d/0x92b8e04cbf5f8f62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216832.568918:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 000000003a7b1a0d/0x92b8e04cbf5f8f62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216832.568929:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 000000003a7b1a0d/0x92b8e04cbf5f8f62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216832.568951:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b5dc7e76 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712948608:0@lo:101: 00000100:00100000:2.0:1782216832.569017:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216832.569134:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e984c6c4 going to sleep for 11 seconds 00000100:00100000:3.0:1782216832.570197:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712948608 00000100:00100000:3.0:1782216832.570213:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712948608 00000100:00100000:0.0:1782216832.572901:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782216832.572914:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034143b57 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+11:6516:x1868789712948608:12345-0@lo:101: 00010000:00010000:0.0:1782216832.572933:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782216832.572957:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004e145038/0x92b8e04cbf5f8f69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f8f62 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216832.573042:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004e145038/0x92b8e04cbf5f8f69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f8f62 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216832.573053:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004e145038/0x92b8e04cbf5f8f69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f8f62 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216832.573062:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004e145038, rc 0) 00000100:00100000:0.0:1782216832.573138:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034143b57 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+12:6516:x1868789712948608:12345-0@lo:101: Request processed in 226us (4121us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216832.573145:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782216832.573172:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b5dc7e76 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712948608:0@lo:101: 00010000:00010000:2.0:1782216832.573191:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 000000003a7b1a0d/0x92b8e04cbf5f8f62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f8f69 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216832.573199:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 000000003a7b1a0d/0x92b8e04cbf5f8f62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f8f69 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216832.573305:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d4c218f5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712948736:0@lo:256: 00000100:00100000:0.0:1782216832.573392:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216832.573464:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set 000000007f29c85f going to sleep for 11 seconds 00000100:00100000:1.0:1782216832.573505:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712948736 00000100:00100000:1.0:1782216832.573511:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712948736 00000100:00100000:1.0:1782216832.573860:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1782216832.573868:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ce7b906 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+12:6516:x1868789712948736:12345-0@lo:256: 20000000:01000000:1.0:1782216832.573883:0:6511:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1782216832.573898:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1782216832.573901:0:6511:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1782216832.573996:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ce7b906 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+12:6516:x1868789712948736:12345-0@lo:256: Request processed in 129us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216832.574004:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1782216832.574083:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d4c218f5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712948736:0@lo:256: 10000000:01000000:2.0:1782216832.574123:0:6516:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1782216832.574133:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 000000003a7b1a0d/0x92b8e04cbf5f8f62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f8f69 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216832.574140:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: 000000003a7b1a0d/0x92b8e04cbf5f8f62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f8f69 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216833.528912:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216834.552878:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782216835.130618:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d27ad824 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17bce19a-7a0f-4c9d-b31c-4e0155298487:3650:1868789712948864:0@lo:400: 00000100:00100000:0.0:1782216835.130689:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216835.130760:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782216835.130768:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000403cd164 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1868789712948992:0@lo:400: 00000100:00100000:0.0:1782216835.130806:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216835.130835:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712948864 00000100:00100000:0.0:1782216835.130841:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712948864 00000100:00100000:0.0:1782216835.130883:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782216835.130890:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b878a950 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+12:3650:x1868789712948864:12345-0@lo:400: 00000100:00100000:0.0:1782216835.130937:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b878a950 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+12:3650:x1868789712948864:12345-0@lo:400: Request processed in 47us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216835.130944:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782216835.130972:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712948992 00000100:00100000:0.0:1782216835.130975:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712948992 00000100:00100000:0.0:1782216835.131000:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782216835.131005:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003632649d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1868789712948992:12345-0@lo:400: 00000100:00100000:0.0:1782216835.131038:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003632649d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1868789712948992:12345-0@lo:400: Request processed in 34us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216835.131044:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1782216835.131081:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000403cd164 x1868789712948992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216835.131093:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000403cd164 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1868789712948992:0@lo:400: 00000100:00100000:0.0:1782216835.131116:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d27ad824 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17bce19a-7a0f-4c9d-b31c-4e0155298487:3650:1868789712948864:0@lo:400: 00010000:00010000:2.0:1782216835.576763:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216836.602837:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216837.624872:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216838.648789:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216839.677814:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782216840.248814:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d27ad824 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17bce19a-7a0f-4c9d-b31c-4e0155298487:3648:1868789712949120:0@lo:400: 00000100:00100000:0.0:1782216840.248902:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216840.248970:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000403cd164 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1868789712949248:0@lo:400: 00000100:00100000:0.0:1782216840.249000:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216840.249043:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712949120 00000100:00100000:0.0:1782216840.249051:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712949120 00000100:00100000:0.0:1782216840.249113:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782216840.249121:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000071c2c90c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+12:3648:x1868789712949120:12345-0@lo:400: 00000100:00100000:0.0:1782216840.249177:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000071c2c90c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+12:3648:x1868789712949120:12345-0@lo:400: Request processed in 56us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216840.249197:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782216840.249236:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712949248 00000100:00100000:0.0:1782216840.249240:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712949248 00000100:00100000:0.0:1782216840.249341:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782216840.249349:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003cebd5b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1868789712949248:12345-0@lo:400: 00000100:00100000:0.0:1782216840.249385:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003cebd5b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1868789712949248:12345-0@lo:400: Request processed in 37us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216840.249391:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1782216840.249439:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000403cd164 x1868789712949248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216840.249455:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000403cd164 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1868789712949248:0@lo:400: 00000100:00100000:0.0:1782216840.249485:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d27ad824 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17bce19a-7a0f-4c9d-b31c-4e0155298487:3648:1868789712949120:0@lo:400: 00010000:00010000:1.0:1782216840.697934:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1782216841.071033:0:7449:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:0.0:1782216841.071037:0:7449:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1782216841.071038:0:7449:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1782216841.071159:0:7449:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000503b783f 00000020:01000004:0.0:1782216841.071174:0:7449:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:0.0:1782216841.071192:0:7449:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1782216841.071205:0:7449:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000dc0d1f44) 00000020:00000080:0.0:1782216841.071227:0:7449:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1782216841.132850:0:7449:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:1.0:1782216841.132925:0:7449:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:1.0:1782216841.167376:0:7449:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1782216841.167600:0:7449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1782216841.167610:0:7449:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1782216841.167622:0:7449:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x92b8e04cbf5f8f77 00000020:01000004:1.0:1782216841.167629:0:7449:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1782216841.167653:0:7449:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.130@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1782216841.167656:0:7449:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1782216841.167662:0:7449:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1782216841.167687:0:7449:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1782216841.167691:0:7449:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.130@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1782216841.199894:0:7449:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.130@tcp ctxt 0 is initialized 00000020:01000004:2.0:1782216841.199938:0:7449:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.130@tcp, index=0001, flags=0x20061 00000020:01000004:2.0:1782216841.199942:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1782216841.199944:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1782216841.199945:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782216841.199946:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782216841.199947:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782216841.199949:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782216841.199950:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782216841.199951:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782216841.199953:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782216841.199954:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782216841.199955:0:7449:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782216841.199959:0:7449:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:2.0:1782216841.199961:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782216841.199962:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1782216841.199963:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782216841.199964:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782216841.199965:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782216841.199966:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782216841.199971:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782216841.199972:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782216841.199973:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782216841.199974:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782216841.199975:0:7449:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782216841.200001:0:7449:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1782216841.200019:0:7449:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b5dc7e76 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:7449:1868789712949376:0@lo:253: 00000100:00100000:2.0:1782216841.200170:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216841.200290:0:7449:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f8ecd817 going to sleep for 11 seconds 00000100:00100000:1.0:1782216841.200389:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712949376 00000100:00100000:1.0:1782216841.200397:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712949376 00000100:00100000:1.0:1782216841.200484:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782216841.200492:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ebb20ed9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+12:7449:x1868789712949376:12345-0@lo:253: 20000000:01000000:1.0:1782216841.200534:0:6513:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1782216841.200538:0:6513:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:1.0:1782216841.200542:0:6513:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:1.0:1782216841.200544:0:6513:0:(mgs_llog.c:3603:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:1.0:1782216841.200579:0:6513:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:1.0:1782216841.200820:0:6513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782216841.200941:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1782216841.200958:0:6513:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1782216841.200974:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1782216841.200988:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1782216841.201001:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1782216841.201194:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:1.0:1782216841.201203:0:6513:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:1.0:1782216841.201218:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:1.0:1782216841.201223:0:6513:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:1.0:1782216841.201317:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:1.0:1782216841.201325:0:6513:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:1.0:1782216841.201339:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1782216841.201351:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1782216841.201441:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:1.0:1782216841.201449:0:6513:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.130@tcp (null) (null) (null) 00000040:00080000:1.0:1782216841.201461:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:1.0:1782216841.201466:0:6513:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1782216841.201477:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:1.0:1782216841.201483:0:6513:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.130@tcp (null) (null) 00000040:00080000:1.0:1782216841.201495:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:1.0:1782216841.201500:0:6513:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1782216841.201512:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1782216841.201528:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1782216841.201536:0:6513:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1782216841.201633:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:1.0:1782216841.201642:0:6513:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:1.0:1782216841.201655:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1782216841.201669:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1782216841.201684:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:1.0:1782216841.201689:0:6513:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:1.0:1782216841.201701:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1782216841.201730:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1782216841.201735:0:6513:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:1.0:1782216841.202139:0:6513:0:(mgs_llog.c:3300:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1782216841.202147:0:6513:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:2.0:1782216841.202733:0:7455:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1782216841.203011:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1782216841.203032:0:6513:0:(mgs_llog.c:3346:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.130@tcp for mdt 20000000:01000000:1.0:1782216841.203034:0:6513:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.130@tcp (null) (null) (null) 00000040:00080000:1.0:1782216841.203134:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1782216841.203142:0:6513:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1782216841.203154:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1782216841.203159:0:6513:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.130@tcp (null) (null) 00000040:00080000:1.0:1782216841.203174:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1782216841.203191:0:6513:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:1.0:1782216841.203204:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:1.0:1782216841.203217:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:1.0:1782216841.203321:0:6513:0:(mgs_llog.c:3426:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:1.0:1782216841.203330:0:6513:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:2.0:1782216841.203705:0:7456:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:1.0:1782216841.203902:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1782216841.203917:0:6513:0:(mgs_llog.c:3484:mgs_write_log_osp_to_mdt()) add nid 192.168.203.130@tcp for mdt 20000000:01000000:1.0:1782216841.203918:0:6513:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.130@tcp (null) (null) (null) 00000040:00080000:1.0:1782216841.203929:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1782216841.203934:0:6513:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1782216841.203943:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1782216841.203947:0:6513:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.130@tcp (null) (null) 00000040:00080000:1.0:1782216841.203956:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1782216841.203961:0:6513:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:1.0:1782216841.203970:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1782216841.203981:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:1.0:1782216841.203996:0:6513:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1782216841.203998:0:6513:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1782216841.204006:0:6513:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1782216841.204045:0:6513:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1782216841.204047:0:6513:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1782216841.204455:0:7457:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1782216841.204540:0:7457:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1782216841.204558:0:7457:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1782216841.204832:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1782216841.204851:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1782216841.204871:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1782216841.204880:0:6513:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1782216841.204882:0:6513:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1782216841.205186:0:7458:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1782216841.205204:0:7458:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1782216841.205217:0:7458:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1782216841.205405:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:1.0:1782216841.205423:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:1.0:1782216841.205454:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:1.0:1782216841.205466:0:6513:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1782216841.205467:0:6513:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1782216841.206198:0:7459:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1782216841.206221:0:7459:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1782216841.206235:0:7459:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:1.0:1782216841.206543:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1782216841.206569:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1782216841.206687:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:1.0:1782216841.206703:0:6513:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1782216841.206705:0:6513:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1782216841.206710:0:6513:0:(mgs_llog.c:5063:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1782216841.206717:0:6513:0:(mgs_llog.c:1376:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1782216841.207040:0:7460:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:1.0:1782216841.207234:0:6513:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:1.0:1782216841.219616:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1782216841.219667:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d15b8f7d/0x92b8e04cbf5f8f7e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.219685:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d8da30e3/0x92b8e04cbf5f8eb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f8eac expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.219692:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000aff09b4c/0x92b8e04cbf5f8ecf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f8ec8 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.219715:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f60bdbf1/0x92b8e04cbf5f8f3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f8f38 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.219721:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000d15b8f7d/0x92b8e04cbf5f8f7e lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.219759:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f60bdbf1/0x92b8e04cbf5f8f3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5f8f38 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.219772:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f60bdbf1/0x92b8e04cbf5f8f3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5f8f38 expref: 12 pid: 6511 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216841.219785:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001fbe8659 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1868789712949504:0@lo:104: 00000100:00100000:1.0:1782216841.220036:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782216841.220728:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000aff09b4c/0x92b8e04cbf5f8ecf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5f8ec8 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.220739:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000aff09b4c/0x92b8e04cbf5f8ecf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5f8ec8 expref: 12 pid: 6511 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216841.220748:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000045cc1a30 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1868789712949632:0@lo:104: 00000100:00100000:1.0:1782216841.220779:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782216841.223146:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d8da30e3/0x92b8e04cbf5f8eb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5f8eac expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.223165:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d8da30e3/0x92b8e04cbf5f8eb3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5f8eac expref: 12 pid: 6511 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216841.223187:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b87482f3 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1868789712949760:0@lo:104: 00000100:00100000:1.0:1782216841.223253:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216841.223376:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712949504 00000100:00100000:0.0:1782216841.223384:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712949504 00000100:00100000:0.0:1782216841.223423:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712949632 00000100:00100000:0.0:1782216841.223426:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712949632 00000100:00100000:0.0:1782216841.223450:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782216841.223457:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007913da60 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+4:6513:x1868789712949504:12345-0@lo:104: 00010000:00010000:0.0:1782216841.223469:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: 00000000c9d20577/0x92b8e04cbf5f8f38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f8f3f expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216841.223541:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782216841.223546:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007913da60 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+4:6513:x1868789712949504:12345-0@lo:104: Request processed in 90us (3512us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216841.223554:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782216841.223572:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1782216841.223575:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782216841.223597:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: 00000000c9d20577/0x92b8e04cbf5f8f38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f8f3f expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216841.223605:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c9d20577 already unused, calling callback (000000002754abcf) 10000000:00010000:3.0:1782216841.223618:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: 00000000c9d20577/0x92b8e04cbf5f8f38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5f8f3f expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216841.223626:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: 00000000c9d20577/0x92b8e04cbf5f8f38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5f8f3f expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782216841.223644:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: 00000000c9d20577/0x92b8e04cbf5f8f38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5f8f3f expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782216841.223649:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1782216841.223672:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000411d5618 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+3:6513:x1868789712949632:12345-0@lo:104: 00010000:00010000:3.0:1782216841.223680:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: 00000000c9d20577/0x92b8e04cbf5f8f38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f8f3f expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216841.223683:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: 00000000baa50e3c/0x92b8e04cbf5f8ec8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f8ecf expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216841.223698:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782216841.223718:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: 00000000c9d20577/0x92b8e04cbf5f8f38 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f8f3f expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216841.223724:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: 00000000c9d20577/0x92b8e04cbf5f8f38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f8f3f expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216841.223740:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782216841.223742:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00010000:00010000:3.0:1782216841.223743:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: 00000000baa50e3c/0x92b8e04cbf5f8ec8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f8ecf expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216841.223751:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000411d5618 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+3:6513:x1868789712949632:12345-0@lo:104: Request processed in 172us (2970us total) trans 0 rc 0/0 00010000:00010000:3.0:1782216841.223756:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000baa50e3c already unused, calling callback (000000002754abcf) 10000000:00010000:3.0:1782216841.223760:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: 00000000baa50e3c/0x92b8e04cbf5f8ec8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5f8ecf expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216841.223763:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1782216841.223772:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: 00000000baa50e3c/0x92b8e04cbf5f8ec8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5f8ecf expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782216841.223777:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: 00000000baa50e3c/0x92b8e04cbf5f8ec8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5f8ecf expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216841.223782:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782216841.223783:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782216841.223804:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: 00000000baa50e3c/0x92b8e04cbf5f8ec8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f8ecf expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216841.223810:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782216841.223832:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: 00000000baa50e3c/0x92b8e04cbf5f8ec8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f8ecf expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216841.223839:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: 00000000baa50e3c/0x92b8e04cbf5f8ec8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f8ecf expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216841.223849:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216841.223851:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216841.223852:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782216841.223873:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000075ad30e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17bce19a-7a0f-4c9d-b31c-4e0155298487:3650:1868789712949888:0@lo:103: 00000100:00100000:3.0:1782216841.223903:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216841.223959:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782216841.223967:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000fd3f6737 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17bce19a-7a0f-4c9d-b31c-4e0155298487:3648:1868789712950016:0@lo:103: 00000100:00100000:3.0:1782216841.223995:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216841.224020:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712949888 00000100:00100000:3.0:1782216841.224023:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712949888 00010000:00010000:3.0:1782216841.224041:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f60bdbf1/0x92b8e04cbf5f8f3f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f8f38 expref: 13 pid: 6511 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216841.224062:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712950016 00000100:00100000:3.0:1782216841.224065:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712950016 00010000:00010000:3.0:1782216841.224077:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000aff09b4c/0x92b8e04cbf5f8ecf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f8ec8 expref: 14 pid: 6511 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216841.224088:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712949760 00000100:00100000:3.0:1782216841.224092:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782216841.224095:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712949760 00000100:00100000:3.0:1782216841.224101:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005bbf4046 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+14:3650:x1868789712949888:12345-0@lo:103: 00010000:00010000:3.0:1782216841.224119:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1782216841.224120:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1782216841.224127:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f60bdbf1/0x92b8e04cbf5f8f3f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f8f38 expref: 14 pid: 6511 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216841.224131:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006f7bc1d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+3:6513:x1868789712949760:12345-0@lo:104: 00010000:00010000:1.0:1782216841.224142:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: 00000000bfc4eaae/0x92b8e04cbf5f8eac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f8eb3 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216841.224145:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f60bdbf1/0x92b8e04cbf5f8f3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5f8f38 expref: 14 pid: 6511 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216841.224170:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782216841.224201:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782216841.224207:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006f7bc1d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+3:6513:x1868789712949760:12345-0@lo:104: Request processed in 80us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216841.224213:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782216841.224228:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005bbf4046 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+14:3650:x1868789712949888:12345-0@lo:103: Request processed in 128us (324us total) trans 0 rc 0/0 00010000:00010000:1.0:1782216841.224228:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782216841.224235:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: 00000000bfc4eaae/0x92b8e04cbf5f8eac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f8eb3 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216841.224241:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1782216841.224248:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bfc4eaae already unused, calling callback (000000002754abcf) 10000000:00010000:1.0:1782216841.224250:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: 00000000bfc4eaae/0x92b8e04cbf5f8eac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5f8eb3 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216841.224262:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782216841.224267:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009bdd7931 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+13:3648:x1868789712950016:12345-0@lo:103: 00010000:00010000:3.0:1782216841.224275:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782216841.224278:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000aff09b4c/0x92b8e04cbf5f8ecf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f8ec8 expref: 13 pid: 6511 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216841.224286:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000aff09b4c/0x92b8e04cbf5f8ecf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5f8ec8 expref: 13 pid: 6511 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216841.224295:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782216841.224327:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009bdd7931 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+13:3648:x1868789712950016:12345-0@lo:103: Request processed in 58us (330us total) trans 0 rc 0/0 00010000:00010000:1.0:1782216841.224327:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: 00000000bfc4eaae/0x92b8e04cbf5f8eac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5f8eb3 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782216841.224343:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: 00000000bfc4eaae/0x92b8e04cbf5f8eac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5f8eb3 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216841.224348:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 10000000:01000000:1.0:1782216841.224354:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782216841.224381:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: 00000000bfc4eaae/0x92b8e04cbf5f8eac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f8eb3 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216841.224395:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000fd3f6737 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17bce19a-7a0f-4c9d-b31c-4e0155298487:3648:1868789712950016:0@lo:103: 00010000:00010000:1.0:1782216841.224402:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782216841.224412:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: 00000000bfc4eaae/0x92b8e04cbf5f8eac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f8eb3 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216841.224418:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000006a9b1f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17bce19a-7a0f-4c9d-b31c-4e0155298487:3648:1868789712950144:0@lo:103: 00010000:00010000:1.0:1782216841.224419:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: 00000000bfc4eaae/0x92b8e04cbf5f8eac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f8eb3 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.224440:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216841.224442:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216841.224444:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782216841.224448:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216841.224457:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set 0000000059f6237f going to sleep for 11 seconds 00010000:00010000:1.0:1782216841.224477:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f60bdbf1/0x92b8e04cbf5f8f3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5f8f38 expref: 12 pid: 6511 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216841.224484:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000075ad30e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17bce19a-7a0f-4c9d-b31c-4e0155298487:3650:1868789712949888:0@lo:103: 00000100:00100000:1.0:1782216841.224489:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001fbe8659 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1868789712949504:0@lo:104: 00010000:00010000:1.0:1782216841.224508:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000aff09b4c/0x92b8e04cbf5f8ecf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5f8ec8 expref: 11 pid: 6511 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216841.224516:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712950144 00000100:00100000:3.0:1782216841.224520:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712950144 00000100:00100000:1.0:1782216841.224531:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000045cc1a30 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1868789712949632:0@lo:104: 00010000:00010000:3.0:1782216841.224534:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d8da30e3/0x92b8e04cbf5f8eb3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f8eac expref: 11 pid: 6511 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216841.224547:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b87482f3 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1868789712949760:0@lo:104: 00000100:00100000:3.0:1782216841.224559:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1782216841.224566:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000d15b8f7d/0x92b8e04cbf5f8f7e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216841.224567:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd3f6737 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+11:3648:x1868789712950144:12345-0@lo:103: 00010000:00010000:3.0:1782216841.224579:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782216841.224607:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d8da30e3/0x92b8e04cbf5f8eb3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f8eac expref: 11 pid: 6511 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216841.224616:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d8da30e3/0x92b8e04cbf5f8eb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5f8eac expref: 11 pid: 6511 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216841.224625:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d8da30e3/0x92b8e04cbf5f8eb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5f8eac expref: 11 pid: 6511 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216841.224635:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000d15b8f7d/0x92b8e04cbf5f8f7e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216841.224641:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d15b8f7d/0x92b8e04cbf5f8f7e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216841.224663:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d15b8f7d/0x92b8e04cbf5f8f7e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216841.224669:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d15b8f7d/0x92b8e04cbf5f8f7e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216841.224675:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d15b8f7d/0x92b8e04cbf5f8f7e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216841.224690:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d15b8f7d/0x92b8e04cbf5f8f7e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216841.224695:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d15b8f7d already unused, calling callback (00000000e53a7aa9) 00010000:00010000:3.0:1782216841.224699:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d15b8f7d/0x92b8e04cbf5f8f7e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216841.224705:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d15b8f7d/0x92b8e04cbf5f8f7e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216841.224724:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d15b8f7d/0x92b8e04cbf5f8f7e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216841.224734:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782216841.224768:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd3f6737 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+10:3648:x1868789712950144:12345-0@lo:103: Request processed in 202us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216841.224775:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782216841.224801:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000006a9b1f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17bce19a-7a0f-4c9d-b31c-4e0155298487:3648:1868789712950144:0@lo:103: 00010000:00010000:1.0:1782216841.224950:0:6513:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000d15b8f7d/0x92b8e04cbf5f8f7e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.224958:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d15b8f7d/0x92b8e04cbf5f8f7e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.224973:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d15b8f7d/0x92b8e04cbf5f8f7e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1782216841.224988:0:6513:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1782216841.232032:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ebb20ed9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+9:7449:x1868789712949376:12345-0@lo:253: Request processed in 31534us (31856us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216841.232048:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782216841.232065:0:7449:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b5dc7e76 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:7449:1868789712949376:0@lo:253: 10000000:01000000:2.0:1782216841.232083:0:7449:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1782216841.232086:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782216841.232088:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1782216841.232090:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782216841.232091:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:2.0:1782216841.232092:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782216841.232093:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782216841.232095:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782216841.232096:0:7449:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1782216841.232098:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782216841.232099:0:7449:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1782216841.232120:0:7449:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000503b783f from lustre-MDT0001 10000000:01000000:2.0:1782216841.232157:0:7449:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1782216841.232160:0:7449:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1782216841.232166:0:7449:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff952e5021b380 local copy 10000000:01000000:2.0:1782216841.232279:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1782216841.232312:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 00000000ad9c4d90/0x92b8e04cbf5f8f85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216841.232322:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.130@tcp lock: 00000000ad9c4d90/0x92b8e04cbf5f8f85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216841.232330:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 00000000ad9c4d90/0x92b8e04cbf5f8f85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216841.232416:0:7449:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b5dc7e76 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:7449:1868789712950272:0@lo:101: 00000100:00100000:2.0:1782216841.232452:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216841.232489:0:7449:0:(client.c:2701:ptlrpc_set_wait()) set 000000007dc2e0fb going to sleep for 11 seconds 00000100:00100000:0.0:1782216841.232686:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712950272 00000100:00100000:0.0:1782216841.232692:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712950272 00000100:00100000:0.0:1782216841.232769:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782216841.232778:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000035d79900 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+9:7449:x1868789712950272:12345-0@lo:101: 00010000:00010000:0.0:1782216841.232790:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782216841.232802:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c0a775c4/0x92b8e04cbf5f8f8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f8f85 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216841.232847:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c0a775c4/0x92b8e04cbf5f8f8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f8f85 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216841.232855:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c0a775c4/0x92b8e04cbf5f8f8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f8f85 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216841.232864:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c0a775c4, rc 0) 00000100:00100000:0.0:1782216841.232905:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000035d79900 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+10:7449:x1868789712950272:12345-0@lo:101: Request processed in 130us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216841.232912:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1782216841.232970:0:7449:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b5dc7e76 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:7449:1868789712950272:0@lo:101: 00010000:00010000:2.0:1782216841.232982:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 00000000ad9c4d90/0x92b8e04cbf5f8f85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x92b8e04cbf5f8f8c expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216841.232990:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 00000000ad9c4d90/0x92b8e04cbf5f8f85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x92b8e04cbf5f8f8c expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216841.233075:0:7449:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b5dc7e76 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:7449:1868789712950400:0@lo:501: 00000100:00100000:2.0:1782216841.233098:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216841.234660:0:7449:0:(client.c:2701:ptlrpc_set_wait()) set 000000007dc2e0fb going to sleep for 11 seconds 00000100:00100000:1.0:1782216841.234772:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712950400 00000100:00100000:1.0:1782216841.234780:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712950400 00000100:00100000:1.0:1782216841.234820:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1782216841.234828:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b54feaf3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+10:7449:x1868789712950400:12345-0@lo:501: 00000100:00100000:1.0:1782216841.235174:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b54feaf3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+10:7449:x1868789712950400:12345-0@lo:501: Request processed in 346us (2074us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782216841.235192:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1782216841.235299:0:7449:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b5dc7e76 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:7449:1868789712950400:0@lo:501: 10000000:01000000:2.0:1782216841.235321:0:7449:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1782216841.235407:0:7449:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1782216841.235422:0:7449:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 00000000ad9c4d90/0x92b8e04cbf5f8f85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x92b8e04cbf5f8f8c expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216841.235431:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 00000000ad9c4d90/0x92b8e04cbf5f8f85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x92b8e04cbf5f8f8c expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216841.235437:0:7449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: 00000000ad9c4d90/0x92b8e04cbf5f8f85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x92b8e04cbf5f8f8c expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216841.235456:0:7449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782216841.235482:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:2.0:1782216841.235488:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff952e7b38d800 00010000:00010000:1.0:1782216841.235488:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: 00000000ad9c4d90/0x92b8e04cbf5f8f85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x92b8e04cbf5f8f8c expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782216841.235494:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1782216841.235501:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ad9c4d90 already unused, calling callback (000000002754abcf) 10000000:01000000:2.0:1782216841.235503:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff952e5021b380 10000000:00010000:1.0:1782216841.235506:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: 00000000ad9c4d90/0x92b8e04cbf5f8f85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x92b8e04cbf5f8f8c expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782216841.235508:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1782216841.235513:0:7449:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff952e5021b380 from 1 10000000:01000000:2.0:1782216841.235515:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782216841.235525:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: 00000000ad9c4d90/0x92b8e04cbf5f8f85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x92b8e04cbf5f8f8c expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782216841.235532:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: 00000000ad9c4d90/0x92b8e04cbf5f8f85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x92b8e04cbf5f8f8c expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216841.235541:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 000000002ece2e23/0x92b8e04cbf5f8f93 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216841.235563:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 000000002ece2e23/0x92b8e04cbf5f8f93 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782216841.235563:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782216841.235575:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 000000002ece2e23/0x92b8e04cbf5f8f93 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.235609:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: 00000000ad9c4d90/0x92b8e04cbf5f8f85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x92b8e04cbf5f8f8c expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.235617:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782216841.235636:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: 00000000ad9c4d90/0x92b8e04cbf5f8f85 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x92b8e04cbf5f8f8c expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.235643:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: 00000000ad9c4d90/0x92b8e04cbf5f8f85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x92b8e04cbf5f8f8c expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.235660:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216841.235662:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216841.235664:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782216841.235676:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b87482f3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789712950656:0@lo:103: 00000100:00100000:2.0:1782216841.235689:0:7449:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b5dc7e76 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:7449:1868789712950528:0@lo:101: 00000100:00100000:1.0:1782216841.235718:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216841.235725:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216841.235760:0:7449:0:(client.c:2701:ptlrpc_set_wait()) set 00000000346f09e9 going to sleep for 11 seconds 00000100:00100000:1.0:1782216841.235786:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712950656 00000100:00100000:1.0:1782216841.235791:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712950656 00000100:00100000:1.0:1782216841.235831:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782216841.235839:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000045cc1a30 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17bce19a-7a0f-4c9d-b31c-4e0155298487+10:3649:x1868789712950656:12345-0@lo:103: 00010000:00010000:1.0:1782216841.235850:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782216841.236679:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c0a775c4/0x92b8e04cbf5f8f8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x92b8e04cbf5f8f85 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.236700:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782216841.236759:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000045cc1a30 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17bce19a-7a0f-4c9d-b31c-4e0155298487+9:3649:x1868789712950656:12345-0@lo:103: Request processed in 921us (1043us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216841.236767:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782216841.236810:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712950528 00000100:00100000:1.0:1782216841.236815:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712950528 00000100:00100000:1.0:1782216841.237067:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1782216841.237075:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c3041f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+9:7449:x1868789712950528:12345-0@lo:101: 00010000:00010000:1.0:1782216841.237087:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782216841.237099:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005bdd5076/0x92b8e04cbf5f8f9a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f8f93 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.237116:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005bdd5076/0x92b8e04cbf5f8f9a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f8f93 expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.237125:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005bdd5076/0x92b8e04cbf5f8f9a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f8f93 expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.237132:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005bdd5076, rc 0) 00000100:00100000:1.0:1782216841.237161:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c3041f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+10:7449:x1868789712950528:12345-0@lo:101: Request processed in 88us (1438us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216841.237167:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1782216841.237717:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b87482f3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789712950656:0@lo:103: 00000100:00100000:1.0:1782216841.237736:0:7449:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b5dc7e76 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:7449:1868789712950528:0@lo:101: 00010000:00010000:1.0:1782216841.237753:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 000000002ece2e23/0x92b8e04cbf5f8f93 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f8f9a expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.237762:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 000000002ece2e23/0x92b8e04cbf5f8f93 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f8f9a expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782216841.237779:0:7449:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782216841.237798:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 000000002ece2e23/0x92b8e04cbf5f8f93 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f8f9a expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.237819:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: 000000002ece2e23/0x92b8e04cbf5f8f93 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f8f9a expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782216841.237830:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff952e7b38d800 10000000:01000000:1.0:1782216841.237836:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1782216841.237840:0:7449:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff952e7b38d800 from 1 10000000:01000000:1.0:1782216841.237842:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1782216841.238083:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 0000000079148b0b/0x92b8e04cbf5f8fa1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.238091:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 0000000079148b0b/0x92b8e04cbf5f8fa1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.238098:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 0000000079148b0b/0x92b8e04cbf5f8fa1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216841.238114:0:7449:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001fbe8659 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:7449:1868789712950784:0@lo:101: 00000100:00100000:1.0:1782216841.238156:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216841.238203:0:7449:0:(client.c:2701:ptlrpc_set_wait()) set 00000000d32aafdf going to sleep for 11 seconds 00000100:00100000:2.0:1782216841.238284:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712950784 00000100:00100000:2.0:1782216841.238297:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712950784 00000100:00100000:2.0:1782216841.238326:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782216841.238333:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dd64d152 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+10:7449:x1868789712950784:12345-0@lo:101: 00010000:00010000:2.0:1782216841.238419:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782216841.238429:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c9d20577/0x92b8e04cbf5f8fa8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f8fa1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216841.238446:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c9d20577/0x92b8e04cbf5f8fa8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f8fa1 expref: 11 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216841.238454:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c9d20577/0x92b8e04cbf5f8fa8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f8fa1 expref: 11 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216841.238460:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c9d20577, rc 0) 00000100:00100000:2.0:1782216841.238498:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dd64d152 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+11:7449:x1868789712950784:12345-0@lo:101: Request processed in 166us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216841.238505:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1782216841.238541:0:7449:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001fbe8659 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:7449:1868789712950784:0@lo:101: 00010000:00010000:1.0:1782216841.238553:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 0000000079148b0b/0x92b8e04cbf5f8fa1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f8fa8 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.238560:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 0000000079148b0b/0x92b8e04cbf5f8fa1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f8fa8 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782216841.238571:0:7449:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1782216841.238599:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 0000000079148b0b/0x92b8e04cbf5f8fa1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f8fa8 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.238612:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: 0000000079148b0b/0x92b8e04cbf5f8fa1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f8fa8 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782216841.238618:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1782216841.238621:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782216841.238626:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff952e7b38d800 10000000:01000000:1.0:1782216841.238628:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1782216841.238631:0:7449:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1782216841.238633:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1782216841.238649:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 000000008d099889/0x92b8e04cbf5f8faf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.238655:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 000000008d099889/0x92b8e04cbf5f8faf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.238662:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 000000008d099889/0x92b8e04cbf5f8faf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216841.238673:0:7449:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001fbe8659 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:7449:1868789712950912:0@lo:101: 00000100:00100000:1.0:1782216841.238702:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216841.238720:0:7449:0:(client.c:2701:ptlrpc_set_wait()) set 00000000d32aafdf going to sleep for 11 seconds 00000100:00100000:2.0:1782216841.238952:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712950912 00000100:00100000:2.0:1782216841.238957:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712950912 00000100:00100000:2.0:1782216841.238982:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1782216841.238988:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b73375ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+11:7449:x1868789712950912:12345-0@lo:101: 00010000:00010000:2.0:1782216841.238995:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782216841.239002:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000072baa9cd/0x92b8e04cbf5f8fb6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f8faf expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216841.239014:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000072baa9cd/0x92b8e04cbf5f8fb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f8faf expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216841.239021:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000072baa9cd/0x92b8e04cbf5f8fb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f8faf expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216841.239037:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000072baa9cd, rc 0) 00000100:00100000:2.0:1782216841.239108:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b73375ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+12:7449:x1868789712950912:12345-0@lo:101: Request processed in 120us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216841.239114:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1782216841.239159:0:7449:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001fbe8659 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:7449:1868789712950912:0@lo:101: 00010000:00010000:1.0:1782216841.239169:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 000000008d099889/0x92b8e04cbf5f8faf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f8fb6 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.239185:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 000000008d099889/0x92b8e04cbf5f8faf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f8fb6 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216841.239289:0:7449:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001fbe8659 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:7449:1868789712951040:0@lo:501: 00000100:00100000:1.0:1782216841.239314:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216841.239416:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712951040 00000100:00100000:0.0:1782216841.239421:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712951040 00000100:00100000:1.0:1782216841.239424:0:7449:0:(client.c:2701:ptlrpc_set_wait()) set 00000000d32aafdf going to sleep for 11 seconds 00000100:00100000:2.0:1782216841.239460:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1782216841.239468:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc100178 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+12:7449:x1868789712951040:12345-0@lo:501: 00000100:00100000:2.0:1782216841.239720:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc100178 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+12:7449:x1868789712951040:12345-0@lo:501: Request processed in 253us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216841.239727:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1782216841.239829:0:7449:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001fbe8659 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:7449:1868789712951040:0@lo:501: 00000100:00100000:1.0:1782216841.239852:0:7449:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001fbe8659 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:7449:1868789712951168:0@lo:503: 00000100:00100000:1.0:1782216841.239889:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216841.239911:0:7449:0:(client.c:2701:ptlrpc_set_wait()) set 00000000d32aafdf going to sleep for 11 seconds 00000100:00100000:3.0:1782216841.240042:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712951168 00000100:00100000:3.0:1782216841.240047:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712951168 00000100:00100000:3.0:1782216841.240084:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1782216841.240090:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ad47984 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+12:7449:x1868789712951168:12345-0@lo:503: 00000100:00100000:3.0:1782216841.240187:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ad47984 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+12:7449:x1868789712951168:12345-0@lo:503: Request processed in 97us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216841.240194:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782216841.240362:0:7449:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001fbe8659 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:7449:1868789712951168:0@lo:503: 00000040:00080000:1.0:1782216841.240631:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782216841.240692:0:7449:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001fbe8659 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:7449:1868789712951296:0@lo:502: 00000100:00100000:1.0:1782216841.240724:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216841.240746:0:7449:0:(client.c:2701:ptlrpc_set_wait()) set 00000000d32aafdf going to sleep for 11 seconds 00000100:00100000:0.0:1782216841.240769:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712951296 00000100:00100000:0.0:1782216841.240772:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712951296 00000100:00100000:0.0:1782216841.240800:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1782216841.240815:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2b5d449 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+12:7449:x1868789712951296:12345-0@lo:502: 00000100:00100000:0.0:1782216841.240914:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2b5d449 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+12:7449:x1868789712951296:12345-0@lo:502: Request processed in 100us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216841.240920:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782216841.240932:0:7449:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001fbe8659 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:7449:1868789712951296:0@lo:502: 00000040:00080000:1.0:1782216841.241095:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1782216841.241118:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:1.0:1782216841.241132:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:1.0:1782216841.241143:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:1.0:1782216841.241155:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:1.0:1782216841.241168:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:1.0:1782216841.241191:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:1.0:1782216841.241205:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:1.0:1782216841.241217:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:1.0:1782216841.241228:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:1.0:1782216841.241249:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:1.0:1782216841.241335:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:1.0:1782216841.241348:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:1.0:1782216841.241367:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:1.0:1782216841.241377:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:1.0:1782216841.241387:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:1.0:1782216841.241397:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:1.0:1782216841.241407:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:1.0:1782216841.241417:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:1.0:1782216841.241427:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:1.0:1782216841.241437:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:1.0:1782216841.241447:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:1.0:1782216841.241457:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:1.0:1782216841.241472:0:7449:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001fbe8659 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:7449:1868789712951424:0@lo:502: 00000100:00100000:1.0:1782216841.241503:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216841.241533:0:7449:0:(client.c:2701:ptlrpc_set_wait()) set 00000000d32aafdf going to sleep for 11 seconds 00000100:00100000:2.0:1782216841.241683:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712951424 00000100:00100000:2.0:1782216841.241687:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712951424 00000100:00100000:2.0:1782216841.241713:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1782216841.241719:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004fea35c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+12:7449:x1868789712951424:12345-0@lo:502: 00000100:00100000:2.0:1782216841.241792:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004fea35c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+12:7449:x1868789712951424:12345-0@lo:502: Request processed in 73us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216841.241799:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1782216841.242110:0:7449:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001fbe8659 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:7449:1868789712951424:0@lo:502: 00000040:00080000:1.0:1782216841.242148:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:1.0:1782216841.242156:0:7449:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:2.0:1782216841.242796:0:7461:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782216841.242808:0:7461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782216841.242810:0:7461:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1782216841.242816:0:7461:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1782216841.242819:0:7461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782216841.242832:0:7461:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000d0a3f1aa) 00000020:00000080:2.0:1782216841.242938:0:7461:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:2.0:1782216841.242944:0:7461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1782216841.243009:0:7461:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1782216841.243014:0:7461:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x92b8e04cbf5f8fc4 00000020:00000080:2.0:1782216841.243236:0:7461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1782216841.243246:0:7461:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782216841.243250:0:7461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782216841.243251:0:7461:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1782216841.243388:0:7461:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782216841.243395:0:7461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782216841.243396:0:7461:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1782216841.243400:0:7461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782216841.243407:0:7461:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000dd84aa9b) 00000020:00000080:2.0:1782216841.243418:0:7461:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:2.0:1782216841.243422:0:7461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1782216841.243423:0:7461:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1782216841.243426:0:7461:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1782216841.243431:0:7461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1782216841.243486:0:7461:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000503b783f from lustre-MDT0001, refs=2 00000020:00000080:2.0:1782216841.243505:0:7461:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (0000000004414195) 00000020:00000080:2.0:1782216841.243573:0:7461:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:2.0:1782216841.243740:0:7461:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1782216841.243749:0:7461:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x92b8e04cbf5f8fd9 00000020:00000080:2.0:1782216841.244345:0:7461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1782216841.244354:0:7461:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1782216841.244360:0:7461:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x92b8e04cbf5f8fe0 00080000:01000000:2.0:1782216841.244368:0:7461:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:2.0:1782216841.244371:0:7461:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x92b8e04cbf5f8fe7 00080000:10000000:2.0:1782216841.245490:0:7461:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1782216841.245945:0:7461:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:3.0:1782216841.306573:0:7461:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:3.0:1782216841.307048:0:7461:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:3.0:1782216841.313042:0:7461:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1782216841.313468:0:7461:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1782216841.339905:0:7461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1782216841.339919:0:7461:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782216841.339925:0:7461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782216841.339927:0:7461:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1782216841.339930:0:7461:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782216841.339936:0:7461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782216841.339938:0:7461:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1782216841.339941:0:7461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1782216841.339946:0:7461:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:00000080:0.0:1782216841.339974:0:7461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1782216841.339994:0:7461:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (000000006411ad77) 00000020:00000080:0.0:1782216841.340014:0:7461:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1782216841.340021:0:7461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1782216841.340102:0:7461:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1782216841.340108:0:7461:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:0.0:1782216841.340114:0:7461:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x92b8e04cbf5f8ff5 00010000:00080000:0.0:1782216841.340143:0:7461:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000341445c5@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.130@tcp at head 00010000:00010000:0.0:1782216841.349806:0:7461:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:1.0:1782216841.357226:0:7461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1782216841.357242:0:7461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1782216841.357348:0:7461:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1782216841.357370:0:7461:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x92b8e04cbf5f8ffc 00000100:00080000:1.0:1782216841.357382:0:7461:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782216841.357387:0:7461:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000341445c5 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1782216841.357421:0:7461:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001fbe8659 x1868789712951552/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782216841.357448:0:7461:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1782216841.357550:0:7461:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782216841.357555:0:7461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782216841.357557:0:7461:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1782216841.357559:0:7461:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1782216841.357566:0:7461:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1782216841.357567:0:7461:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1782216841.357569:0:7461:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1782216841.357570:0:7461:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1782216841.357573:0:7461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782216841.357574:0:7461:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1782216841.357576:0:7461:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782216841.357616:0:7461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782216841.357618:0:7461:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1782216841.357622:0:7461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1782216841.357651:0:7461:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1782216841.357663:0:7461:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782216841.357666:0:7461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782216841.357667:0:7461:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1782216841.357669:0:7461:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782216841.357671:0:7461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782216841.357672:0:7461:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1782216841.357675:0:7461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1782216841.357676:0:7461:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1782216841.357698:0:7461:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782216841.357701:0:7461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782216841.357703:0:7461:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1782216841.357706:0:7461:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:3.0:1782216841.357866:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001fbe8659 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1868789712951552:0@lo:38: 00000100:00100000:3.0:1782216841.357971:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216841.358113:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712951552 00000100:00100000:1.0:1782216841.358120:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712951552 00000100:00100000:1.0:1782216841.358155:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782216841.358161:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000075ad30e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1868789712951552:12345-0@lo:38: 00010000:00080000:1.0:1782216841.358192:0:6523:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 204 last 0 00000020:00000080:1.0:1782216841.358218:0:6523:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x92b8e04cbf5f9003 00000004:00100000:1.0:1782216841.358230:0:6523:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1782216841.358236:0:6523:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000020:01000000:0.0:1782216841.358448:0:7449:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:0.0:1782216841.358478:0:7449:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1782216841.358495:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 000000008d099889/0x92b8e04cbf5f8faf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f8fb6 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216841.358505:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: 000000008d099889/0x92b8e04cbf5f8faf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f8fb6 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782216841.358513:0:7449:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff952e7b38d800 from 1 10000000:01000000:0.0:1782216841.358515:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1782216841.358539:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 00000000c0a775c4/0x92b8e04cbf5f900a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216841.358546:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 00000000c0a775c4/0x92b8e04cbf5f900a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216841.358554:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 00000000c0a775c4/0x92b8e04cbf5f900a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216841.358568:0:7449:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d27ad824 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:7449:1868789712951680:0@lo:101: 00000100:00100000:0.0:1782216841.358617:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216841.358631:0:7449:0:(client.c:2701:ptlrpc_set_wait()) set 00000000c90a7347 going to sleep for 11 seconds 00000100:00100000:0.0:1782216841.358654:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712951680 00000100:00100000:0.0:1782216841.358665:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712951680 00000100:00100000:0.0:1782216841.358693:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1782216841.358699:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000002c6e03d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+12:7449:x1868789712951680:12345-0@lo:101: 00010000:00010000:0.0:1782216841.358709:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782216841.358718:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f9e2e10a/0x92b8e04cbf5f9011 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f900a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216841.358735:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f9e2e10a/0x92b8e04cbf5f9011 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f900a expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216841.358743:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f9e2e10a/0x92b8e04cbf5f9011 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f900a expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216841.358751:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f9e2e10a, rc 0) 00000100:00100000:0.0:1782216841.358781:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000002c6e03d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+13:7449:x1868789712951680:12345-0@lo:101: Request processed in 82us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216841.358787:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1782216841.358826:0:7449:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d27ad824 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:7449:1868789712951680:0@lo:101: 00010000:00010000:0.0:1782216841.358837:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 00000000c0a775c4/0x92b8e04cbf5f900a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f9011 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216841.358844:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 00000000c0a775c4/0x92b8e04cbf5f900a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f9011 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216841.359478:0:7449:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d27ad824 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:7449:1868789712951808:0@lo:256: 00000100:00100000:0.0:1782216841.359512:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216841.359531:0:7449:0:(client.c:2701:ptlrpc_set_wait()) set 00000000c90a7347 going to sleep for 11 seconds 00000100:00100000:0.0:1782216841.359551:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712951808 00000100:00100000:0.0:1782216841.359555:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712951808 00000100:00100000:1.0:1782216841.365476:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1782216841.365502:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b8dc3db7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+13:7449:x1868789712951808:12345-0@lo:256: 20000000:01000000:1.0:1782216841.365531:0:6513:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1782216841.365547:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1782216841.365549:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1782216841.365692:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b8dc3db7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+13:7449:x1868789712951808:12345-0@lo:256: Request processed in 192us (6178us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216841.365700:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1782216841.366281:0:7449:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d27ad824 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:7449:1868789712951808:0@lo:256: 10000000:01000000:0.0:1782216841.366865:0:7449:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1782216841.366882:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 00000000c0a775c4/0x92b8e04cbf5f900a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f9011 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216841.366893:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: 00000000c0a775c4/0x92b8e04cbf5f900a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f9011 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782216841.366902:0:7449:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff952e7b38d800 from 1 10000000:01000000:0.0:1782216841.366904:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782216841.366933:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 0000000008e2888b/0x92b8e04cbf5f9018 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216841.366939:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 0000000008e2888b/0x92b8e04cbf5f9018 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216841.366947:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 0000000008e2888b/0x92b8e04cbf5f9018 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216841.366962:0:7449:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d27ad824 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:7449:1868789712951936:0@lo:101: 00000100:00100000:0.0:1782216841.366999:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216841.367027:0:7449:0:(client.c:2701:ptlrpc_set_wait()) set 00000000c90a7347 going to sleep for 11 seconds 00000100:00100000:0.0:1782216841.367047:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712951936 00000100:00100000:0.0:1782216841.367052:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712951936 00000100:00100000:0.0:1782216841.367082:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1782216841.367088:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c6932ca6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+13:7449:x1868789712951936:12345-0@lo:101: 00010000:00010000:0.0:1782216841.367103:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782216841.367126:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000007d002c5/0x92b8e04cbf5f901f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f9018 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216841.367154:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000007d002c5/0x92b8e04cbf5f901f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9018 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216841.367163:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000007d002c5/0x92b8e04cbf5f901f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9018 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216841.367172:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000007d002c5, rc 0) 00000100:00100000:0.0:1782216841.367220:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c6932ca6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+14:7449:x1868789712951936:12345-0@lo:101: Request processed in 132us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216841.367226:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1782216841.367706:0:7449:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d27ad824 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:7449:1868789712951936:0@lo:101: 00010000:00010000:2.0:1782216841.367720:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 0000000008e2888b/0x92b8e04cbf5f9018 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f901f expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216841.367728:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 0000000008e2888b/0x92b8e04cbf5f9018 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f901f expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216841.367833:0:7449:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000124317aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:7449:1868789712952064:0@lo:501: 00000100:00100000:2.0:1782216841.367860:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216841.367877:0:7449:0:(client.c:2701:ptlrpc_set_wait()) set 0000000016abd69e going to sleep for 11 seconds 00000100:00100000:3.0:1782216841.368061:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000ef8ce878 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1868789712952192:0@lo:400: 00000100:00100000:3.0:1782216841.368094:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216841.368200:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712952064 00000100:00100000:1.0:1782216841.368206:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712952064 00000100:00100000:1.0:1782216841.368236:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1782216841.368243:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004756951c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+14:7449:x1868789712952064:12345-0@lo:501: 00000100:00100000:1.0:1782216841.369002:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004756951c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+14:7449:x1868789712952064:12345-0@lo:501: Request processed in 757us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216841.369010:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1782216841.369207:0:7449:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000124317aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:7449:1868789712952064:0@lo:501: 00000100:00100000:0.0:1782216841.369244:0:7449:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000403cd164 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:7449:1868789712952320:0@lo:503: 00000100:00100000:0.0:1782216841.369290:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216841.369318:0:7449:0:(client.c:2701:ptlrpc_set_wait()) set 000000003469cdb7 going to sleep for 11 seconds 00000100:00100000:1.0:1782216841.369442:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712952320 00000100:00100000:1.0:1782216841.369447:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712952320 00000100:00100000:1.0:1782216841.369483:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1782216841.369490:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000086f6f2f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+14:7449:x1868789712952320:12345-0@lo:503: 00000040:00080000:1.0:1782216841.369521:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782216841.369559:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000086f6f2f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+14:7449:x1868789712952320:12345-0@lo:503: Request processed in 71us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216841.369565:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1782216841.369718:0:7449:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000403cd164 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:7449:1868789712952320:0@lo:503: 00000040:00080000:0.0:1782216841.369972:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782216841.370014:0:7449:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:0.0:1782216841.370078:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:1.0:1782216841.370462:0:6523:0:(import.c:65:import_set_state_nolock()) 00000000ee5139d8 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782216841.370516:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000075ad30e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1868789712951552:12345-0@lo:38: Request processed in 12354us (12545us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216841.370524:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782216841.370561:0:3646:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1782216841.370569:0:3646:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1782216841.370606:0:3646:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1782216841.370611:0:3646:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1782216841.370613:0:3646:0:(import.c:65:import_set_state_nolock()) 00000000341445c5 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1782216841.370623:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001fbe8659 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1868789712951552:0@lo:38: 00000100:00100000:1.0:1782216841.370675:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001fbe8659 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789712952448:0@lo:41: 00000100:00100000:1.0:1782216841.370704:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216841.370746:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712952448 00000100:00100000:1.0:1782216841.370749:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712952448 00000100:00100000:1.0:1782216841.370771:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782216841.370776:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d10887ec pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1868789712952448:12345-0@lo:41: 00000004:00000024:1.0:1782216841.370797:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1782216841.370826:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d10887ec pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1868789712952448:12345-0@lo:41: Request processed in 50us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216841.370831:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782216841.370857:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001fbe8659 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789712952448:0@lo:41: 00000100:00100000:2.0:1782216841.371151:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712952192 00000100:00100000:2.0:1782216841.371156:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712952192 00000100:00100000:2.0:1782216841.371843:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782216841.371854:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000030cb55f8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1868789712952192:12345-0@lo:400: 00000100:00100000:2.0:1782216841.371924:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000030cb55f8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1868789712952192:12345-0@lo:400: Request processed in 73us (3830us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216841.371930:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1782216841.372025:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ef8ce878 x1868789712952192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216841.372037:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000ef8ce878 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1868789712952192:0@lo:400: 00000040:00080000:1.0:1782216841.372749:0:7466:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:3.0:1782216841.373019:0:7449:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1782216841.373055:0:7449:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782216841.373076:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 0000000008e2888b/0x92b8e04cbf5f9018 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f901f expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216841.373086:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: 0000000008e2888b/0x92b8e04cbf5f9018 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f901f expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782216841.373137:0:7449:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1782216841.373139:0:7449:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff952e7b38d800 10000000:01000000:3.0:1782216841.373142:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff952e7b38d800 10000000:01000000:3.0:1782216841.373145:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782216841.373150:0:7449:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff952e7b38d800 from 1 10000000:01000000:3.0:1782216841.373152:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782216841.373195:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 00000000cc63a196/0x92b8e04cbf5f9026 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216841.373202:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 00000000cc63a196/0x92b8e04cbf5f9026 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216841.373211:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 00000000cc63a196/0x92b8e04cbf5f9026 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216841.373227:0:7449:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b2afbef5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:7449:1868789712952576:0@lo:101: 00000100:00100000:3.0:1782216841.373283:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216841.373326:0:7449:0:(client.c:2701:ptlrpc_set_wait()) set 0000000023495907 going to sleep for 11 seconds 00000100:00100000:1.0:1782216841.373428:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712952576 00000100:00100000:1.0:1782216841.373433:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712952576 00000100:00100000:1.0:1782216841.373474:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1782216841.373481:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001c074466 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+14:7449:x1868789712952576:12345-0@lo:101: 00010000:00010000:1.0:1782216841.373492:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782216841.373503:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d15b8f7d/0x92b8e04cbf5f902d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f9026 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.373535:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d15b8f7d/0x92b8e04cbf5f902d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9026 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.373545:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d15b8f7d/0x92b8e04cbf5f902d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9026 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.373553:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d15b8f7d, rc 0) 00000100:00100000:1.0:1782216841.373614:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001c074466 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:7449:x1868789712952576:12345-0@lo:101: Request processed in 134us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216841.373620:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1782216841.373652:0:7449:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b2afbef5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:7449:1868789712952576:0@lo:101: 00010000:00010000:1.0:1782216841.373664:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 00000000cc63a196/0x92b8e04cbf5f9026 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f902d expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.373671:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 00000000cc63a196/0x92b8e04cbf5f9026 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f902d expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216841.373748:0:7449:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000ef8ce878 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:7449:1868789712952704:0@lo:501: 00000100:00100000:1.0:1782216841.373771:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216841.373786:0:7449:0:(client.c:2701:ptlrpc_set_wait()) set 00000000d776f762 going to sleep for 11 seconds 00000100:00100000:1.0:1782216841.373803:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712952704 00000100:00100000:1.0:1782216841.373806:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712952704 00000100:00100000:1.0:1782216841.373821:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1782216841.373826:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7666176 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:7449:x1868789712952704:12345-0@lo:501: 00000100:00100000:1.0:1782216841.374162:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7666176 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:7449:x1868789712952704:12345-0@lo:501: Request processed in 335us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216841.374169:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1782216841.374349:0:7449:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000ef8ce878 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:7449:1868789712952704:0@lo:501: 00000100:00100000:3.0:1782216841.374379:0:7449:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c50f27fb pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:7449:1868789712952832:0@lo:503: 00000100:00100000:3.0:1782216841.374417:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216841.374467:0:7449:0:(client.c:2701:ptlrpc_set_wait()) set 00000000282d49cf going to sleep for 11 seconds 00000100:00100000:1.0:1782216841.374508:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712952832 00000100:00100000:1.0:1782216841.374512:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712952832 00000100:00100000:1.0:1782216841.374572:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1782216841.374579:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a52efb07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:7449:x1868789712952832:12345-0@lo:503: 00000100:00100000:1.0:1782216841.374685:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a52efb07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:7449:x1868789712952832:12345-0@lo:503: Request processed in 106us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216841.374691:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1782216841.374758:0:7449:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c50f27fb pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:7449:1868789712952832:0@lo:503: 00000040:00080000:0.0:1782216841.375022:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782216841.375091:0:7449:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000403cd164 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:7449:1868789712952960:0@lo:502: 00000100:00100000:0.0:1782216841.375125:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216841.375439:0:7449:0:(client.c:2701:ptlrpc_set_wait()) set 000000006cdbb81e going to sleep for 11 seconds 00000100:00100000:3.0:1782216841.375496:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712952960 00000100:00100000:3.0:1782216841.375501:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712952960 00000100:00100000:3.0:1782216841.375525:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1782216841.375531:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000002e97db6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:7449:x1868789712952960:12345-0@lo:502: 00000100:00100000:3.0:1782216841.375634:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000002e97db6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:7449:x1868789712952960:12345-0@lo:502: Request processed in 103us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216841.375641:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1782216841.375727:0:7449:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000403cd164 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:7449:1868789712952960:0@lo:502: 00000040:00080000:0.0:1782216841.375975:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1782216841.376009:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1782216841.376023:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1782216841.376035:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1782216841.376046:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1782216841.376057:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1782216841.376068:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1782216841.376080:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1782216841.376091:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1782216841.376103:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1782216841.376117:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1782216841.376129:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1782216841.376141:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1782216841.376153:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1782216841.376191:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1782216841.376208:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1782216841.376221:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1782216841.376235:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1782216841.376246:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1782216841.376336:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1782216841.376355:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1782216841.376369:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1782216841.376381:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1782216841.376393:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1782216841.376404:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1782216841.376415:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1782216841.376427:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1782216841.376440:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:0.0:1782216841.376464:0:7449:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000403cd164 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:7449:1868789712953088:0@lo:502: 00000100:00100000:0.0:1782216841.376505:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216841.376655:0:7449:0:(client.c:2701:ptlrpc_set_wait()) set 000000006cdbb81e going to sleep for 11 seconds 00000100:00100000:1.0:1782216841.376762:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712953088 00000100:00100000:1.0:1782216841.376768:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712953088 00000100:00100000:3.0:1782216841.376819:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1782216841.376827:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d61a0497 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:7449:x1868789712953088:12345-0@lo:502: 00000100:00100000:3.0:1782216841.376958:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d61a0497 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:7449:x1868789712953088:12345-0@lo:502: Request processed in 132us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216841.376965:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1782216841.377064:0:7449:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000403cd164 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:7449:1868789712953088:0@lo:502: 00000040:00080000:0.0:1782216841.377106:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1782216841.377123:0:7449:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1782216841.377623:0:7467:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1782216841.377636:0:7467:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (000000004fc5e421) 00000020:00000080:0.0:1782216841.377656:0:7467:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1782216841.377825:0:7467:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000503b783f from lustre-MDT0001, refs=3 00000020:01000004:0.0:1782216841.377829:0:7467:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000503b783f from lustre-MDT0001, refs=3 00000020:01000004:0.0:1782216841.377832:0:7467:0:(obd_mount.c:701:lustre_put_lsi()) put 00000000503b783f 3 00010000:00080000:0.0:1782216841.377931:0:7467:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000630134fe@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.130@tcp at head 00010000:00010000:0.0:1782216841.381977:0:7467:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:0.0:1782216841.382112:0:7467:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1782216841.382153:0:7467:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1782216841.382167:0:7467:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x92b8e04cbf5f903b 00000100:00080000:0.0:1782216841.382187:0:7467:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782216841.382191:0:7467:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000630134fe using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1782216841.382229:0:7467:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000403cd164 x1868789712953216/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782216841.382248:0:7467:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000040:00080000:0.0:1782216841.382480:0:7467:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:1.0:1782216841.382753:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000403cd164 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1868789712953216:0@lo:38: 00000100:00100000:1.0:1782216841.382818:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216841.383369:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712953216 00000100:00100000:1.0:1782216841.383376:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712953216 00000100:00100000:1.0:1782216841.383409:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782216841.383415:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001fbe8659 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1868789712953216:12345-0@lo:38: 00010000:00080000:1.0:1782216841.383439:0:6518:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 204 last 0 00000020:00000080:1.0:1782216841.383470:0:6518:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x92b8e04cbf5f9042 00000004:00100000:1.0:1782216841.383484:0:6518:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1782216841.383513:0:6518:0:(import.c:65:import_set_state_nolock()) 0000000020e5938a : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782216841.383564:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001fbe8659 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1868789712953216:12345-0@lo:38: Request processed in 148us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216841.383572:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1782216841.383834:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000403cd164 x1868789712953216/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782216851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216841.383845:0:3646:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1782216841.383852:0:3646:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1782216841.383860:0:3646:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1782216841.383876:0:3646:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1782216841.383878:0:3646:0:(import.c:65:import_set_state_nolock()) 00000000630134fe lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1782216841.383883:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000403cd164 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1868789712953216:0@lo:38: 40000000:00080000:0.0:1782216841.384412:0:7469:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000020:01000000:3.0:1782216841.384940:0:7449:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1782216841.384975:0:7449:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782216841.384993:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 00000000cc63a196/0x92b8e04cbf5f9026 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f902d expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216841.385005:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: 00000000cc63a196/0x92b8e04cbf5f9026 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f902d expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1782216841.385072:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1782216841.385074:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1782216841.385076:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782216841.385080:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782216841.385081:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782216841.385082:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782216841.385083:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782216841.385085:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782216841.385086:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782216841.385088:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782216841.385089:0:7449:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1782216841.385092:0:7449:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:3.0:1782216841.385094:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782216841.385095:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1782216841.385096:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782216841.385097:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782216841.385097:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782216841.385098:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782216841.385099:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782216841.385100:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782216841.385100:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782216841.385101:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782216841.385102:0:7449:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1782216841.385123:0:7449:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1782216841.385137:0:7449:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d49727f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:7449:1868789712953344:0@lo:253: 00000100:00100000:3.0:1782216841.385198:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216841.385234:0:7449:0:(client.c:2701:ptlrpc_set_wait()) set 00000000228fefd2 going to sleep for 11 seconds 00000100:00100000:0.0:1782216841.385361:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712953344 00000100:00100000:0.0:1782216841.385368:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712953344 00000100:00100000:0.0:1782216841.385408:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1782216841.385416:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002e5bc243 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:7449:x1868789712953344:12345-0@lo:253: 20000000:01000000:0.0:1782216841.385439:0:6513:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1782216841.385453:0:6513:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1782216841.388150:0:6498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1782216841.391448:0:6513:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1782216841.391643:0:6513:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1782216841.392012:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002e5bc243 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:7449:x1868789712953344:12345-0@lo:253: Request processed in 6593us (6810us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216841.392036:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1782216841.392089:0:7449:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d49727f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:7449:1868789712953344:0@lo:253: 10000000:01000000:0.0:1782216841.392103:0:7449:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1782216841.392106:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1782216841.392107:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1782216841.392109:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782216841.392110:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782216841.392111:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782216841.392112:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782216841.392113:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1782216841.392114:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782216841.392115:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782216841.392117:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782216841.392118:0:7449:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1782216841.392134:0:7449:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1782216841.393754:0:6534:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1782216841.393762:0:6534:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1782216841.393781:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e887a6b4/0x92b8e04cbf5f9049 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.393797:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000004e145038/0x92b8e04cbf5f8f69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f8f62 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.393804:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f9e2e10a/0x92b8e04cbf5f9011 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f900a expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.393811:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000e887a6b4/0x92b8e04cbf5f9049 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.393848:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f9e2e10a/0x92b8e04cbf5f9011 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5f900a expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.393904:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f9e2e10a/0x92b8e04cbf5f9011 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5f900a expref: 14 pid: 6514 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216841.393917:0:6534:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a3ba9406 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1868789712953472:0@lo:104: 00000100:00100000:1.0:1782216841.393964:0:6534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782216841.394046:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000004e145038/0x92b8e04cbf5f8f69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5f8f62 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.394053:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000004e145038/0x92b8e04cbf5f8f69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5f8f62 expref: 14 pid: 6514 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216841.394075:0:6534:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000073fbb14b pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1868789712953600:0@lo:104: 00000100:00100000:1.0:1782216841.394095:0:6534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00080000:10000000:0.0:1782216841.397742:0:7449:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:0.0:1782216841.397908:0:7449:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1782216841.398154:0:7449:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00000100:00100000:1.0:1782216841.398409:0:6534:0:(client.c:2701:ptlrpc_set_wait()) set 000000009ca92fe4 going to sleep for 11 seconds 00080000:10000000:0.0:1782216841.398849:0:7449:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1782216841.399048:0:7449:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1782216841.399219:0:7449:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000100:00100000:2.0:1782216841.399651:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712953472 00000100:00100000:2.0:1782216841.399660:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712953472 00000100:00100000:2.0:1782216841.399694:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712953600 00000100:00100000:2.0:1782216841.399697:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712953600 00000100:00100000:2.0:1782216841.399713:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782216841.399720:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d9924660 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+4:6534:x1868789712953472:12345-0@lo:104: 00010000:00010000:2.0:1782216841.399736:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: 00000000c0a775c4/0x92b8e04cbf5f900a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f9011 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216841.399856:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782216841.399862:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d9924660 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+4:6534:x1868789712953472:12345-0@lo:104: Request processed in 143us (5898us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216841.399869:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782216841.399884:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782216841.399890:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000024bf064c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+3:6534:x1868789712953600:12345-0@lo:104: 00010000:00010000:2.0:1782216841.399905:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: 000000003a7b1a0d/0x92b8e04cbf5f8f62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f8f69 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216841.399937:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1782216841.399942:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000024bf064c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+3:6534:x1868789712953600:12345-0@lo:104: Request processed in 53us (5847us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216841.399947:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1782216841.400027:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782216841.400033:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: 00000000c0a775c4/0x92b8e04cbf5f900a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f9011 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.400040:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c0a775c4 already unused, calling callback (000000002754abcf) 10000000:00010000:1.0:1782216841.400043:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: 00000000c0a775c4/0x92b8e04cbf5f900a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5f9011 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.400051:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: 00000000c0a775c4/0x92b8e04cbf5f900a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5f9011 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782216841.400057:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: 00000000c0a775c4/0x92b8e04cbf5f900a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5f9011 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782216841.400062:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1782216841.400095:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: 00000000c0a775c4/0x92b8e04cbf5f900a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f9011 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.400101:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782216841.400115:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: 00000000c0a775c4/0x92b8e04cbf5f900a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f9011 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.400121:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: 00000000c0a775c4/0x92b8e04cbf5f900a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f9011 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.400132:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782216841.400140:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: 000000003a7b1a0d/0x92b8e04cbf5f8f62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f8f69 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.400145:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003a7b1a0d already unused, calling callback (000000002754abcf) 10000000:00010000:1.0:1782216841.400147:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: 000000003a7b1a0d/0x92b8e04cbf5f8f62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5f8f69 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.400152:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: 000000003a7b1a0d/0x92b8e04cbf5f8f62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5f8f69 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782216841.400157:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: 000000003a7b1a0d/0x92b8e04cbf5f8f62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5f8f69 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782216841.400161:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1782216841.400172:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: 000000003a7b1a0d/0x92b8e04cbf5f8f62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f8f69 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.400367:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782216841.400379:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: 000000003a7b1a0d/0x92b8e04cbf5f8f62 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f8f69 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.400384:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: 000000003a7b1a0d/0x92b8e04cbf5f8f62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f8f69 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.400396:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216841.400398:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216841.400399:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216841.400405:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782216841.400417:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000052fe6fa1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17bce19a-7a0f-4c9d-b31c-4e0155298487:3648:1868789712953728:0@lo:103: 00000100:00100000:1.0:1782216841.400455:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216841.400498:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000082bbbf74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789712953856:0@lo:103: 00000100:00100000:1.0:1782216841.400529:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216841.400559:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712953728 00000100:00100000:1.0:1782216841.400562:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712953728 00010000:00010000:1.0:1782216841.400578:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f9e2e10a/0x92b8e04cbf5f9011 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f900a expref: 15 pid: 6514 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216841.400616:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712953856 00000100:00100000:1.0:1782216841.400618:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712953856 00010000:00010000:1.0:1782216841.400629:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000004e145038/0x92b8e04cbf5f8f69 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f8f62 expref: 16 pid: 6514 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216841.400640:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782216841.400646:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ef8ce878 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:3648:x1868789712953728:12345-0@lo:103: 00010000:00010000:1.0:1782216841.400656:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782216841.400659:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f9e2e10a/0x92b8e04cbf5f9011 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f900a expref: 16 pid: 6514 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.400668:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f9e2e10a/0x92b8e04cbf5f9011 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5f900a expref: 16 pid: 6514 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.400682:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782216841.400704:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ef8ce878 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:3648:x1868789712953728:12345-0@lo:103: Request processed in 59us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216841.400711:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782216841.400721:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782216841.400725:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e35faad6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:3649:x1868789712953856:12345-0@lo:103: 00010000:00010000:1.0:1782216841.400731:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782216841.400734:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000004e145038/0x92b8e04cbf5f8f69 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f8f62 expref: 15 pid: 6514 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.400750:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000004e145038/0x92b8e04cbf5f8f69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5f8f62 expref: 15 pid: 6514 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.400761:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000e887a6b4/0x92b8e04cbf5f9049 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.400767:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e887a6b4/0x92b8e04cbf5f9049 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1782216841.400780:0:6505:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007026663s 00010000:00010000:1.0:1782216841.400783:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e887a6b4/0x92b8e04cbf5f9049 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.400789:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e887a6b4/0x92b8e04cbf5f9049 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.400794:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e887a6b4/0x92b8e04cbf5f9049 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.400798:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e887a6b4/0x92b8e04cbf5f9049 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.400802:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e887a6b4 already unused, calling callback (00000000e53a7aa9) 00010000:00010000:1.0:1782216841.400805:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e887a6b4/0x92b8e04cbf5f9049 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.400811:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e887a6b4/0x92b8e04cbf5f9049 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.400818:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e887a6b4/0x92b8e04cbf5f9049 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216841.400837:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782216841.400860:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e35faad6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:3649:x1868789712953856:12345-0@lo:103: Request processed in 135us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216841.400866:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782216841.400921:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000052fe6fa1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17bce19a-7a0f-4c9d-b31c-4e0155298487:3648:1868789712953728:0@lo:103: 00000100:00100000:1.0:1782216841.400941:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000082bbbf74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789712953856:0@lo:103: 00010000:00010000:0.0:1782216841.401774:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f9e2e10a/0x92b8e04cbf5f9011 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5f900a expref: 14 pid: 6514 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216841.401789:0:6534:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a3ba9406 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1868789712953472:0@lo:104: 00010000:00010000:0.0:1782216841.401799:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004e145038/0x92b8e04cbf5f8f69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5f8f62 expref: 13 pid: 6514 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216841.401806:0:6534:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000073fbb14b pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1868789712953600:0@lo:104: 00010000:00010000:0.0:1782216841.401820:0:6534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000e887a6b4/0x92b8e04cbf5f9049 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216841.401836:0:6534:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000e887a6b4/0x92b8e04cbf5f9049 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216841.401842:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e887a6b4/0x92b8e04cbf5f9049 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216841.401847:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e887a6b4/0x92b8e04cbf5f9049 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1782216841.402503:0:7449:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1782216841.402932:0:7449:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1782216841.403137:0:7449:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:3.0:1782216841.403362:0:7449:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1782216841.403537:0:7449:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:3.0:1782216841.403802:0:7449:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:3.0:1782216841.405251:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:3.0:1782216841.405611:0:7473:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:3.0:1782216841.405661:0:7473:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000391e76c7 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7473:1868789712953984:0@lo:700: 00000100:00100000:3.0:1782216841.405724:0:7473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216841.405749:0:7473:0:(client.c:2701:ptlrpc_set_wait()) set 00000000d6abd6d6 going to sleep for 11 seconds 00000100:00100000:2.0:1782216841.405825:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712953984 00000100:00100000:2.0:1782216841.405832:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712953984 00000100:00100000:2.0:1782216841.405872:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782216841.405879:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dd6f1375 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7473:x1868789712953984:12345-0@lo:700: 00000040:01000000:0.0:1782216841.405997:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1782216841.406774:0:7474:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002564d4fe pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1868789712954112:0@lo:1000: 00000100:00100000:0.0:1782216841.406830:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:3.0:1782216841.407215:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1782216841.407338:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1782216841.407837:0:7449:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1782216841.407846:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1782216841.407963:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782216841.408932:0:7449:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1782216841.409540:0:7449:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1782216841.409572:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1782216841.409772:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1782216841.409970:0:7449:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000100:00100000:0.0:1782216841.410359:0:7474:0:(client.c:2701:ptlrpc_set_wait()) set 000000006cdbb81e going to sleep for 11 seconds 00000020:00080000:1.0:1782216841.410461:0:7472:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1782216841.410466:0:7472:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00100000:10000000:3.0:1782216841.414034:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1782216841.414196:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1782216841.414503:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1782216841.414700:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1782216841.414849:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1782216841.414978:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1782216841.415103:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00000100:00100000:2.0:1782216841.415400:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712954112 00000100:00100000:2.0:1782216841.415410:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712954112 00100000:10000000:3.0:1782216841.415517:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1782216841.415709:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1782216841.415859:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1782216841.416001:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1782216841.416138:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00000100:00100000:1.0:1782216841.416401:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782216841.416411:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c8c0ab0f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7474:x1868789712954112:12345-0@lo:1000: 00000100:00100000:1.0:1782216841.416532:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c8c0ab0f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7474:x1868789712954112:12345-0@lo:1000: Request processed in 123us (9702us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216841.416540:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782216841.416668:0:7474:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002564d4fe pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1868789712954112:0@lo:1000: 00000040:01000000:1.0:1782216841.416705:0:7474:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:1.0:1782216841.416742:0:7474:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000082bbbf74 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1868789712954240:0@lo:700: 00000100:00100000:1.0:1782216841.416775:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216841.416802:0:7474:0:(client.c:2701:ptlrpc_set_wait()) set 00000000898d5592 going to sleep for 11 seconds 00100000:10000000:3.0:1782216841.416896:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1782216841.417043:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1782216841.417169:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00000100:00100000:2.0:1782216841.417353:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712954240 00000100:00100000:2.0:1782216841.417360:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712954240 00000100:00100000:2.0:1782216841.417392:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782216841.417398:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000052fe6fa1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7474:x1868789712954240:12345-0@lo:700: 00000100:00100000:2.0:1782216841.417458:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000052fe6fa1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7474:x1868789712954240:12345-0@lo:700: Request processed in 60us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216841.417464:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782216841.417523:0:7474:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000082bbbf74 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1868789712954240:0@lo:700: 00000100:00100000:1.0:1782216841.417569:0:7474:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000082bbbf74 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7474:1868789712954368:0@lo:900: 00000100:00100000:1.0:1782216841.417617:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216841.417634:0:7474:0:(client.c:2701:ptlrpc_set_wait()) set 00000000898d5592 going to sleep for 11 seconds 00000100:00100000:2.0:1782216841.417686:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712954368 00000100:00100000:2.0:1782216841.417690:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712954368 00000100:00100000:2.0:1782216841.417713:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782216841.417719:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000045cc1a30 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7474:x1868789712954368:12345-0@lo:900: 00000100:00100000:2.0:1782216841.417761:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000045cc1a30 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7474:x1868789712954368:12345-0@lo:900: Request processed in 42us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216841.417766:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1782216841.417820:0:7474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000082bbbf74 x1868789712954368/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1782216857 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216841.417843:0:7474:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000082bbbf74 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7474:1868789712954368:0@lo:900: 00000100:00100000:1.0:1782216841.417919:0:7474:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000082bbbf74 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1868789712954496:0@lo:1000: 00000100:00100000:1.0:1782216841.417946:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216841.417972:0:7474:0:(client.c:2701:ptlrpc_set_wait()) set 00000000a67ba2af going to sleep for 11 seconds 00000100:00100000:2.0:1782216841.418013:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712954496 00000100:00100000:2.0:1782216841.418022:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712954496 00000100:00100000:2.0:1782216841.418080:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782216841.418086:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ef8ce878 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7474:x1868789712954496:12345-0@lo:1000: 00000100:00100000:2.0:1782216841.418136:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ef8ce878 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7474:x1868789712954496:12345-0@lo:1000: Request processed in 51us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216841.418141:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00100000:10000000:3.0:1782216841.418414:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1782216841.418745:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1782216841.418887:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1782216841.419027:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1782216841.419219:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1782216841.419348:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1782216841.419474:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1782216841.419637:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1782216841.419800:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1782216841.419943:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1782216841.420080:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1782216841.420222:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1782216841.420369:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1782216841.420501:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1782216841.420658:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1782216841.420801:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1782216841.420958:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1782216841.421164:0:7449:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1782216841.422363:0:7474:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000082bbbf74 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1868789712954496:0@lo:1000: 00000004:00080000:1.0:1782216841.422433:0:7474:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000898d5592 with version 0 00000020:00100000:1.0:1782216841.422457:0:7474:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1782216841.422463:0:7474:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000082bbbf74 x1868789712954752/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782216841.422483:0:7474:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000082bbbf74 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1868789712954752:0@lo:1000: 00000100:00100000:1.0:1782216841.422539:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216841.422574:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712954752 00000100:00100000:1.0:1782216841.422598:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712954752 00000100:00100000:1.0:1782216841.422632:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782216841.422639:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b87482f3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7474:x1868789712954752:12345-0@lo:1000: 00000100:00100000:1.0:1782216841.422945:0:7474:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e82484cc going to sleep for 11 seconds 40000000:02000000:1.0:1782216841.423467:0:6525:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000100:00100000:1.0:1782216841.433503:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dd6f1375 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7473:x1868789712953984:12345-0@lo:700: Request processed in 27617us (27773us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216841.433525:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1782216841.433666:0:7473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000391e76c7 x1868789712953984/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1782216857 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216841.433682:0:7473:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000391e76c7 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7473:1868789712953984:0@lo:700: 40000000:02000000:3.0:1782216841.433696:0:7473:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000001:00080000:0.0:1782216841.439479:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:1.0:1782216841.439721:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b87482f3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7474:x1868789712954752:12345-0@lo:1000: Request processed in 17080us (17180us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1782216841.439734:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:2.0:1782216841.439874:0:7474:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1782216841.439879:0:7474:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1782216841.439894:0:7474:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000082bbbf74 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1868789712954752:0@lo:1000: 00000100:00100000:2.0:1782216841.439980:0:7474:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000bbc08beb pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1868789712954880:0@lo:1000: 00000100:00100000:2.0:1782216841.440016:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216841.440063:0:7474:0:(client.c:2701:ptlrpc_set_wait()) set 000000007dc2e0fb going to sleep for 11 seconds 00000100:00100000:1.0:1782216841.441975:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712954880 00000100:00100000:1.0:1782216841.441987:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712954880 00000100:00100000:1.0:1782216841.442058:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782216841.442066:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000029bdce7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7474:x1868789712954880:12345-0@lo:1000: 00000100:00100000:1.0:1782216841.442187:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000029bdce7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7474:x1868789712954880:12345-0@lo:1000: Request processed in 122us (2170us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216841.442195:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782216841.442240:0:7474:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000bbc08beb pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1868789712954880:0@lo:1000: 00000040:00080000:1.0:1782216841.442274:0:7474:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1782216841.442313:0:7474:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000d776f762 with version 1 00000001:00080000:0.0:1782216841.443632:0:7449:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1782216841.443669:0:7449:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa4bf81c73988 00100000:10000000:0.0:1782216841.443678:0:7449:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1782216841.444284:0:7449:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1782216841.444316:0:7449:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.130@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1782216841.444339:0:7449:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1782216841.444366:0:7449:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000040:00080000:1.0:1782216841.446022:0:7474:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1782216841.446096:0:7474:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000020:00000004:2.0:1782216841.448908:0:7449:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782216841.449054:0:7449:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000004:00080000:2.0:1782216841.461890:0:7464:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000d5a2c266 version 1 rpc_version 1 00000020:00100000:2.0:1782216841.461935:0:7464:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1782216841.461945:0:7464:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000510bafb6 x1868789712955136/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782216841.461968:0:7464:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000510bafb6 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7464:1868789712955136:0@lo:1000: 00000100:00100000:2.0:1782216841.462033:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216841.462087:0:7464:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f8ecd817 going to sleep for 11 seconds 00000100:00100000:1.0:1782216841.463210:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712955136 00000100:00100000:1.0:1782216841.463222:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712955136 00000100:00100000:1.0:1782216841.463799:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782216841.463810:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c6bf06ec pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7464:x1868789712955136:12345-0@lo:1000: 00000001:00080000:2.0:1782216841.477717:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:1.0:1782216841.488050:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c6bf06ec pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7464:x1868789712955136:12345-0@lo:1000: Request processed in 24236us (26011us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1782216841.488066:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:1.0:1782216841.488122:0:7464:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1782216841.488126:0:7464:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1782216841.488142:0:7464:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000510bafb6 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7464:1868789712955136:0@lo:1000: 00000040:00080000:3.0:1782216841.490426:0:7473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782216841.502316:0:7473:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1782216841.502398:0:7473:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1782216841.502412:0:7473:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:1.0:1782216841.720908:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216842.745338:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216843.768885:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216844.792959:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782216845.500040:0:7718:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1782216845.817020:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1782216846.343819:0:7770:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782216846.344017:0:7770:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1782216846.394323:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000006a9b1f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789712955264:0@lo:41: 00000100:00100000:1.0:1782216846.394392:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216846.394479:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712955264 00000100:00100000:1.0:1782216846.394487:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712955264 00000100:00100000:1.0:1782216846.394529:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782216846.394537:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a01a77d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789712955264:12345-0@lo:41: 00000004:00000024:1.0:1782216846.394575:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1782216846.394647:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a01a77d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789712955264:12345-0@lo:41: Request processed in 105us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216846.394655:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782216846.394705:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000006a9b1f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789712955264:0@lo:41: 00000100:00100000:3.0:1782216846.395860:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000391e76c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789712955392:0@lo:400: 00000100:00100000:3.0:1782216846.395909:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216846.395943:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782216846.395949:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000cf883c65 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1868789712955520:0@lo:400: 00000100:00100000:3.0:1782216846.395976:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216846.396024:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712955392 00000100:00100000:3.0:1782216846.396030:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712955392 00000100:00100000:3.0:1782216846.396070:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1782216846.396078:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006c18bdc5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+13:3647:x1868789712955392:12345-0@lo:400: 00000100:00100000:3.0:1782216846.396123:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006c18bdc5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+13:3647:x1868789712955392:12345-0@lo:400: Request processed in 46us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216846.396131:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1782216846.396231:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712955520 00000100:00100000:3.0:1782216846.396235:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712955520 00000100:00100000:3.0:1782216846.396270:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782216846.396279:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001491d778 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1868789712955520:12345-0@lo:400: 00000100:00100000:3.0:1782216846.396314:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001491d778 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1868789712955520:12345-0@lo:400: Request processed in 38us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216846.396321:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782216846.396347:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000075be3167 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1868789712955648:0@lo:400: 00010000:00080000:3.0:1782216846.396354:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000cf883c65 x1868789712955520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216846.396368:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000cf883c65 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1868789712955520:0@lo:400: 00000100:00100000:3.0:1782216846.396379:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000391e76c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789712955392:0@lo:400: 00000100:00100000:2.0:1782216846.396388:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216846.396405:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712955648 00000100:00100000:3.0:1782216846.396410:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712955648 00000100:00100000:3.0:1782216846.396437:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782216846.396443:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b330a8f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1868789712955648:12345-0@lo:400: 00000100:00100000:3.0:1782216846.397607:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b330a8f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1868789712955648:12345-0@lo:400: Request processed in 1160us (1216us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216846.397619:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1782216846.400682:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000075be3167 x1868789712955648/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216846.400701:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000075be3167 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1868789712955648:0@lo:400: 00010000:00010000:2.0:1782216846.841954:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216847.866691:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782216848.893413:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1782216849.200879:0:7872:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782216849.201061:0:7872:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1782216849.912791:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782216850.153479:0:7920:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe7d49f310 20000000:00000080:3.0:1782216850.153775:0:7920:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff952e7c549c00 uarg=0000000000000000 20000000:01000000:3.0:1782216850.153823:0:7920:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1782216850.153830:0:7920:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1782216850.153835:0:7920:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1782216850.153908:0:7920:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1782216850.153921:0:7920:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1782216850.157426:0:7920:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782216850.157982:0:7920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1782216850.158016:0:7920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1782216850.158031:0:7920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1782216850.158047:0:7920:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1782216850.158062:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000482b05eb/0x92b8e04cbf5f9050 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216850.158080:0:7920:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d5796596/0x92b8e04cbf5f8f31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f8f2a expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216850.158087:0:7920:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000007d002c5/0x92b8e04cbf5f901f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9018 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216850.158093:0:7920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000482b05eb/0x92b8e04cbf5f9050 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216850.158142:0:7920:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000007d002c5/0x92b8e04cbf5f901f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5f9018 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216850.158154:0:7920:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000007d002c5/0x92b8e04cbf5f901f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9018 expref: 12 pid: 6511 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216850.158166:0:7920:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000391e76c7 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7920:1868789712955776:0@lo:104: 00000100:00100000:3.0:1782216850.158236:0:7920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782216850.158294:0:7920:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d5796596/0x92b8e04cbf5f8f31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5f8f2a expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216850.158310:0:7920:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d5796596/0x92b8e04cbf5f8f31 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5f8f2a expref: 12 pid: 6511 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216850.158318:0:7920:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000cf883c65 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7920:1868789712955904:0@lo:104: 00000100:00100000:3.0:1782216850.158339:0:7920:0:(client.c:2701:ptlrpc_set_wait()) set 00000000bbb33b9a going to sleep for 11 seconds 00000100:00100000:2.0:1782216850.158463:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1782216850.158482:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216850.158509:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712955776 00000100:00100000:2.0:1782216850.158524:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712955776 00000100:00100000:2.0:1782216850.158558:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712955904 00000100:00100000:2.0:1782216850.158561:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712955904 00000100:00100000:2.0:1782216850.158575:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782216850.158611:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000076a5af12 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+4:7920:x1868789712955776:12345-0@lo:104: 00010000:00010000:2.0:1782216850.158623:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: 0000000008e2888b/0x92b8e04cbf5f9018 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f901f expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216850.158679:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782216850.158684:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000076a5af12 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+4:7920:x1868789712955776:12345-0@lo:104: Request processed in 104us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216850.158691:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782216850.158725:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782216850.158731:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc3ff9ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+3:7920:x1868789712955904:12345-0@lo:104: 00010000:00010000:2.0:1782216850.158746:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: 000000009d542441/0x92b8e04cbf5f8f2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f8f31 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216850.158780:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1782216850.158786:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc3ff9ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+3:7920:x1868789712955904:12345-0@lo:104: Request processed in 55us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216850.158792:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1782216850.158809:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782216850.158813:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: 0000000008e2888b/0x92b8e04cbf5f9018 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f901f expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216850.158820:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000008e2888b already unused, calling callback (000000002754abcf) 10000000:00010000:2.0:1782216850.158824:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: 0000000008e2888b/0x92b8e04cbf5f9018 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5f901f expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216850.158830:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: 0000000008e2888b/0x92b8e04cbf5f9018 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5f901f expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782216850.158836:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: 0000000008e2888b/0x92b8e04cbf5f9018 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5f901f expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782216850.158841:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782216850.158865:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: 0000000008e2888b/0x92b8e04cbf5f9018 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f901f expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216850.158871:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782216850.158886:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: 0000000008e2888b/0x92b8e04cbf5f9018 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f901f expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216850.158891:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: 0000000008e2888b/0x92b8e04cbf5f9018 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f901f expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216850.158911:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782216850.158913:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: 000000009d542441/0x92b8e04cbf5f8f2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f8f31 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216850.158918:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009d542441 already unused, calling callback (000000002754abcf) 10000000:00010000:2.0:1782216850.158920:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: 000000009d542441/0x92b8e04cbf5f8f2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5f8f31 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216850.158925:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: 000000009d542441/0x92b8e04cbf5f8f2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5f8f31 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782216850.158929:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: 000000009d542441/0x92b8e04cbf5f8f2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5f8f31 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782216850.158933:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782216850.158946:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: 000000009d542441/0x92b8e04cbf5f8f2a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f8f31 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216850.158952:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782216850.158965:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: 000000009d542441/0x92b8e04cbf5f8f2a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f8f31 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216850.158971:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: 000000009d542441/0x92b8e04cbf5f8f2a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f8f31 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216850.158983:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216850.158985:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216850.158986:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216850.158997:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a07bfc4d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17bce19a-7a0f-4c9d-b31c-4e0155298487:3650:1868789712956032:0@lo:103: 00000100:00100000:2.0:1782216850.159029:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216850.159060:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d08e0983 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789712956160:0@lo:103: 00000100:00100000:2.0:1782216850.159080:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782216850.159140:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216850.159160:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712956032 00000100:00100000:2.0:1782216850.159164:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712956032 00010000:00010000:2.0:1782216850.159304:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000007d002c5/0x92b8e04cbf5f901f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9018 expref: 13 pid: 6511 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216850.159328:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712956160 00000100:00100000:2.0:1782216850.159332:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712956160 00010000:00010000:2.0:1782216850.159343:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d5796596/0x92b8e04cbf5f8f31 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f8f2a expref: 14 pid: 6511 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216850.159354:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782216850.159360:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008cd55cf5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+14:3650:x1868789712956032:12345-0@lo:103: 00010000:00010000:2.0:1782216850.159368:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782216850.159372:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000007d002c5/0x92b8e04cbf5f901f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9018 expref: 14 pid: 6511 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216850.159379:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000007d002c5/0x92b8e04cbf5f901f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9018 expref: 14 pid: 6511 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216850.159392:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782216850.159420:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008cd55cf5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+14:3650:x1868789712956032:12345-0@lo:103: Request processed in 61us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216850.159426:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782216850.159438:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782216850.159443:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000da81dab4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+13:3647:x1868789712956160:12345-0@lo:103: 00010000:00010000:2.0:1782216850.159458:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782216850.159462:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d5796596/0x92b8e04cbf5f8f31 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f8f2a expref: 13 pid: 6511 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216850.159470:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d5796596/0x92b8e04cbf5f8f31 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5f8f2a expref: 13 pid: 6511 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216850.159479:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000482b05eb/0x92b8e04cbf5f9050 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216850.159486:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000482b05eb/0x92b8e04cbf5f9050 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216850.159497:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000482b05eb/0x92b8e04cbf5f9050 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216850.159503:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000482b05eb/0x92b8e04cbf5f9050 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216850.159508:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000482b05eb/0x92b8e04cbf5f9050 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216850.159524:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000482b05eb/0x92b8e04cbf5f9050 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216850.159528:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000482b05eb already unused, calling callback (00000000e53a7aa9) 00010000:00010000:2.0:1782216850.159531:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000482b05eb/0x92b8e04cbf5f9050 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216850.159537:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000482b05eb/0x92b8e04cbf5f9050 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216850.159554:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000482b05eb/0x92b8e04cbf5f9050 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216850.159562:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782216850.159610:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000da81dab4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+13:3647:x1868789712956160:12345-0@lo:103: Request processed in 167us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216850.159616:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782216850.159647:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d08e0983 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789712956160:0@lo:103: 00000100:00100000:2.0:1782216850.159668:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a07bfc4d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17bce19a-7a0f-4c9d-b31c-4e0155298487:3650:1868789712956032:0@lo:103: 00010000:00010000:0.0:1782216850.159769:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000007d002c5/0x92b8e04cbf5f901f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5f9018 expref: 12 pid: 6511 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216850.159778:0:7920:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000391e76c7 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7920:1868789712955776:0@lo:104: 00010000:00010000:0.0:1782216850.159786:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d5796596/0x92b8e04cbf5f8f31 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5f8f2a expref: 11 pid: 6511 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216850.159793:0:7920:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000cf883c65 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7920:1868789712955904:0@lo:104: 00010000:00010000:0.0:1782216850.159806:0:7920:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000482b05eb/0x92b8e04cbf5f9050 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216850.159820:0:7920:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000482b05eb/0x92b8e04cbf5f9050 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216850.159825:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000482b05eb/0x92b8e04cbf5f9050 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216850.159830:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000482b05eb/0x92b8e04cbf5f9050 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782216850.408711:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1782216850.408718:0:6516:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff952e7b38d800 from 4 10000000:01000000:2.0:1782216850.408724:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1782216850.408771:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 00000000bc8b3380/0x92b8e04cbf5f9057 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216850.408783:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 00000000bc8b3380/0x92b8e04cbf5f9057 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216850.408792:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 00000000bc8b3380/0x92b8e04cbf5f9057 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216850.408815:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a07bfc4d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712956288:0@lo:101: 00000100:00100000:2.0:1782216850.408880:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216850.409002:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set 0000000047d476cb going to sleep for 11 seconds 00000100:00100000:0.0:1782216850.409152:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712956288 00000100:00100000:0.0:1782216850.409160:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712956288 00000100:00100000:0.0:1782216850.409226:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1782216850.409234:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000294b768c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+11:6516:x1868789712956288:12345-0@lo:101: 00010000:00010000:0.0:1782216850.409246:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782216850.409259:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000007d002c5/0x92b8e04cbf5f905e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f9057 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216850.409278:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000007d002c5/0x92b8e04cbf5f905e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9057 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216850.409287:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000007d002c5/0x92b8e04cbf5f905e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9057 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216850.409295:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000007d002c5, rc 0) 00000100:00100000:0.0:1782216850.409341:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000294b768c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+12:6516:x1868789712956288:12345-0@lo:101: Request processed in 108us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216850.409348:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1782216850.409649:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a07bfc4d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712956288:0@lo:101: 00010000:00010000:2.0:1782216850.409663:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 00000000bc8b3380/0x92b8e04cbf5f9057 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f905e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216850.409688:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 00000000bc8b3380/0x92b8e04cbf5f9057 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f905e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216850.409737:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a07bfc4d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712956416:0@lo:256: 00000100:00100000:2.0:1782216850.409770:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216850.409842:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712956416 00000100:00100000:3.0:1782216850.409848:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712956416 00000100:00100000:3.0:1782216850.409876:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1782216850.409882:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005dc9bb33 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+12:6516:x1868789712956416:12345-0@lo:256: 20000000:01000000:3.0:1782216850.409897:0:6514:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1782216850.409912:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1782216850.409915:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1782216850.409983:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005dc9bb33 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+12:6516:x1868789712956416:12345-0@lo:256: Request processed in 101us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216850.409990:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1782216850.410387:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set 0000000047d476cb going to sleep for 11 seconds 00000100:00100000:2.0:1782216850.410403:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a07bfc4d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712956416:0@lo:256: 10000000:01000000:2.0:1782216850.410442:0:6516:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1782216850.410448:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 00000000bc8b3380/0x92b8e04cbf5f9057 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f905e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216850.410455:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: 00000000bc8b3380/0x92b8e04cbf5f9057 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f905e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782216850.410463:0:6516:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782216850.410465:0:6516:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff952e7b38d800 from 1 10000000:01000000:2.0:1782216850.410467:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782216850.410489:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 00000000d818238a/0x92b8e04cbf5f9065 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216850.410495:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 00000000d818238a/0x92b8e04cbf5f9065 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216850.410502:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 00000000d818238a/0x92b8e04cbf5f9065 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216850.410514:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a07bfc4d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712956544:0@lo:101: 00000100:00100000:2.0:1782216850.411262:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216850.411317:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set 0000000047d476cb going to sleep for 11 seconds 00000100:00100000:3.0:1782216850.411375:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712956544 00000100:00100000:3.0:1782216850.411382:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712956544 00000100:00100000:3.0:1782216850.411422:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1782216850.411429:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007930c2c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+12:6516:x1868789712956544:12345-0@lo:101: 00010000:00010000:3.0:1782216850.411440:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782216850.411452:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f20b707a/0x92b8e04cbf5f906c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f9065 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216850.411471:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f20b707a/0x92b8e04cbf5f906c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9065 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216850.411479:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f20b707a/0x92b8e04cbf5f906c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9065 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216850.411497:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f20b707a, rc 0) 00000100:00100000:3.0:1782216850.411540:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007930c2c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+13:6516:x1868789712956544:12345-0@lo:101: Request processed in 112us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216850.411553:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1782216850.411578:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a07bfc4d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712956544:0@lo:101: 00010000:00010000:2.0:1782216850.411626:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 00000000d818238a/0x92b8e04cbf5f9065 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f906c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216850.411635:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 00000000d818238a/0x92b8e04cbf5f9065 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f906c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216850.411696:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a07bfc4d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712956672:0@lo:501: 00000100:00100000:2.0:1782216850.411730:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216850.411755:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set 0000000047d476cb going to sleep for 11 seconds 00000100:00100000:1.0:1782216850.411812:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712956672 00000100:00100000:1.0:1782216850.411817:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712956672 00000100:00100000:1.0:1782216850.411849:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1782216850.411855:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005965ba21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+13:6516:x1868789712956672:12345-0@lo:501: 00000100:00100000:1.0:1782216850.411974:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005965ba21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+13:6516:x1868789712956672:12345-0@lo:501: Request processed in 118us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216850.411981:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1782216850.412224:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a07bfc4d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712956672:0@lo:501: 00000100:00100000:2.0:1782216850.412254:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a07bfc4d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712956800:0@lo:503: 00000100:00100000:2.0:1782216850.412294:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216850.412352:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set 0000000047d476cb going to sleep for 11 seconds 00000100:00100000:0.0:1782216850.413301:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712956800 00000100:00100000:0.0:1782216850.413319:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712956800 00000100:00100000:0.0:1782216850.413418:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1782216850.413425:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000721a45fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+13:6516:x1868789712956800:12345-0@lo:503: 00000100:00100000:0.0:1782216850.413552:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000721a45fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+13:6516:x1868789712956800:12345-0@lo:503: Request processed in 128us (1258us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216850.413559:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1782216850.413651:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a07bfc4d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712956800:0@lo:503: 00000100:00100000:2.0:1782216850.414231:0:7932:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a07bfc4d pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:7932:1868789712956928:0@lo:502: 00000100:00100000:2.0:1782216850.414276:0:7932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216850.414567:0:7932:0:(client.c:2701:ptlrpc_set_wait()) set 00000000afe79058 going to sleep for 11 seconds 00000100:00100000:1.0:1782216850.414783:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712956928 00000100:00100000:1.0:1782216850.414790:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712956928 00000100:00100000:1.0:1782216850.414819:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1782216850.414826:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d76623ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+13:7932:x1868789712956928:12345-0@lo:502: 00000100:00100000:1.0:1782216850.414927:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d76623ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+13:7932:x1868789712956928:12345-0@lo:502: Request processed in 99us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216850.414935:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1782216850.415150:0:7932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a07bfc4d pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:7932:1868789712956928:0@lo:502: 00000020:01000000:2.0:1782216850.415177:0:7932:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782216850.415497:0:7932:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782216850.415499:0:7932:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1782216850.415510:0:7932:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff952e7b38d800 00000020:00000080:2.0:1782216850.415513:0:7932:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1782216850.415574:0:7932:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46db2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:7932:1868789712957056:0@lo:502: 00000100:00100000:2.0:1782216850.415787:0:7932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216850.415819:0:7932:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e50d58240 going to sleep for 11 seconds 00000100:00100000:1.0:1782216850.415885:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712957056 00000100:00100000:1.0:1782216850.415891:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712957056 00000100:00100000:1.0:1782216850.415917:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1782216850.415930:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e190450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+13:7932:x1868789712957056:12345-0@lo:502: 00000100:00100000:1.0:1782216850.416010:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e190450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+13:7932:x1868789712957056:12345-0@lo:502: Request processed in 80us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216850.416017:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1782216850.416300:0:7932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46db2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:7932:1868789712957056:0@lo:502: 00000020:01000000:2.0:1782216850.416322:0:7932:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782216850.416327:0:7932:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782216850.416329:0:7932:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1782216850.416334:0:7932:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1782216850.416866:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1782216850.416889:0:6516:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782216850.416898:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e413fd800/0x92b8e04cbf5f9065 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f906c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216850.416909:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e413fd800/0x92b8e04cbf5f9065 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f906c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782216850.416917:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1782216850.416920:0:6516:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff952e70905800 from 21 10000000:01000000:1.0:1782216850.416923:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782216850.416950:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e41681600/0x92b8e04cbf5f9073 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216850.416958:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e41681600/0x92b8e04cbf5f9073 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216850.416966:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e41681600/0x92b8e04cbf5f9073 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216850.416979:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b09ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712957184:0@lo:101: 00000100:00100000:1.0:1782216850.417013:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216850.417518:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e42c44300 going to sleep for 11 seconds 00000100:00100000:0.0:1782216850.417737:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712957184 00000100:00100000:0.0:1782216850.417744:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712957184 00000100:00100000:0.0:1782216850.417787:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1782216850.417795:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e193450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+13:6516:x1868789712957184:12345-0@lo:101: 00010000:00010000:0.0:1782216850.417807:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782216850.417820:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e7c448600/0x92b8e04cbf5f907a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f9073 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216850.417842:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e7c448600/0x92b8e04cbf5f907a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9073 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216850.417852:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e7c448600/0x92b8e04cbf5f907a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9073 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216850.417860:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7c448600, rc 0) 00000100:00100000:0.0:1782216850.417909:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e193450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+14:6516:x1868789712957184:12345-0@lo:101: Request processed in 114us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216850.417917:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1782216850.418141:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b09ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712957184:0@lo:101: 00010000:00010000:1.0:1782216850.418155:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e41681600/0x92b8e04cbf5f9073 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f907a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216850.418178:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e41681600/0x92b8e04cbf5f9073 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f907a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216850.418364:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b09ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712957312:0@lo:501: 00000100:00100000:1.0:1782216850.418393:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216850.418412:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e42c44300 going to sleep for 11 seconds 00000100:00100000:0.0:1782216850.418473:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712957312 00000100:00100000:0.0:1782216850.418477:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712957312 00000100:00100000:0.0:1782216850.418988:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1782216850.418999:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e191850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+14:6516:x1868789712957312:12345-0@lo:501: 00000100:00100000:0.0:1782216850.419398:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e191850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+14:6516:x1868789712957312:12345-0@lo:501: Request processed in 400us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216850.419416:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1782216850.419792:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b09ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712957312:0@lo:501: 00000100:00100000:1.0:1782216850.419835:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b09ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712957440:0@lo:503: 00000100:00100000:1.0:1782216850.419877:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216850.419943:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e42c44300 going to sleep for 11 seconds 00000100:00100000:0.0:1782216850.419982:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712957440 00000100:00100000:0.0:1782216850.419987:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712957440 00000100:00100000:0.0:1782216850.420981:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1782216850.420995:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e58053450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+14:6516:x1868789712957440:12345-0@lo:503: 00000100:00100000:0.0:1782216850.421363:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e58053450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+14:6516:x1868789712957440:12345-0@lo:503: Request processed in 373us (1485us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216850.421371:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1782216850.421908:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b09ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712957440:0@lo:503: 00000100:00100000:2.0:1782216850.423383:0:7933:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46db2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:7933:1868789712957568:0@lo:502: 00000100:00100000:2.0:1782216850.423456:0:7933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216850.423551:0:7933:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e50d58000 going to sleep for 11 seconds 00000100:00100000:3.0:1782216850.423820:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712957568 00000100:00100000:3.0:1782216850.423828:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712957568 00000100:00100000:3.0:1782216850.423875:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1782216850.423885:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e43998c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+14:7933:x1868789712957568:12345-0@lo:502: 00000100:00100000:3.0:1782216850.424016:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e43998c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+14:7933:x1868789712957568:12345-0@lo:502: Request processed in 132us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216850.424095:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1782216850.424363:0:7933:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46db2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:7933:1868789712957568:0@lo:502: 00000100:00100000:1.0:1782216850.424416:0:7933:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b09ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:7933:1868789712957696:0@lo:502: 00000100:00100000:1.0:1782216850.424452:0:7933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216850.424480:0:7933:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e42c44300 going to sleep for 11 seconds 00000100:00100000:0.0:1782216850.424535:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712957696 00000100:00100000:0.0:1782216850.424549:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712957696 00000100:00100000:0.0:1782216850.424602:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1782216850.424771:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4399b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+14:7933:x1868789712957696:12345-0@lo:502: 00000100:00100000:0.0:1782216850.424856:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4399b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+14:7933:x1868789712957696:12345-0@lo:502: Request processed in 87us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216850.424908:0:7933:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b09ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:7933:1868789712957696:0@lo:502: 00000040:00080000:1.0:1782216850.424928:0:7933:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1782216850.424993:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1782216850.425013:0:6516:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1782216850.425036:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e41681600/0x92b8e04cbf5f9073 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f907a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216850.425046:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e41681600/0x92b8e04cbf5f9073 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f907a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782216850.425067:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1782216850.425070:0:6516:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff952e70905800 from 4 10000000:01000000:1.0:1782216850.425072:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782216850.425097:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e41681000/0x92b8e04cbf5f9081 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216850.425105:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e41681000/0x92b8e04cbf5f9081 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216850.425123:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e41681000/0x92b8e04cbf5f9081 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216850.425136:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b09ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712957824:0@lo:101: 00000100:00100000:1.0:1782216850.425164:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216850.425198:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e42c44300 going to sleep for 11 seconds 00000100:00100000:1.0:1782216850.425987:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712957824 00000100:00100000:1.0:1782216850.425994:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712957824 00000100:00100000:0.0:1782216850.426404:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1782216850.426528:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1782216850.426538:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e43999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+14:6516:x1868789712957824:12345-0@lo:101: 00010000:00010000:1.0:1782216850.426561:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782216850.426575:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e41680c00/0x92b8e04cbf5f9088 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f9081 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216850.426727:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e41680c00/0x92b8e04cbf5f9088 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9081 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216850.426738:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e41680c00/0x92b8e04cbf5f9088 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9081 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216850.426759:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e41680c00, rc 0) 00000100:00100000:1.0:1782216850.426821:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e43999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:6516:x1868789712957824:12345-0@lo:101: Request processed in 284us (1655us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216850.426827:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1782216850.426888:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b09ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712957824:0@lo:101: 00010000:00010000:2.0:1782216850.426904:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e41681000/0x92b8e04cbf5f9081 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f9088 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216850.426913:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e41681000/0x92b8e04cbf5f9081 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f9088 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216850.426969:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46db2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712957952:0@lo:256: 00000100:00100000:2.0:1782216850.427004:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216850.427432:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e50d58900 going to sleep for 11 seconds 00000100:00100000:3.0:1782216850.427498:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712957952 00000100:00100000:3.0:1782216850.427505:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712957952 00000100:00100000:3.0:1782216850.427535:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1782216850.427554:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e43999c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:6516:x1868789712957952:12345-0@lo:256: 20000000:01000000:3.0:1782216850.427570:0:6514:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1782216850.427750:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1782216850.427754:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1782216850.427848:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e43999c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:6516:x1868789712957952:12345-0@lo:256: Request processed in 306us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216850.427855:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1782216850.427930:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46db2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712957952:0@lo:256: 10000000:01000000:2.0:1782216850.427974:0:6516:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1782216850.427982:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e41681000/0x92b8e04cbf5f9081 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f9088 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216850.427990:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e41681000/0x92b8e04cbf5f9081 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f9088 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782216850.428009:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1782216850.428012:0:6516:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1782216850.428014:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1782216850.428046:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e413fc600/0x92b8e04cbf5f908f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216850.428054:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e413fc600/0x92b8e04cbf5f908f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216850.428061:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e413fc600/0x92b8e04cbf5f908f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216850.428075:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46db2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712958080:0@lo:101: 00000100:00100000:2.0:1782216850.428099:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216850.428135:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e50d58900 going to sleep for 11 seconds 00000100:00100000:3.0:1782216850.428347:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712958080 00000100:00100000:3.0:1782216850.428352:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712958080 00000100:00100000:3.0:1782216850.428372:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1782216850.428378:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e582c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:6516:x1868789712958080:12345-0@lo:101: 00010000:00010000:3.0:1782216850.428386:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782216850.428402:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e7b363800/0x92b8e04cbf5f9096 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f908f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216850.428419:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e7b363800/0x92b8e04cbf5f9096 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f908f expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216850.428428:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e7b363800/0x92b8e04cbf5f9096 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f908f expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216850.428435:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b363800, rc 0) 00000100:00100000:3.0:1782216850.428471:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e582c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:6516:x1868789712958080:12345-0@lo:101: Request processed in 93us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216850.428477:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1782216850.428555:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46db2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712958080:0@lo:101: 00010000:00010000:2.0:1782216850.428567:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e413fc600/0x92b8e04cbf5f908f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f9096 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216850.428576:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e413fc600/0x92b8e04cbf5f908f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f9096 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216850.428793:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46db2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712958208:0@lo:501: 00000100:00100000:2.0:1782216850.428820:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216850.428846:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e50d58900 going to sleep for 11 seconds 00000100:00100000:3.0:1782216850.428889:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712958208 00000100:00100000:3.0:1782216850.428893:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712958208 00000100:00100000:3.0:1782216850.428911:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1782216850.428916:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e582c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:6516:x1868789712958208:12345-0@lo:501: 00000100:00100000:3.0:1782216850.429039:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e582c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:6516:x1868789712958208:12345-0@lo:501: Request processed in 121us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216850.429046:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1782216850.429176:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46db2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712958208:0@lo:501: 00000100:00100000:2.0:1782216850.429324:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46db2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712958336:0@lo:503: 00000100:00100000:2.0:1782216850.429370:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216850.429391:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e50d58900 going to sleep for 11 seconds 00000100:00100000:3.0:1782216850.429437:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712958336 00000100:00100000:3.0:1782216850.429441:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712958336 00000100:00100000:3.0:1782216850.429459:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1782216850.429464:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:6516:x1868789712958336:12345-0@lo:503: 00000100:00100000:3.0:1782216850.429559:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:6516:x1868789712958336:12345-0@lo:503: Request processed in 94us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216850.429565:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1782216850.429818:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46db2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712958336:0@lo:503: 00000100:00100000:2.0:1782216850.430403:0:7934:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46db2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:7934:1868789712958464:0@lo:502: 00000100:00100000:2.0:1782216850.430446:0:7934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216850.430468:0:7934:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e50d58cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782216850.430510:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712958464 00000100:00100000:3.0:1782216850.430515:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712958464 00000100:00100000:3.0:1782216850.430552:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1782216850.430560:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:7934:x1868789712958464:12345-0@lo:502: 00000100:00100000:3.0:1782216850.430846:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:7934:x1868789712958464:12345-0@lo:502: Request processed in 285us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216850.430853:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1782216850.430934:0:7934:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46db2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:7934:1868789712958464:0@lo:502: 00000020:01000000:2.0:1782216850.430956:0:7934:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782216850.430966:0:7934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782216850.430969:0:7934:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1782216850.430973:0:7934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1782216850.430976:0:7934:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:00000080:2.0:1782216850.430996:0:7934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782216850.431011:0:7934:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff952e7397b380) 00000020:00000080:2.0:1782216850.431104:0:7934:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:2.0:1782216850.431121:0:7934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1782216850.432699:0:7934:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1782216850.432707:0:7934:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:2.0:1782216850.432715:0:7934:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x92b8e04cbf5f90a4 00010000:00080000:2.0:1782216850.432743:0:7934:0:(ldlm_lib.c:102:import_set_conn()) imp ffff952e7b2cc800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.130@tcp at head 00010000:00010000:2.0:1782216850.436406:0:7934:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:3.0:1782216850.438787:0:7934:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1782216850.438945:0:7934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1782216850.438991:0:7934:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1782216850.439014:0:7934:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x92b8e04cbf5f90ab 00000100:00080000:3.0:1782216850.439024:0:7934:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782216850.439030:0:7934:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff952e7b2cc800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1782216850.439066:0:7934:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff952e46da4000 x1868789712958592/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782216850.439130:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1868789712958592:0@lo:38: 00000100:00100000:1.0:1782216850.439310:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1782216850.439383:0:7934:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:3.0:1782216850.439442:0:7934:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:2.0:1782216850.439573:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712958592 00000100:00100000:2.0:1782216850.439599:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712958592 00000100:00100000:2.0:1782216850.439642:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782216850.439649:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b09f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1868789712958592:12345-0@lo:38: 00000020:01000000:3.0:1782216850.439650:0:7934:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782216850.439654:0:7934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782216850.439655:0:7934:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1782216850.439658:0:7934:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782216850.439661:0:7934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782216850.439662:0:7934:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:3.0:1782216850.439664:0:7934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1782216850.439666:0:7934:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00010000:00080000:2.0:1782216850.439671:0:6523:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 213 last 0 00000100:00100000:3.0:1782216850.439687:0:7934:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:7934:1868789712958720:0@lo:502: 00000020:00000080:2.0:1782216850.439702:0:6523:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x92b8e04cbf5f90b2 00000004:00100000:2.0:1782216850.439714:0:6523:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1782216850.439727:0:6523:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1782216850.439729:0:7934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216850.439750:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712958720 00000100:00100000:3.0:1782216850.439754:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712958720 00000100:00100000:3.0:1782216850.439782:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1782216850.439788:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:7934:x1868789712958720:12345-0@lo:502: 00000100:00100000:3.0:1782216850.439911:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:7934:x1868789712958720:12345-0@lo:502: Request processed in 122us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216850.439919:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1782216850.439962:0:7934:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e47c56840 going to sleep for 11 seconds 00000100:00100000:3.0:1782216850.439982:0:7934:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:7934:1868789712958720:0@lo:502: 00000020:01000000:3.0:1782216850.440006:0:7934:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782216850.440010:0:7934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782216850.440011:0:7934:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:3.0:1782216850.440014:0:7934:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1782216850.440091:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1782216850.440121:0:6516:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1782216850.440130:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e413fc600/0x92b8e04cbf5f908f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f9096 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216850.440140:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e413fc600/0x92b8e04cbf5f908f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f9096 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782216850.440149:0:6516:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782216850.440152:0:6516:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff952e70905800 from 1 10000000:01000000:2.0:1782216850.440154:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782216850.440175:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e413fde00/0x92b8e04cbf5f90b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1782216850.440176:0:7937:0:(client.c:1831:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff952e46da4a80 x1868789712958976/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216850.440185:0:7937:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e47c560c0 going to sleep for 0 seconds 00010000:00010000:2.0:1782216850.440259:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e413fde00/0x92b8e04cbf5f90b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216850.440269:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e413fde00/0x92b8e04cbf5f90b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216850.440282:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46db2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712958848:0@lo:101: 00000100:00100000:2.0:1782216850.440310:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216850.440328:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e50d58a80 going to sleep for 11 seconds 00000100:00100000:3.0:1782216850.440454:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712958848 00000100:00100000:3.0:1782216850.440459:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712958848 00000100:00100000:3.0:1782216850.440491:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1782216850.440499:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:6516:x1868789712958848:12345-0@lo:101: 00010000:00010000:3.0:1782216850.440508:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782216850.440520:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e7b363e00/0x92b8e04cbf5f90c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f90b9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216850.440538:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e7b363e00/0x92b8e04cbf5f90c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f90b9 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216850.440548:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e7b363e00/0x92b8e04cbf5f90c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f90b9 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216850.440556:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b363e00, rc 0) 00000100:00100000:3.0:1782216850.440605:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:6516:x1868789712958848:12345-0@lo:101: Request processed in 107us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216850.440618:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1782216850.441055:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782216850.441067:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e72e8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1868789712959104:0@lo:400: 00000100:00100000:0.0:1782216850.441102:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216850.441140:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e72e8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789712959232:0@lo:400: 00000100:00100000:2.0:1782216850.441158:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46db2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712958848:0@lo:101: 00000100:00100000:0.0:1782216850.441164:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782216850.441171:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e413fde00/0x92b8e04cbf5f90b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f90c0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216850.441180:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e413fde00/0x92b8e04cbf5f90b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f90c0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216850.441181:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782216850.441186:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e72e8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1868789712959360:0@lo:400: 00000100:00100000:2.0:1782216850.441254:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46db2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712959488:0@lo:501: 00000100:00100000:2.0:1782216850.441278:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216850.441284:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216850.441299:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e50d58a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782216850.441310:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712959488 00000100:00100000:0.0:1782216850.441312:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712959104 00000100:00100000:2.0:1782216850.441314:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712959488 00000100:00100000:0.0:1782216850.441315:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712959104 00000100:00100000:2.0:1782216850.441341:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1782216850.441348:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:6516:x1868789712959488:12345-0@lo:501: 00000100:00100000:2.0:1782216850.441453:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:6516:x1868789712959488:12345-0@lo:501: Request processed in 104us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216850.441459:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1782216850.441487:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46db2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712959488:0@lo:501: 00000100:00100000:2.0:1782216850.441512:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46db2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712959616:0@lo:503: 00000100:00100000:2.0:1782216850.441556:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216850.441569:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e50d58a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782216850.441906:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712959360 00000100:00100000:0.0:1782216850.441910:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712959360 00000100:00100000:0.0:1782216850.441941:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782216850.441948:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72e8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1868789712959104:12345-0@lo:400: 00000100:00100000:0.0:1782216850.441988:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72e8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1868789712959104:12345-0@lo:400: Request processed in 40us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216850.441994:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782216850.442006:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782216850.442013:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72e8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1868789712959360:12345-0@lo:400: 00000100:00100000:0.0:1782216850.442042:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72e8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1868789712959360:12345-0@lo:400: Request processed in 30us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216850.442047:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782216850.442078:0:6524:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1782216850.442083:0:6524:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00010000:00080000:0.0:1782216850.442183:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff952e72e8c000 x1868789712959104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216850.442195:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e72e8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1868789712959104:0@lo:400: 00010000:00080000:0.0:1782216850.442629:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff952e72e8d500 x1868789712959360/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216850.442640:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e72e8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1868789712959360:0@lo:400: 00000100:00100000:3.0:1782216850.442811:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712959232 00000100:00100000:3.0:1782216850.442816:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712959232 00000100:00100000:2.0:1782216850.444155:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712959616 00000100:00100000:2.0:1782216850.444164:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712959616 00000100:00100000:2.0:1782216850.444390:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1782216850.444401:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:6516:x1868789712959616:12345-0@lo:503: 00000100:00100000:3.0:1782216850.444475:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782216850.444483:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72e8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789712959232:12345-0@lo:400: 00000100:00100000:3.0:1782216850.445031:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72e8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789712959232:12345-0@lo:400: Request processed in 547us (3862us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216850.445040:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782216850.445145:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e72e8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789712959232:0@lo:400: 00000100:00100000:2.0:1782216850.445379:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:6516:x1868789712959616:12345-0@lo:503: Request processed in 979us (3821us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216850.445387:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1782216850.445427:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46db2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712959616:0@lo:503: 00000100:00100000:0.0:1782216850.446188:0:7939:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e72e8d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:7939:1868789712959744:0@lo:502: 00000100:00100000:0.0:1782216850.446316:0:7939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216850.446356:0:7939:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e460690c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782216850.447172:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712959744 00000100:00100000:2.0:1782216850.447182:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712959744 00000100:00100000:2.0:1782216850.447767:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1782216850.447778:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:7939:x1868789712959744:12345-0@lo:502: 00000100:00100000:2.0:1782216850.448677:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:7939:x1868789712959744:12345-0@lo:502: Request processed in 899us (2359us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216850.448687:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1782216850.449025:0:7939:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e72e8d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:7939:1868789712959744:0@lo:502: 00000020:01000000:0.0:1782216850.449182:0:7939:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782216850.449191:0:7939:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782216850.449193:0:7939:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1782216850.449199:0:7939:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff952e70905800 00000020:00000080:0.0:1782216850.449202:0:7939:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1782216850.449303:0:7939:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e72e8d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:7939:1868789712959872:0@lo:502: 00000100:00100000:0.0:1782216850.449504:0:7939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216850.449570:0:7939:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e460690c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782216850.449843:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712959872 00000100:00100000:2.0:1782216850.449850:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712959872 00000100:00100000:2.0:1782216850.449935:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1782216850.449944:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:7939:x1868789712959872:12345-0@lo:502: 00000100:00100000:2.0:1782216850.450040:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:7939:x1868789712959872:12345-0@lo:502: Request processed in 97us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216850.450047:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1782216850.450124:0:7939:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e72e8d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:7939:1868789712959872:0@lo:502: 00000020:01000000:3.0:1782216850.450147:0:7939:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782216850.450152:0:7939:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782216850.450154:0:7939:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1782216850.450157:0:7939:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1782216850.450543:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1782216850.450568:0:6516:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782216850.450577:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e413fde00/0x92b8e04cbf5f90b9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f90c0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216850.450681:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e413fde00/0x92b8e04cbf5f90b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f90c0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782216850.450691:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1782216850.450693:0:6516:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff952e5021b380 from 1 10000000:01000000:2.0:1782216850.450696:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1782216850.450723:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e413fd200/0x92b8e04cbf5f90c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216850.450731:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e413fd200/0x92b8e04cbf5f90c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216850.450739:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e413fd200/0x92b8e04cbf5f90c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216850.450765:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46db0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712960000:0@lo:101: 00000100:00100000:2.0:1782216850.451000:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216850.451069:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e54f6a180 going to sleep for 11 seconds 00000100:00100000:0.0:1782216850.451338:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712960000 00000100:00100000:0.0:1782216850.451344:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712960000 00000100:00100000:0.0:1782216850.451564:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1782216850.451574:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:6516:x1868789712960000:12345-0@lo:101: 00010000:00010000:0.0:1782216850.451605:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782216850.451618:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e7c448000/0x92b8e04cbf5f90ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f90c7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216850.451640:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e7c448000/0x92b8e04cbf5f90ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f90c7 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216850.451649:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e7c448000/0x92b8e04cbf5f90ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f90c7 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216850.451657:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7c448000, rc 0) 00000100:00100000:0.0:1782216850.451704:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+18:6516:x1868789712960000:12345-0@lo:101: Request processed in 132us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216850.451710:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1782216850.451781:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46db0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712960000:0@lo:101: 00010000:00010000:2.0:1782216850.451804:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e413fd200/0x92b8e04cbf5f90c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f90ce expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216850.451819:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e413fd200/0x92b8e04cbf5f90c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f90ce expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216850.451881:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46db0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712960128:0@lo:501: 00000100:00100000:2.0:1782216850.451907:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216850.456520:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e54f6a180 going to sleep for 11 seconds 00000100:00080000:2.0:1782216850.456904:0:6523:0:(import.c:65:import_set_state_nolock()) ffff952e7c5cc000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782216850.456983:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b09f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1868789712958592:12345-0@lo:38: Request processed in 17331us (17780us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216850.456993:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782216850.457046:0:3646:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782216850.457055:0:3646:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1782216850.457063:0:3646:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1782216850.457067:0:3646:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1782216850.457070:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952e7b2cc800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1782216850.457085:0:3646:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000007ba10606): req@ffff952e46da4a80 x1868789712958976/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216850.457103:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1868789712958592:0@lo:38: 00000100:00100000:2.0:1782216850.457178:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782216850.457190:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46db3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789712960256:0@lo:41: 00000100:00100000:2.0:1782216850.457235:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216850.457976:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712960128 00000100:00100000:1.0:1782216850.457985:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712960128 00000100:00100000:1.0:1782216850.458027:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1782216850.458036:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+18:6516:x1868789712960128:12345-0@lo:501: 00000100:00100000:1.0:1782216850.458136:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+18:6516:x1868789712960128:12345-0@lo:501: Request processed in 100us (6227us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782216850.458143:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1782216850.458182:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712960256 00000100:00100000:1.0:1782216850.458185:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712960256 00000100:00100000:1.0:1782216850.458229:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782216850.458237:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46db2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1868789712960256:12345-0@lo:41: 00000004:00000024:1.0:1782216850.458258:0:7938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1782216850.458296:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46db2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1868789712960256:12345-0@lo:41: Request processed in 59us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216850.458302:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782216850.458518:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46db3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789712960256:0@lo:41: 00000100:00100000:2.0:1782216850.458549:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46db0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712960128:0@lo:501: 10000000:01000000:2.0:1782216850.458609:0:6516:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1782216850.458620:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e413fd200/0x92b8e04cbf5f90c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f90ce expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216850.458630:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e413fd200/0x92b8e04cbf5f90c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f90ce expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216850.460681:0:7937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216850.460761:0:7937:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e47c560c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782216850.461120:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712958976 00000100:00100000:0.0:1782216850.461127:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712958976 00000100:00100000:0.0:1782216850.461230:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782216850.461251:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46db0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7937:x1868789712958976:12345-0@lo:1000: 00000100:00100000:0.0:1782216850.461347:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46db0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7937:x1868789712958976:12345-0@lo:1000: Request processed in 96us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216850.461354:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782216850.462240:0:7937:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da4a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7937:1868789712958976:0@lo:1000: 00000040:01000000:2.0:1782216850.462277:0:7937:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1782216850.462318:0:7937:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46db3480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7937:1868789712960384:0@lo:1000: 00000100:00100000:2.0:1782216850.462360:0:7937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216850.462391:0:7937:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e51f28180 going to sleep for 11 seconds 00000100:00100000:3.0:1782216850.462605:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712960384 00000100:00100000:3.0:1782216850.462612:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712960384 00000100:00100000:3.0:1782216850.462644:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782216850.462652:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46db2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7937:x1868789712960384:12345-0@lo:1000: 00000100:00100000:3.0:1782216850.462760:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46db2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7937:x1868789712960384:12345-0@lo:1000: Request processed in 109us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216850.462767:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782216850.462971:0:7937:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46db3480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7937:1868789712960384:0@lo:1000: 00000100:00100000:2.0:1782216850.463015:0:7937:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46db3480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7937:1868789712960512:0@lo:700: 00000100:00100000:2.0:1782216850.463042:0:7937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216850.463068:0:7937:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e51f28180 going to sleep for 11 seconds 00000100:00100000:3.0:1782216850.463322:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712960512 00000100:00100000:3.0:1782216850.463327:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712960512 00000100:00100000:3.0:1782216850.463360:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782216850.463367:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46db3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7937:x1868789712960512:12345-0@lo:700: 00000100:00100000:3.0:1782216850.463408:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46db3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7937:x1868789712960512:12345-0@lo:700: Request processed in 41us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216850.463414:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782216850.463624:0:7937:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46db3480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7937:1868789712960512:0@lo:700: 00000100:00100000:2.0:1782216850.463805:0:7937:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46db3480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7937:1868789712960640:0@lo:1000: 00000100:00100000:2.0:1782216850.463846:0:7937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216850.463863:0:7937:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e74bf5600 going to sleep for 11 seconds 00000100:00100000:3.0:1782216850.464090:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712960640 00000100:00100000:3.0:1782216850.464354:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712960640 00000100:00100000:3.0:1782216850.464393:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782216850.464401:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46db1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7937:x1868789712960640:12345-0@lo:1000: 00000100:00100000:3.0:1782216850.464618:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46db1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7937:x1868789712960640:12345-0@lo:1000: Request processed in 217us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216850.464625:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782216850.464718:0:7937:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46db3480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7937:1868789712960640:0@lo:1000: 00000004:00080000:2.0:1782216850.464770:0:7937:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff952e51f28180 with version 0 00000020:00100000:2.0:1782216850.464784:0:7937:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1782216850.464791:0:7937:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff952e46db3480 x1868789712960896/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782216850.465026:0:7937:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46db3480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7937:1868789712960896:0@lo:1000: 00000100:00100000:2.0:1782216850.465059:0:7937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216850.465132:0:7937:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e74bf5600 going to sleep for 11 seconds 00000100:00100000:0.0:1782216850.465379:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712960896 00000100:00100000:0.0:1782216850.465385:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712960896 00000100:00100000:0.0:1782216850.465501:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782216850.465510:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46db0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7937:x1868789712960896:12345-0@lo:1000: 00000001:00080000:2.0:1782216850.470434:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:2.0:1782216850.470447:0:7451:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1782216850.470839:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46db0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7937:x1868789712960896:12345-0@lo:1000: Request processed in 5325us (5774us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1782216850.470852:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:2.0:1782216850.471089:0:7937:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1782216850.471094:0:7937:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1782216850.471118:0:7937:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46db3480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7937:1868789712960896:0@lo:1000: 00000100:00100000:2.0:1782216850.474907:0:7937:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46db3480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7937:1868789712961024:0@lo:1000: 00000100:00100000:2.0:1782216850.474978:0:7937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216850.475374:0:7937:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e74bf5c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782216850.475417:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712961024 00000100:00100000:3.0:1782216850.475424:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712961024 00000100:00100000:3.0:1782216850.475481:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782216850.475491:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46db1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7937:x1868789712961024:12345-0@lo:1000: 00000100:00100000:3.0:1782216850.475746:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46db1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7937:x1868789712961024:12345-0@lo:1000: Request processed in 256us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216850.475755:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782216850.475898:0:7937:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46db3480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7937:1868789712961024:0@lo:1000: 00000040:00080000:2.0:1782216850.475924:0:7937:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1782216850.475964:0:7937:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff952e74bf5600 with version 1 00000004:00080000:1.0:1782216850.476000:0:7935:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff952e50d58cc0 version 1 rpc_version 1 00000020:00100000:1.0:1782216850.476020:0:7935:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1782216850.476027:0:7935:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff952e7b09e680 x1868789712961280/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782216850.476043:0:7935:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b09e680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7935:1868789712961280:0@lo:1000: 00000100:00100000:1.0:1782216850.476088:0:7935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216850.476120:0:7935:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e42c443c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782216850.476280:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712961280 00000100:00100000:0.0:1782216850.476286:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712961280 00000100:00100000:0.0:1782216850.476324:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782216850.476332:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b09ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7935:x1868789712961280:12345-0@lo:1000: 00000040:00080000:2.0:1782216850.478447:0:7937:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1782216850.478527:0:7937:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1782216850.478532:0:7937:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:3.0:1782216850.482165:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:0.0:1782216850.483950:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b09ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7935:x1868789712961280:12345-0@lo:1000: Request processed in 7612us (7854us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1782216850.483963:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:1.0:1782216850.484064:0:7935:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1782216850.484071:0:7935:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1782216850.484087:0:7935:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b09e680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7935:1868789712961280:0@lo:1000: 00010000:00010000:2.0:1782216850.937409:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782216851.512793:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782216851.512817:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b09e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789712961408:0@lo:41: 00000100:00100000:0.0:1782216851.512882:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216851.513014:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712961408 00000100:00100000:3.0:1782216851.513022:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712961408 00000100:00100000:3.0:1782216851.513066:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782216851.513076:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72e8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789712961408:12345-0@lo:41: 00000004:00000024:3.0:1782216851.513120:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1782216851.513174:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72e8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789712961408:12345-0@lo:41: Request processed in 99us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216851.513182:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782216851.513268:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b09e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789712961408:0@lo:41: 00010000:00010000:0.0:1782216851.961721:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216852.984841:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782216854.019795:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216855.038307:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782216855.610185:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789712961536:0@lo:400: 00000100:00100000:3.0:1782216855.610451:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216855.610601:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789712962048:0@lo:400: 00000100:00100000:0.0:1782216855.610626:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712961536 00000100:00100000:0.0:1782216855.610634:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712961536 00000100:00100000:3.0:1782216855.610635:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216855.610666:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782216855.610673:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1868789712961664:0@lo:400: 00000100:00100000:0.0:1782216855.610680:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1782216855.610696:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216855.610696:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52589850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+18:3649:x1868789712961536:12345-0@lo:400: 00000100:00100000:3.0:1782216855.610712:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e72e8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789712962176:0@lo:41: 00000100:00100000:3.0:1782216855.610729:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216855.610743:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52589850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+18:3649:x1868789712961536:12345-0@lo:400: Request processed in 49us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216855.610750:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1782216855.610757:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789712961536:0@lo:400: 00000100:00100000:0.0:1782216855.610780:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712962048 00000100:00100000:3.0:1782216855.610782:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789712961792:0@lo:400: 00000100:00100000:0.0:1782216855.610784:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712962048 00000100:00100000:3.0:1782216855.610803:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216855.610806:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712962176 00000100:00100000:0.0:1782216855.610809:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712962176 00000100:00100000:3.0:1782216855.610816:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782216855.610818:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712961792 00000100:00100000:0.0:1782216855.610819:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712961792 00000100:00100000:0.0:1782216855.610832:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782216855.610837:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1868789712962048:12345-0@lo:400: 00000100:00100000:0.0:1782216855.610881:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1868789712962048:12345-0@lo:400: Request processed in 43us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216855.610887:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782216855.610899:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782216855.610905:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789712962176:12345-0@lo:41: 00000004:00000024:0.0:1782216855.610929:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1782216855.610957:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789712962176:12345-0@lo:41: Request processed in 53us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216855.610963:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782216855.610975:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782216855.610981:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789712961792:12345-0@lo:400: 00000100:00100000:0.0:1782216855.611005:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789712961792:12345-0@lo:400: Request processed in 25us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216855.611010:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782216855.612693:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1868789712961920:0@lo:400: 00000100:00100000:3.0:1782216855.612758:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216855.612811:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789712961792:0@lo:400: 00000100:00100000:3.0:1782216855.614603:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712961664 00000100:00100000:3.0:1782216855.614615:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712961664 00000100:00100000:3.0:1782216855.614666:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712961920 00000100:00100000:3.0:1782216855.614670:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712961920 00000100:00100000:3.0:1782216855.614692:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782216855.614701:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1868789712961664:12345-0@lo:400: 00000100:00100000:0.0:1782216855.615785:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782216855.615810:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1868789712961920:12345-0@lo:400: 00000100:00100000:0.0:1782216855.619570:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1868789712961920:12345-0@lo:400: Request processed in 3753us (6800us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216855.619601:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782216855.619661:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1868789712961664:12345-0@lo:400: Request processed in 4959us (8961us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216855.619669:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1782216855.619730:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff952e46da6300 x1868789712961920/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216855.619747:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1868789712961920:0@lo:400: 00010000:00080000:3.0:1782216855.619787:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff952e46da5880 x1868789712961664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216855.619810:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1868789712961664:0@lo:400: 00000100:00100000:3.0:1782216855.619914:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e72e8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789712962176:0@lo:41: 00000100:00100000:3.0:1782216855.619926:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789712962048:0@lo:400: 00010000:00010000:2.0:1782216856.056884:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782216856.633622:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46db3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789712962304:0@lo:41: 00000100:00100000:0.0:1782216856.633694:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216856.633874:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712962304 00000100:00100000:2.0:1782216856.633881:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712962304 00000100:00100000:2.0:1782216856.635186:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1782216856.635201:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72e8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789712962304:12345-0@lo:41: 00000004:00000024:2.0:1782216856.635241:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1782216856.635314:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72e8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789712962304:12345-0@lo:41: Request processed in 117us (1619us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216856.635321:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782216856.635517:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46db3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789712962304:0@lo:41: 00010000:00010000:1.0:1782216857.080830:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216858.104780:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1782216858.431284:0:8426:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:0.0:1782216858.431288:0:8426:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1782216858.431289:0:8426:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1782216858.431426:0:8426:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff952e74b5e800 00000020:01000004:0.0:1782216858.431441:0:8426:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1782216858.431452:0:8426:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1782216858.431473:0:8426:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff952e74c84d40) 00000020:00000080:0.0:1782216858.431490:0:8426:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1782216858.489693:0:8426:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1782216858.489745:0:8426:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:0.0:1782216858.505420:0:8426:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1782216858.505872:0:8426:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1782216858.505885:0:8426:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1782216858.505895:0:8426:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x92b8e04cbf5f90dc 00000020:01000004:0.0:1782216858.505901:0:8426:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1782216858.505921:0:8426:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.130@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1782216858.505924:0:8426:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1782216858.505930:0:8426:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1782216858.505934:0:8426:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1782216858.505945:0:8426:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff952e74c83380) 00000020:00000080:0.0:1782216858.505956:0:8426:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:0.0:1782216858.508830:0:8426:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782216858.508997:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1782216858.509003:0:8426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1782216858.515407:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1782216858.515422:0:8426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1782216858.518502:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1782216858.518518:0:8426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1782216858.522754:0:8426:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782216858.522936:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1782216858.522942:0:8426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1782216858.524949:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1782216858.524960:0:8426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1782216858.560379:0:8426:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782216858.560724:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1782216858.560732:0:8426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1782216858.562086:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1782216858.562095:0:8426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1782216858.563847:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1782216858.563860:0:8426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1782216858.566690:0:8426:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782216858.566879:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1782216858.566887:0:8426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1782216858.568311:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1782216858.568320:0:8426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1782216858.608819:0:8426:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782216858.608997:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1782216858.609003:0:8426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1782216858.610274:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1782216858.610290:0:8426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1782216858.610805:0:8426:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1782216858.610843:0:8426:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1782216858.610850:0:8426:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.130@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1782216858.624146:0:8426:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.130@tcp ctxt 0 is initialized 00000020:01000004:1.0:1782216858.624183:0:8426:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.130@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1782216858.624187:0:8426:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1782216858.624189:0:8426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1782216858.624190:0:8426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782216858.624191:0:8426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782216858.624192:0:8426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782216858.624194:0:8426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782216858.624195:0:8426:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782216858.624196:0:8426:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782216858.624198:0:8426:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782216858.624199:0:8426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782216858.624201:0:8426:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1782216858.624204:0:8426:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1782216858.624206:0:8426:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1782216858.624208:0:8426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1782216858.624209:0:8426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782216858.624210:0:8426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782216858.624211:0:8426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782216858.624212:0:8426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782216858.624213:0:8426:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782216858.624213:0:8426:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782216858.624214:0:8426:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782216858.624215:0:8426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782216858.624221:0:8426:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1782216858.624246:0:8426:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1782216858.624264:0:8426:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b09c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:8426:1868789712962432:0@lo:253: 00000100:00100000:1.0:1782216858.624330:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216858.624399:0:8426:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e460e8000 going to sleep for 11 seconds 00000100:00100000:3.0:1782216858.625308:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712962432 00000100:00100000:3.0:1782216858.625318:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712962432 00000100:00100000:3.0:1782216858.625821:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1782216858.625833:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52588c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+18:8426:x1868789712962432:12345-0@lo:253: 20000000:01000000:3.0:1782216858.625886:0:6513:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1782216858.625890:0:6513:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1782216858.625895:0:6513:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1782216858.625898:0:6513:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1782216858.626136:0:6513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782216858.626303:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1782216858.626318:0:6513:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1782216858.626335:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1782216858.626342:0:6513:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1782216858.626925:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1782216858.626950:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1782216858.627037:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1782216858.627065:0:6513:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.203.130@tcp 20000000:01000000:3.0:1782216858.627067:0:6513:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.130@tcp (null) (null) (null) 00000040:00080000:3.0:1782216858.627099:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1782216858.627107:0:6513:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1782216858.627121:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1782216858.627127:0:6513:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.130@tcp (null) (null) 00000040:00080000:3.0:1782216858.627138:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1782216858.627144:0:6513:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1782216858.627156:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1782216858.627170:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1782216858.627235:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:3.0:1782216858.627246:0:6513:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.203.130@tcp 20000000:01000000:3.0:1782216858.627247:0:6513:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.130@tcp (null) (null) (null) 00000040:00080000:3.0:1782216858.627261:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:3.0:1782216858.627267:0:6513:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1782216858.627280:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:3.0:1782216858.627286:0:6513:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.130@tcp (null) (null) 00000040:00080000:3.0:1782216858.627298:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:3.0:1782216858.627303:0:6513:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1782216858.627314:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:3.0:1782216858.627327:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:3.0:1782216858.627759:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:3.0:1782216858.627772:0:6513:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.203.130@tcp 20000000:01000000:3.0:1782216858.627773:0:6513:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.130@tcp (null) (null) (null) 00000040:00080000:3.0:1782216858.627796:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:3.0:1782216858.627803:0:6513:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1782216858.627815:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:3.0:1782216858.627831:0:6513:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.130@tcp (null) (null) 00000040:00080000:3.0:1782216858.627843:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:3.0:1782216858.627846:0:6513:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1782216858.627853:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:3.0:1782216858.627874:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:3.0:1782216858.627886:0:6513:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1782216858.627889:0:6513:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1782216858.627892:0:6513:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1782216858.627934:0:6513:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1782216858.627936:0:6513:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1782216858.632547:0:8445:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:1.0:1782216858.632777:0:8445:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:1.0:1782216858.632799:0:8445:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1782216858.633084:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1782216858.633104:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1782216858.633115:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1782216858.633123:0:6513:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1782216858.633125:0:6513:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1782216858.633880:0:8446:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 27 marker 19 1->4: lustre sys.timeout 20000000:01000000:1.0:1782216858.633907:0:8446:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 29 marker 19 2->4: lustre sys.timeout 00000040:00080000:1.0:1782216858.633922:0:8446:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1782216858.634086:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:3.0:1782216858.634105:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:3.0:1782216858.634119:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:3.0:1782216858.634129:0:6513:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1782216858.634131:0:6513:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1782216858.634831:0:8447:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1782216858.635035:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1782216858.635068:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1782216858.635084:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1782216858.635092:0:6513:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1782216858.635094:0:6513:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1782216858.635414:0:8448:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:1.0:1782216858.635439:0:8448:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:1.0:1782216858.635455:0:8448:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:3.0:1782216858.635880:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:3.0:1782216858.635901:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:3.0:1782216858.635917:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 10000000:01000000:3.0:1782216858.635932:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1782216858.635949:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff952e7b363600/0x92b8e04cbf5f90ea lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.636033:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952e413fc400/0x92b8e04cbf5f8fb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f8faf expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.636042:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952e41681e00/0x92b8e04cbf5f902d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9026 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.636048:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952e7c448600/0x92b8e04cbf5f907a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9073 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.636062:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952e7b363800/0x92b8e04cbf5f9096 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f908f expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.636069:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952e7c448000/0x92b8e04cbf5f90ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f90c7 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.636076:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff952e7b363600/0x92b8e04cbf5f90ea lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.636113:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952e7c448000/0x92b8e04cbf5f90ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5f90c7 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.636128:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff952e7c448000/0x92b8e04cbf5f90ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5f90c7 expref: 18 pid: 6511 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216858.636143:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da7800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1868789712962560:0@lo:104: 00000100:00100000:3.0:1782216858.636217:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782216858.636306:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952e7b363800/0x92b8e04cbf5f9096 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5f908f expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.636314:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff952e7b363800/0x92b8e04cbf5f9096 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5f908f expref: 18 pid: 6514 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216858.636330:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da6300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1868789712962688:0@lo:104: 00000100:00100000:3.0:1782216858.636361:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782216858.636499:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952e7c448600/0x92b8e04cbf5f907a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5f9073 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.636508:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff952e7c448600/0x92b8e04cbf5f907a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9073 expref: 18 pid: 6513 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216858.636515:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da7100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1868789712962816:0@lo:104: 00000100:00100000:3.0:1782216858.636537:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216858.636752:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712962560 00000100:00100000:2.0:1782216858.636759:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712962560 00000100:00100000:2.0:1782216858.636796:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712962688 00000100:00100000:2.0:1782216858.636799:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712962688 00000100:00100000:2.0:1782216858.636814:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782216858.636822:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+4:6513:x1868789712962560:12345-0@lo:104: 00010000:00010000:2.0:1782216858.636834:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff952e413fd200/0x92b8e04cbf5f90c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f90ce expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216858.636882:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782216858.636888:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+4:6513:x1868789712962560:12345-0@lo:104: Request processed in 67us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216858.636903:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782216858.636920:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782216858.636925:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+3:6513:x1868789712962688:12345-0@lo:104: 00010000:00010000:2.0:1782216858.636932:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff952e413fc600/0x92b8e04cbf5f908f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f9096 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216858.636962:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1782216858.636966:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+3:6513:x1868789712962688:12345-0@lo:104: Request processed in 42us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216858.636980:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:2.0:1782216858.636995:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782216858.637001:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e413fd200/0x92b8e04cbf5f90c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f90ce expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216858.637008:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e413fd200 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:2.0:1782216858.637023:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e413fd200/0x92b8e04cbf5f90c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5f90ce expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216858.637031:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e413fd200/0x92b8e04cbf5f90c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5f90ce expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782216858.637039:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e413fd200/0x92b8e04cbf5f90c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5f90ce expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782216858.637044:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782216858.637078:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e413fd200/0x92b8e04cbf5f90c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f90ce expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216858.637085:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782216858.637109:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e413fd200/0x92b8e04cbf5f90c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f90ce expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216858.637116:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e413fd200/0x92b8e04cbf5f90c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f90ce expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216858.637128:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782216858.637131:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e413fc600/0x92b8e04cbf5f908f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f9096 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216858.637136:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e413fc600 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:2.0:1782216858.637139:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e413fc600/0x92b8e04cbf5f908f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5f9096 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216858.637145:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e413fc600/0x92b8e04cbf5f908f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5f9096 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782216858.637151:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e413fc600/0x92b8e04cbf5f908f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5f9096 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782216858.637157:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782216858.637170:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e413fc600/0x92b8e04cbf5f908f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f9096 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216858.637176:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782216858.637189:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e413fc600/0x92b8e04cbf5f908f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f9096 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216858.637195:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e413fc600/0x92b8e04cbf5f908f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f9096 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216858.637204:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216858.637211:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216858.637212:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216858.637231:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17bce19a-7a0f-4c9d-b31c-4e0155298487:3648:1868789712962944:0@lo:103: 00000100:00100000:2.0:1782216858.637273:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216858.637310:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789712963072:0@lo:103: 00000100:00100000:2.0:1782216858.637331:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782216858.637433:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216858.637960:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712962944 00000100:00100000:2.0:1782216858.637966:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712962944 00010000:00010000:2.0:1782216858.638043:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952e7c448000/0x92b8e04cbf5f90ce lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f90c7 expref: 19 pid: 6511 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216858.638108:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712963072 00000100:00100000:2.0:1782216858.638111:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712963072 00010000:00010000:2.0:1782216858.638123:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952e7b363800/0x92b8e04cbf5f9096 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f908f expref: 20 pid: 6514 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.638579:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952e41681e00/0x92b8e04cbf5f902d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5f9026 expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.638612:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff952e41681e00/0x92b8e04cbf5f902d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9026 expref: 20 pid: 6513 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216858.638623:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da4a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1868789712963200:0@lo:104: 00000100:00100000:3.0:1782216858.638659:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782216858.638692:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952e413fc400/0x92b8e04cbf5f8fb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5f8faf expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.638700:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff952e413fc400/0x92b8e04cbf5f8fb6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5f8faf expref: 20 pid: 6511 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216858.638709:0:6513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be4000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1868789712963328:0@lo:104: 00000100:00100000:3.0:1782216858.638728:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216858.638737:0:6513:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e7c7d1600 going to sleep for 11 seconds 00000100:00100000:3.0:1782216858.638756:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da7800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1868789712962560:0@lo:104: 00000100:00100000:3.0:1782216858.638773:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da6300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1868789712962688:0@lo:104: 00000100:00100000:1.0:1782216858.638916:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782216858.638928:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46db0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+20:3648:x1868789712962944:12345-0@lo:103: 00010000:00010000:1.0:1782216858.638943:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782216858.638950:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952e7c448000/0x92b8e04cbf5f90ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f90c7 expref: 20 pid: 6511 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216858.638960:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952e7c448000/0x92b8e04cbf5f90ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5f90c7 expref: 20 pid: 6511 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216858.639083:0:6505:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1782216858.639091:0:6505:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1782216858.639128:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e7c448000/0x92b8e04cbf5f90ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5f90c7 expref: 20 pid: 6511 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216858.639142:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782216858.639185:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46db0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+19:3648:x1868789712962944:12345-0@lo:103: Request processed in 260us (1912us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216858.639201:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782216858.639220:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782216858.639226:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46db3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+18:3649:x1868789712963072:12345-0@lo:103: 00010000:00010000:1.0:1782216858.639234:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782216858.639239:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952e7b363800/0x92b8e04cbf5f9096 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f908f expref: 18 pid: 6514 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216858.639248:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952e7b363800/0x92b8e04cbf5f9096 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5f908f expref: 18 pid: 6514 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216858.639259:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e7b363800/0x92b8e04cbf5f9096 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5f908f expref: 18 pid: 6514 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216858.639267:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782216858.639293:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46db3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:3649:x1868789712963072:12345-0@lo:103: Request processed in 67us (1961us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216858.639300:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782216858.639370:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17bce19a-7a0f-4c9d-b31c-4e0155298487:3648:1868789712962944:0@lo:103: 00000100:00100000:2.0:1782216858.639514:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789712963072:0@lo:103: 00000100:00100000:2.0:1782216858.639534:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712962816 00000100:00100000:2.0:1782216858.639539:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712962816 00000100:00100000:2.0:1782216858.639560:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712963200 00000100:00100000:2.0:1782216858.639563:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712963200 00000100:00100000:2.0:1782216858.639574:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712963328 00000100:00100000:2.0:1782216858.639577:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712963328 00000100:00100000:2.0:1782216858.639675:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782216858.639682:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+5:6513:x1868789712962816:12345-0@lo:104: 00010000:00010000:2.0:1782216858.639693:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff952e41681600/0x92b8e04cbf5f9073 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f907a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216858.639742:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782216858.639748:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+5:6513:x1868789712962816:12345-0@lo:104: Request processed in 66us (3210us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216858.639760:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782216858.639772:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782216858.639779:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+4:6513:x1868789712963200:12345-0@lo:104: 00010000:00010000:2.0:1782216858.639786:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff952e7b362600/0x92b8e04cbf5f9026 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f902d expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216858.639822:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1782216858.639827:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+4:6513:x1868789712963200:12345-0@lo:104: Request processed in 50us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216858.639833:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782216858.639843:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782216858.639848:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+3:6513:x1868789712963328:12345-0@lo:104: 00010000:00010000:2.0:1782216858.639854:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff952e41681400/0x92b8e04cbf5f8faf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f8fb6 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216858.639877:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1782216858.639881:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+3:6513:x1868789712963328:12345-0@lo:104: Request processed in 34us (1153us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216858.639886:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1782216858.639901:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1782216858.639906:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e41681600/0x92b8e04cbf5f9073 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f907a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216858.639912:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e41681600 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:2.0:1782216858.639916:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e41681600/0x92b8e04cbf5f9073 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5f907a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216858.639934:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e41681600/0x92b8e04cbf5f9073 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5f907a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782216858.639940:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e41681600/0x92b8e04cbf5f9073 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5f907a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782216858.639945:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782216858.639970:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e41681600/0x92b8e04cbf5f9073 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f907a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216858.640087:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da7100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1868789712962816:0@lo:104: 00000100:00100000:3.0:1782216858.640096:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da4a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1868789712963200:0@lo:104: 00000100:00100000:3.0:1782216858.640103:0:6513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be4000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1868789712963328:0@lo:104: 00010000:00010000:3.0:1782216858.640127:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff952e7b363600/0x92b8e04cbf5f90ea lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216858.640171:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782216858.640194:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e41681600/0x92b8e04cbf5f9073 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f907a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216858.640201:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e41681600/0x92b8e04cbf5f9073 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f907a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216858.640212:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782216858.640215:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e7b362600/0x92b8e04cbf5f9026 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f902d expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216858.640221:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362600 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:2.0:1782216858.640223:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e7b362600/0x92b8e04cbf5f9026 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5f902d expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216858.640229:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e7b362600/0x92b8e04cbf5f9026 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5f902d expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782216858.640235:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e7b362600/0x92b8e04cbf5f9026 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5f902d expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782216858.640246:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782216858.640260:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e7b362600/0x92b8e04cbf5f9026 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f902d expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216858.640266:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782216858.640278:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e7b362600/0x92b8e04cbf5f9026 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f902d expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216858.640285:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e7b362600/0x92b8e04cbf5f9026 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f902d expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216858.640294:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782216858.640296:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e41681400/0x92b8e04cbf5f8faf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f8fb6 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216858.640301:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e41681400 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:2.0:1782216858.640304:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e41681400/0x92b8e04cbf5f8faf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5f8fb6 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216858.640309:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e41681400/0x92b8e04cbf5f8faf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5f8fb6 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782216858.640315:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e41681400/0x92b8e04cbf5f8faf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5f8fb6 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782216858.640319:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782216858.640343:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e41681400/0x92b8e04cbf5f8faf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f8fb6 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216858.640487:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17bce19a-7a0f-4c9d-b31c-4e0155298487:3650:1868789712963456:0@lo:103: 00000100:00100000:3.0:1782216858.640522:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216858.640694:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712963456 00000100:00100000:1.0:1782216858.640699:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712963456 00010000:00010000:1.0:1782216858.640719:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952e7c448600/0x92b8e04cbf5f907a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9073 expref: 17 pid: 6513 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216858.640742:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782216858.640749:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:3650:x1868789712963456:12345-0@lo:103: 00010000:00010000:1.0:1782216858.640758:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782216858.640764:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952e7c448600/0x92b8e04cbf5f907a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9073 expref: 17 pid: 6513 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216858.640773:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952e7c448600/0x92b8e04cbf5f907a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9073 expref: 17 pid: 6513 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216858.640793:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e7c448600/0x92b8e04cbf5f907a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5f9073 expref: 17 pid: 6513 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216858.640803:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782216858.640834:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:3650:x1868789712963456:12345-0@lo:103: Request processed in 85us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216858.640840:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782216858.640903:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17bce19a-7a0f-4c9d-b31c-4e0155298487:3650:1868789712963456:0@lo:103: 00010000:00010000:2.0:1782216858.641104:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782216858.641119:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e41681400/0x92b8e04cbf5f8faf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f8fb6 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216858.641126:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e41681400/0x92b8e04cbf5f8faf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f8fb6 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216858.641140:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216858.641142:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216858.641143:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216858.641154:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789712963584:0@lo:103: 00000100:00100000:2.0:1782216858.641179:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216858.641209:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782216858.641215:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41bfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789712963712:0@lo:103: 00000100:00100000:2.0:1782216858.641236:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782216858.641272:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782216858.641437:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712963584 00000100:00100000:1.0:1782216858.641441:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712963584 00010000:00010000:1.0:1782216858.641457:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952e41681e00/0x92b8e04cbf5f902d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9026 expref: 16 pid: 6513 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216858.641470:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712963712 00000100:00100000:1.0:1782216858.641472:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712963712 00010000:00010000:1.0:1782216858.641482:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952e413fc400/0x92b8e04cbf5f8fb6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f8faf expref: 17 pid: 6511 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216858.641493:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782216858.641499:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:3647:x1868789712963584:12345-0@lo:103: 00010000:00010000:1.0:1782216858.641506:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782216858.641510:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952e41681e00/0x92b8e04cbf5f902d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9026 expref: 17 pid: 6513 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216858.641519:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952e41681e00/0x92b8e04cbf5f902d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9026 expref: 17 pid: 6513 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216858.641529:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e41681e00/0x92b8e04cbf5f902d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5f9026 expref: 17 pid: 6513 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216858.641549:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782216858.641691:0:6504:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1782216858.641702:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782216858.641710:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e6f92fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:3647:x1868789712963712:12345-0@lo:103: 00010000:00010000:3.0:1782216858.641717:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782216858.641722:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952e413fc400/0x92b8e04cbf5f8fb6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f8faf expref: 16 pid: 6511 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.641730:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952e413fc400/0x92b8e04cbf5f8fb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5f8faf expref: 16 pid: 6511 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.641740:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e413fc400/0x92b8e04cbf5f8fb6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5f8faf expref: 16 pid: 6511 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.641751:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff952e7b363600/0x92b8e04cbf5f90ea lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.641764:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e7b363600/0x92b8e04cbf5f90ea lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.641777:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff952e7b363600/0x92b8e04cbf5f90ea lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.641783:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff952e7b363600/0x92b8e04cbf5f90ea lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.641789:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff952e7b363600/0x92b8e04cbf5f90ea lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.641794:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff952e7b363600/0x92b8e04cbf5f90ea lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.641798:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b363600 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:3.0:1782216858.641802:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff952e7b363600/0x92b8e04cbf5f90ea lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.641809:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff952e7b363600/0x92b8e04cbf5f90ea lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.641823:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff952e7b363600/0x92b8e04cbf5f90ea lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.641831:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782216858.641857:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e6f92fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:3647:x1868789712963712:12345-0@lo:103: Request processed in 148us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216858.641864:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1782216858.641885:0:6513:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff952e7b363600/0x92b8e04cbf5f90ea lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.641898:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff952e7b363600/0x92b8e04cbf5f90ea lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.641904:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e7b363600/0x92b8e04cbf5f90ea lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1782216858.641917:0:6513:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1782216858.643018:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17bce19a-7a0f-4c9d-b31c-4e0155298487+14:3647:x1868789712963584:12345-0@lo:103: Request processed in 1514us (1833us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216858.643028:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782216858.643268:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41bfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789712963712:0@lo:103: 00000100:00100000:0.0:1782216858.643280:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46db3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789712963584:0@lo:103: 00000100:00100000:0.0:1782216858.645383:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52588c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+13:8426:x1868789712962432:12345-0@lo:253: Request processed in 19538us (21036us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216858.645396:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1782216858.646009:0:8426:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b09c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:8426:1868789712962432:0@lo:253: 10000000:01000000:1.0:1782216858.646024:0:8426:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1782216858.646028:0:8426:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1782216858.646030:0:8426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1782216858.646031:0:8426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782216858.646033:0:8426:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1782216858.646034:0:8426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782216858.646035:0:8426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782216858.646037:0:8426:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782216858.646039:0:8426:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1782216858.646040:0:8426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782216858.646042:0:8426:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1782216858.646071:0:8426:0:(tgt_mount.c:101:server_register_mount()) register mount ffff952e74b5e800 from lustre-OST0000 10000000:01000000:1.0:1782216858.646103:0:8426:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1782216858.646106:0:8426:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1782216858.646114:0:8426:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff952e5021b380 local copy 10000000:01000000:1.0:1782216858.646118:0:8426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1782216858.646261:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e41680e00/0x92b8e04cbf5f90f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216858.646271:0:8426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.130@tcp lock: ffff952e41680e00/0x92b8e04cbf5f90f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216858.646280:0:8426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e41680e00/0x92b8e04cbf5f90f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216858.646297:0:8426:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b09c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:8426:1868789712963840:0@lo:101: 00000100:00100000:1.0:1782216858.646349:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216858.646469:0:8426:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e45c70780 going to sleep for 11 seconds 00000100:00100000:0.0:1782216858.646505:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712963840 00000100:00100000:0.0:1782216858.646512:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712963840 00000100:00100000:0.0:1782216858.646599:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1782216858.646609:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52589450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+13:8426:x1868789712963840:12345-0@lo:101: 00010000:00010000:0.0:1782216858.646622:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782216858.646635:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e7c448800/0x92b8e04cbf5f90f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f90f1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216858.646657:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e7c448800/0x92b8e04cbf5f90f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f90f1 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216858.646667:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e7c448800/0x92b8e04cbf5f90f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f90f1 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216858.646675:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7c448800, rc 0) 00000100:00100000:0.0:1782216858.646755:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52589450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+14:8426:x1868789712963840:12345-0@lo:101: Request processed in 147us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216858.646762:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1782216858.647070:0:8426:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b09c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:8426:1868789712963840:0@lo:101: 00010000:00010000:3.0:1782216858.647083:0:8426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e41680e00/0x92b8e04cbf5f90f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x92b8e04cbf5f90f8 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.647092:0:8426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e41680e00/0x92b8e04cbf5f90f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x92b8e04cbf5f90f8 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216858.647250:0:8426:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:8426:1868789712963968:0@lo:501: 00000100:00100000:3.0:1782216858.647280:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216858.647343:0:8426:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e7c7d1600 going to sleep for 11 seconds 00000100:00100000:0.0:1782216858.647502:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712963968 00000100:00100000:0.0:1782216858.647508:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712963968 00000100:00100000:0.0:1782216858.647573:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1782216858.647642:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52589050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+14:8426:x1868789712963968:12345-0@lo:501: 00000100:00100000:0.0:1782216858.647757:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52589050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+14:8426:x1868789712963968:12345-0@lo:501: Request processed in 175us (475us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782216858.647764:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1782216858.647979:0:8426:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:8426:1868789712963968:0@lo:501: 10000000:01000000:3.0:1782216858.647993:0:8426:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1782216858.648011:0:8426:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1782216858.648016:0:8426:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e41680e00/0x92b8e04cbf5f90f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x92b8e04cbf5f90f8 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.648025:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e41680e00/0x92b8e04cbf5f90f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x92b8e04cbf5f90f8 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.648032:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff952e41680e00/0x92b8e04cbf5f90f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x92b8e04cbf5f90f8 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.648065:0:8426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1782216858.648089:0:8426:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff952e74b5e800 10000000:01000000:3.0:1782216858.648094:0:8426:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1782216858.648099:0:8426:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1782216858.648102:0:8426:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782216858.648105:0:8426:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1782216858.648108:0:8426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1782216858.648135:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7b363a00/0x92b8e04cbf5f90ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.648143:0:8426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e7b363a00/0x92b8e04cbf5f90ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.648151:0:8426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e7b363a00/0x92b8e04cbf5f90ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216858.648163:0:8426:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:8426:1868789712964096:0@lo:101: 00000100:00100000:3.0:1782216858.648190:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216858.648214:0:8426:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e7c7d1a80 going to sleep for 11 seconds 00010000:00010000:2.0:1782216858.648327:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782216858.648334:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e41680e00/0x92b8e04cbf5f90f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x92b8e04cbf5f90f8 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216858.648342:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e41680e00 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:2.0:1782216858.648345:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e41680e00/0x92b8e04cbf5f90f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x92b8e04cbf5f90f8 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216858.648353:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e41680e00/0x92b8e04cbf5f90f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x92b8e04cbf5f90f8 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782216858.648442:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e41680e00/0x92b8e04cbf5f90f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x92b8e04cbf5f90f8 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782216858.648450:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782216858.648476:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e41680e00/0x92b8e04cbf5f90f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x92b8e04cbf5f90f8 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216858.648483:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782216858.648509:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e41680e00/0x92b8e04cbf5f90f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x92b8e04cbf5f90f8 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216858.648516:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e41680e00/0x92b8e04cbf5f90f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x92b8e04cbf5f90f8 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216858.648529:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216858.648531:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216858.648532:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216858.648539:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782216858.648549:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41bfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17bce19a-7a0f-4c9d-b31c-4e0155298487:3650:1868789712964224:0@lo:103: 00000100:00100000:2.0:1782216858.648579:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216858.648645:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712964224 00000100:00100000:2.0:1782216858.648650:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712964224 00000100:00100000:2.0:1782216858.648690:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782216858.648697:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bf9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+14:3650:x1868789712964224:12345-0@lo:103: 00010000:00010000:2.0:1782216858.648708:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782216858.648720:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e7c448800/0x92b8e04cbf5f90f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x92b8e04cbf5f90f1 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216858.648733:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782216858.648762:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bf9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+13:3650:x1868789712964224:12345-0@lo:103: Request processed in 64us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216858.648767:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782216858.648793:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41bfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17bce19a-7a0f-4c9d-b31c-4e0155298487:3650:1868789712964224:0@lo:103: 00000100:00100000:0.0:1782216858.649029:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712964096 00000100:00100000:0.0:1782216858.649034:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712964096 00000100:00100000:0.0:1782216858.649106:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1782216858.649114:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+13:8426:x1868789712964096:12345-0@lo:101: 00010000:00010000:0.0:1782216858.649133:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782216858.649144:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e7c448c00/0x92b8e04cbf5f9106 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f90ff expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216858.649161:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e7c448c00/0x92b8e04cbf5f9106 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f90ff expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216858.649171:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e7c448c00/0x92b8e04cbf5f9106 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f90ff expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216858.649178:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7c448c00, rc 0) 00000100:00100000:0.0:1782216858.649219:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+14:8426:x1868789712964096:12345-0@lo:101: Request processed in 106us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216858.649224:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1782216858.649286:0:8426:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:8426:1868789712964096:0@lo:101: 00010000:00010000:3.0:1782216858.649299:0:8426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e7b363a00/0x92b8e04cbf5f90ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f9106 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.649307:0:8426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e7b363a00/0x92b8e04cbf5f90ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f9106 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216858.649391:0:8426:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:8426:1868789712964352:0@lo:501: 00000100:00100000:3.0:1782216858.649430:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216858.649790:0:8426:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e7c7d1a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782216858.649937:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712964352 00000100:00100000:2.0:1782216858.649948:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712964352 00000100:00100000:2.0:1782216858.649972:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1782216858.649979:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+14:8426:x1868789712964352:12345-0@lo:501: 00000100:00100000:2.0:1782216858.650093:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+14:8426:x1868789712964352:12345-0@lo:501: Request processed in 114us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216858.650099:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1782216858.650213:0:8426:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:8426:1868789712964352:0@lo:501: 00000100:00100000:3.0:1782216858.650242:0:8426:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:8426:1868789712964480:0@lo:503: 00000100:00100000:3.0:1782216858.650280:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216858.650293:0:8426:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e7c7d1a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782216858.650337:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712964480 00000100:00100000:2.0:1782216858.650341:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712964480 00000100:00100000:2.0:1782216858.650358:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1782216858.650363:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+14:8426:x1868789712964480:12345-0@lo:503: 00000100:00100000:2.0:1782216858.650461:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+14:8426:x1868789712964480:12345-0@lo:503: Request processed in 96us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216858.650467:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1782216858.650606:0:8426:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:8426:1868789712964480:0@lo:503: 00000040:00080000:3.0:1782216858.650833:0:8426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782216858.650906:0:8426:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:8426:1868789712964608:0@lo:502: 00000100:00100000:3.0:1782216858.650943:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216858.650959:0:8426:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e7c7d1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1782216858.651119:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712964608 00000100:00100000:1.0:1782216858.651132:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712964608 00000100:00100000:1.0:1782216858.651156:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1782216858.651164:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52588050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+14:8426:x1868789712964608:12345-0@lo:502: 00000100:00100000:1.0:1782216858.651243:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52588050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+14:8426:x1868789712964608:12345-0@lo:502: Request processed in 79us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216858.651249:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1782216858.651502:0:8426:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:8426:1868789712964608:0@lo:502: 00000040:00080000:3.0:1782216858.651735:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1782216858.651761:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1782216858.651775:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1782216858.651787:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1782216858.651799:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1782216858.651810:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1782216858.651830:0:8426:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:8426:1868789712964736:0@lo:502: 00000100:00100000:3.0:1782216858.651971:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216858.652003:0:8426:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e7c7d1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1782216858.652072:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712964736 00000100:00100000:1.0:1782216858.652077:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712964736 00000100:00100000:1.0:1782216858.652105:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1782216858.652114:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52588850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+14:8426:x1868789712964736:12345-0@lo:502: 00000100:00100000:1.0:1782216858.652205:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52588850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+14:8426:x1868789712964736:12345-0@lo:502: Request processed in 91us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216858.652211:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1782216858.652341:0:8426:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:8426:1868789712964736:0@lo:502: 00000040:00080000:3.0:1782216858.652389:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1782216858.652397:0:8426:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1782216858.653072:0:8450:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1782216858.653080:0:8450:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1782216858.653093:0:8450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782216858.653095:0:8450:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1782216858.653101:0:8450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782216858.653115:0:8450:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff952e50218000) 00000020:00000080:3.0:1782216858.653201:0:8450:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:3.0:1782216858.653210:0:8450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1782216858.653271:0:8450:0:(tgt_mount.c:153:server_get_mount()) get mount ffff952e74b5e800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1782216858.653278:0:8450:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1782216858.653285:0:8450:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x92b8e04cbf5f9114 00010000:00010000:3.0:1782216858.658290:0:8450:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:3.0:1782216858.662770:0:8450:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1782216858.666648:0:8450:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1782216858.667763:0:8450:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1782216858.682288:0:8450:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1782216858.683985:0:8450:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1782216858.700838:0:8450:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1782216858.708710:0:8450:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1782216858.708722:0:8450:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782216858.708729:0:8450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782216858.708732:0:8450:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1782216858.708735:0:8450:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782216858.708740:0:8450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782216858.708741:0:8450:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:1.0:1782216858.708745:0:8450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1782216858.708747:0:8450:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1782216858.708775:0:8450:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782216858.708779:0:8450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782216858.708780:0:8450:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:1.0:1782216858.708783:0:8450:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1782216858.709973:0:8426:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1782216858.710005:0:8426:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1782216858.710038:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7b363a00/0x92b8e04cbf5f90ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f9106 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216858.710060:0:8426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e7b363a00/0x92b8e04cbf5f90ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f9106 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782216858.710069:0:8426:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff952e74b5e800 from 1 10000000:01000000:2.0:1782216858.710073:0:8426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782216858.710109:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e413fc600/0x92b8e04cbf5f911b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216858.710118:0:8426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e413fc600/0x92b8e04cbf5f911b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216858.711102:0:8426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e413fc600/0x92b8e04cbf5f911b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216858.711260:0:8426:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41bfa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:8426:1868789712964864:0@lo:101: 00000100:00100000:2.0:1782216858.711324:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216858.711735:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712964864 00000100:00100000:1.0:1782216858.711750:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712964864 00000100:00100000:1.0:1782216858.711801:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1782216858.711810:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+14:8426:x1868789712964864:12345-0@lo:101: 00010000:00010000:1.0:1782216858.711824:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782216858.711837:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e41681e00/0x92b8e04cbf5f9122 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f911b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216858.711929:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e41681e00/0x92b8e04cbf5f9122 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f911b expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216858.711940:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e41681e00/0x92b8e04cbf5f9122 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f911b expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216858.711949:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e41681e00, rc 0) 00000100:00100000:1.0:1782216858.711987:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:8426:x1868789712964864:12345-0@lo:101: Request processed in 178us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216858.711994:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1782216858.713040:0:8426:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e7c6ef240 going to sleep for 11 seconds 00000100:00100000:2.0:1782216858.713078:0:8426:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41bfa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:8426:1868789712964864:0@lo:101: 00010000:00010000:2.0:1782216858.713095:0:8426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e413fc600/0x92b8e04cbf5f911b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f9122 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216858.713105:0:8426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e413fc600/0x92b8e04cbf5f911b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f9122 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216858.713334:0:8426:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41bfa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:8426:1868789712964992:0@lo:501: 00000100:00100000:2.0:1782216858.713378:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216858.713407:0:8426:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e7c6ef240 going to sleep for 11 seconds 00000100:00100000:2.0:1782216858.713433:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712964992 00000100:00100000:2.0:1782216858.713438:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712964992 00000100:00100000:2.0:1782216858.713471:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1782216858.713478:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:8426:x1868789712964992:12345-0@lo:501: 00000100:00100000:2.0:1782216858.713573:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:8426:x1868789712964992:12345-0@lo:501: Request processed in 95us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216858.713597:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1782216858.713635:0:8426:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41bfa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:8426:1868789712964992:0@lo:501: 00000100:00100000:2.0:1782216858.713677:0:8426:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41bfa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:8426:1868789712965120:0@lo:503: 00000100:00100000:2.0:1782216858.713718:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216858.713730:0:8426:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e7c6ef240 going to sleep for 11 seconds 00000100:00100000:1.0:1782216858.714275:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712965120 00000100:00100000:1.0:1782216858.714280:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712965120 00000100:00100000:1.0:1782216858.714314:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1782216858.714321:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52589c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:8426:x1868789712965120:12345-0@lo:503: 00000100:00100000:1.0:1782216858.715018:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52589c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:8426:x1868789712965120:12345-0@lo:503: Request processed in 696us (1296us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216858.715027:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1782216858.715306:0:8426:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41bfa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:8426:1868789712965120:0@lo:503: 00000040:00080000:2.0:1782216858.715540:0:8426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782216858.715665:0:8426:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41bfa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:8426:1868789712965248:0@lo:502: 00000100:00100000:2.0:1782216858.715712:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216858.715750:0:8426:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e7c6ef240 going to sleep for 11 seconds 00000100:00100000:1.0:1782216858.717778:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712965248 00000100:00100000:1.0:1782216858.717791:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712965248 00000100:00100000:1.0:1782216858.717846:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1782216858.717867:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:8426:x1868789712965248:12345-0@lo:502: 00000100:00100000:1.0:1782216858.718043:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:8426:x1868789712965248:12345-0@lo:502: Request processed in 188us (2329us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216858.718070:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1782216858.719108:0:8426:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41bfa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:8426:1868789712965248:0@lo:502: 00000040:00080000:0.0:1782216858.719375:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1782216858.719414:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1782216858.719454:0:8426:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e72e8c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:8426:1868789712965376:0@lo:502: 00000100:00100000:0.0:1782216858.719510:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216858.719547:0:8426:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e52b6eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1782216858.722298:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712965376 00000100:00100000:1.0:1782216858.722312:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712965376 00000100:00100000:1.0:1782216858.722376:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1782216858.722386:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:8426:x1868789712965376:12345-0@lo:502: 00000100:00100000:1.0:1782216858.722556:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:8426:x1868789712965376:12345-0@lo:502: Request processed in 171us (3045us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216858.722564:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1782216858.722895:0:8426:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e72e8c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:8426:1868789712965376:0@lo:502: 00000040:00080000:3.0:1782216858.722977:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1782216858.722991:0:8426:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1782216858.723842:0:8454:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782216858.723850:0:8454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782216858.723852:0:8454:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1782216858.723857:0:8454:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff952e74b5e800 00000020:00000080:3.0:1782216858.723859:0:8454:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1782216858.723867:0:8454:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782216858.723869:0:8454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782216858.723870:0:8454:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1782216858.723872:0:8454:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1782216858.723997:0:8426:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1782216858.724023:0:8426:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782216858.724044:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e413fc600/0x92b8e04cbf5f911b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f9122 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216858.724373:0:8426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e413fc600/0x92b8e04cbf5f911b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f9122 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782216858.724423:0:8426:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1782216858.724426:0:8426:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff952e74b5e800 10000000:01000000:2.0:1782216858.724429:0:8426:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff952e74b5e800 10000000:01000000:2.0:1782216858.724432:0:8426:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1782216858.724437:0:8426:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff952e74b5e800 from 1 10000000:01000000:2.0:1782216858.724440:0:8426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782216858.724480:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e413fd200/0x92b8e04cbf5f9129 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216858.724488:0:8426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e413fd200/0x92b8e04cbf5f9129 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216858.724802:0:8426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e413fd200/0x92b8e04cbf5f9129 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216858.724841:0:8426:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41bf8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:8426:1868789712965504:0@lo:101: 00000100:00100000:2.0:1782216858.724901:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216858.725322:0:8426:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e7c6ef240 going to sleep for 11 seconds 00000100:00100000:3.0:1782216858.725882:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712965504 00000100:00100000:3.0:1782216858.725890:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712965504 00000100:00100000:2.0:1782216858.726177:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1782216858.726186:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52588450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:8426:x1868789712965504:12345-0@lo:101: 00010000:00010000:2.0:1782216858.726776:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782216858.726794:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e413fc400/0x92b8e04cbf5f9130 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f9129 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216858.726821:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e413fc400/0x92b8e04cbf5f9130 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9129 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216858.726832:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e413fc400/0x92b8e04cbf5f9130 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9129 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216858.726841:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e413fc400, rc 0) 00000100:00100000:2.0:1782216858.726901:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52588450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:8426:x1868789712965504:12345-0@lo:101: Request processed in 716us (2000us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216858.726908:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1782216858.727121:0:8426:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41bf8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:8426:1868789712965504:0@lo:101: 00010000:00010000:3.0:1782216858.727162:0:8426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e413fd200/0x92b8e04cbf5f9129 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f9130 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.727170:0:8426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e413fd200/0x92b8e04cbf5f9129 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f9130 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216858.727842:0:8426:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:8426:1868789712965632:0@lo:501: 00000100:00100000:3.0:1782216858.727883:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216858.728161:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712965632 00000100:00100000:2.0:1782216858.728167:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712965632 00000100:00100000:2.0:1782216858.728203:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1782216858.728211:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e195450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:8426:x1868789712965632:12345-0@lo:501: 00000100:00100000:3.0:1782216858.729002:0:8426:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d42279180 going to sleep for 11 seconds 00000100:00100000:2.0:1782216858.729273:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e195450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:8426:x1868789712965632:12345-0@lo:501: Request processed in 1061us (1388us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216858.729282:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1782216858.729363:0:8426:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:8426:1868789712965632:0@lo:501: 00000100:00100000:3.0:1782216858.729447:0:8426:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:8426:1868789712965760:0@lo:503: 00000100:00100000:3.0:1782216858.729487:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216858.729546:0:8426:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d42279180 going to sleep for 11 seconds 00000100:00100000:1.0:1782216858.729576:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712965760 00000100:00100000:1.0:1782216858.729755:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712965760 00000100:00100000:1.0:1782216858.729823:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1782216858.729832:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e195050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:8426:x1868789712965760:12345-0@lo:503: 00000100:00100000:1.0:1782216858.729930:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e195050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:8426:x1868789712965760:12345-0@lo:503: Request processed in 99us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216858.729937:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1782216858.729951:0:8426:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:8426:1868789712965760:0@lo:503: 00000040:00080000:0.0:1782216858.730291:0:8426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782216858.730364:0:8426:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e72e8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:8426:1868789712965888:0@lo:502: 00000100:00100000:0.0:1782216858.730403:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216858.730434:0:8426:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e52b6e000 going to sleep for 11 seconds 00000100:00100000:1.0:1782216858.730452:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712965888 00000100:00100000:1.0:1782216858.730457:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712965888 00000100:00100000:1.0:1782216858.730512:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1782216858.730518:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e197c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:8426:x1868789712965888:12345-0@lo:502: 00000100:00100000:1.0:1782216858.730609:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e197c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:8426:x1868789712965888:12345-0@lo:502: Request processed in 91us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216858.730625:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1782216858.730728:0:8426:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e72e8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:8426:1868789712965888:0@lo:502: 00000040:00080000:0.0:1782216858.731528:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1782216858.731562:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1782216858.731575:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1782216858.731672:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1782216858.731689:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1782216858.731704:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1782216858.731717:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1782216858.731729:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1782216858.731740:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1782216858.731752:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1782216858.731765:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1782216858.731778:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1782216858.731793:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1782216858.732022:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1782216858.732123:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1782216858.732147:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1782216858.732159:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1782216858.732170:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1782216858.732199:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1782216858.732213:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1782216858.732224:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1782216858.732235:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1782216858.732246:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1782216858.732260:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1782216858.732271:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1782216858.732282:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1782216858.732293:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1782216858.732303:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1782216858.732315:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1782216858.732325:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1782216858.732336:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1782216858.732346:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1782216858.732357:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1782216858.732368:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1782216858.732379:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1782216858.732391:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1782216858.732403:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:1.0:1782216858.732436:0:8426:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b09d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:8426:1868789712966016:0@lo:502: 00000100:00100000:1.0:1782216858.732512:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216858.732610:0:8426:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e460e83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782216858.733089:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712966016 00000100:00100000:3.0:1782216858.733097:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712966016 00000100:00100000:3.0:1782216858.733261:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1782216858.733271:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e196c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:8426:x1868789712966016:12345-0@lo:502: 00000100:00100000:3.0:1782216858.733389:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e196c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:8426:x1868789712966016:12345-0@lo:502: Request processed in 119us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216858.733396:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1782216858.733456:0:8426:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b09d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:8426:1868789712966016:0@lo:502: 00000040:00080000:2.0:1782216858.733518:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1782216858.733528:0:8426:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1782216858.736215:0:8455:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1782216858.736235:0:8455:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff952e73978000) 00000020:00000080:2.0:1782216858.736261:0:8455:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1782216858.736479:0:8455:0:(tgt_mount.c:153:server_get_mount()) get mount ffff952e74b5e800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1782216858.736484:0:8455:0:(tgt_mount.c:187:server_put_mount()) put mount ffff952e74b5e800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1782216858.736486:0:8455:0:(obd_mount.c:701:lustre_put_lsi()) put ffff952e74b5e800 3 00010000:00080000:2.0:1782216858.736517:0:8455:0:(ldlm_lib.c:102:import_set_conn()) imp ffff952d42006800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.130@tcp at head 00010000:00010000:2.0:1782216858.742437:0:8455:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:2.0:1782216858.742608:0:8455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1782216858.743242:0:8455:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1782216858.743256:0:8455:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x92b8e04cbf5f913e 00000100:00080000:2.0:1782216858.743266:0:8455:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782216858.743272:0:8455:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff952d42006800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1782216858.743304:0:8455:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff952d41bfb480 x1868789712966144/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782216858.743336:0:8455:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1782216858.743974:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41bfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1868789712966144:0@lo:38: 00000100:00100000:1.0:1782216858.744060:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216858.744410:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712966144 00000100:00100000:2.0:1782216858.744418:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712966144 00000100:00100000:2.0:1782216858.744457:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782216858.744464:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b09f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1868789712966144:12345-0@lo:38: 00010000:00080000:2.0:1782216858.744504:0:6518:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 221 last 0 00000020:00000080:2.0:1782216858.744548:0:6518:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x92b8e04cbf5f9145 00000004:00100000:2.0:1782216858.744562:0:6518:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1782216858.744609:0:6518:0:(import.c:65:import_set_state_nolock()) ffff952e7c517000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782216858.744897:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b09f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1868789712966144:12345-0@lo:38: Request processed in 431us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216858.744910:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:2.0:1782216858.745199:0:8455:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1782216858.745216:0:8455:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff952e739799c0) 00010000:00080000:1.0:1782216858.745222:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff952d41bfb480 x1868789712966144/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782216868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216858.745234:0:3646:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000020:00000080:2.0:1782216858.745235:0:8455:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000100:00080000:1.0:1782216858.745242:0:3646:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1782216858.745251:0:3646:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1782216858.745256:0:3646:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1782216858.745266:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952d42006800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1782216858.745273:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41bfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1868789712966144:0@lo:38: 00000020:01000004:2.0:1782216858.745396:0:8455:0:(tgt_mount.c:153:server_get_mount()) get mount ffff952e74b5e800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1782216858.745401:0:8455:0:(tgt_mount.c:187:server_put_mount()) put mount ffff952e74b5e800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1782216858.745404:0:8455:0:(obd_mount.c:701:lustre_put_lsi()) put ffff952e74b5e800 3 00010000:00080000:2.0:1782216858.745427:0:8455:0:(ldlm_lib.c:102:import_set_conn()) imp ffff952d4245c000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.130@tcp at head 00000100:00100000:1.0:1782216858.746635:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1868789712966272:0@lo:400: 00000100:00100000:1.0:1782216858.746692:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216858.746876:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789712966400:0@lo:400: 00000100:00100000:0.0:1782216858.746913:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216858.746938:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782216858.746945:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1868789712966528:0@lo:400: 00000100:00100000:0.0:1782216858.746981:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216858.747026:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712966400 00000100:00100000:0.0:1782216858.747032:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712966400 00010000:00010000:2.0:1782216858.747557:0:8455:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:2.0:1782216858.747916:0:8455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1782216858.748108:0:8455:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1782216858.748120:0:8455:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x92b8e04cbf5f9153 00000100:00080000:2.0:1782216858.748191:0:8455:0:(import.c:512:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782216858.748198:0:8455:0:(import.c:626:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff952d4245c000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1782216858.748227:0:8455:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff952d41bf8700 x1868789712966784/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782216858.748261:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41bf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1868789712966784:0@lo:38: 00000100:00100000:2.0:1782216858.748309:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216858.748355:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712966272 00000100:00100000:2.0:1782216858.748360:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712966272 00000100:00100000:2.0:1782216858.748389:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712966528 00000100:00100000:2.0:1782216858.748392:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712966528 00000100:00100000:2.0:1782216858.748401:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712966784 00000100:00100000:2.0:1782216858.748403:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712966784 00000100:00100000:2.0:1782216858.748412:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782216858.748420:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b09e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1868789712966272:12345-0@lo:400: 00000100:00100000:0.0:1782216858.748538:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782216858.748549:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72e8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789712966400:12345-0@lo:400: 00000100:00100000:0.0:1782216858.748605:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72e8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789712966400:12345-0@lo:400: Request processed in 60us (1691us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216858.748622:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782216858.748648:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782216858.748655:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72e8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1868789712966528:12345-0@lo:400: 00000100:00100000:0.0:1782216858.748687:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72e8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1868789712966528:12345-0@lo:400: Request processed in 32us (1706us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216858.748692:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782216858.748703:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782216858.748707:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1868789712966784:12345-0@lo:38: 00010000:00080000:0.0:1782216858.748727:0:6520:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 221 last 0 00000020:00000080:0.0:1782216858.748830:0:6520:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x92b8e04cbf5f915a 00000004:00100000:0.0:1782216858.748846:0:6520:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1782216858.748874:0:6520:0:(import.c:65:import_set_state_nolock()) ffff952e74b7c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782216858.748913:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1868789712966784:12345-0@lo:38: Request processed in 204us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216858.748920:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1782216858.748962:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff952d41be4e00 x1868789712966528/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216858.748976:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1868789712966528:0@lo:400: 00000100:00100000:0.0:1782216858.748989:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789712966400:0@lo:400: 00010000:00080000:0.0:1782216858.749163:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff952d41bf8700 x1868789712966784/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782216868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216858.749172:0:3646:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782216858.749178:0:3646:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1782216858.749185:0:3646:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1782216858.749603:0:3646:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1782216858.749607:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952d4245c000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1782216858.749614:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41bf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1868789712966784:0@lo:38: 00000100:00100000:2.0:1782216858.762154:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b09e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1868789712966272:12345-0@lo:400: Request processed in 13724us (15451us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216858.762185:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1782216858.763231:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff952d41be7b80 x1868789712966272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216858.763248:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1868789712966272:0@lo:400: 00000100:00100000:1.0:1782216858.763270:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782216858.763280:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789712966656:0@lo:400: 00000100:00100000:1.0:1782216858.763333:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216858.764035:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712966656 00000100:00100000:0.0:1782216858.764044:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712966656 00000100:00100000:0.0:1782216858.764099:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782216858.764108:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b09c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789712966656:12345-0@lo:400: 00000100:00100000:0.0:1782216858.764169:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b09c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789712966656:12345-0@lo:400: Request processed in 62us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216858.764176:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782216858.764213:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789712966656:0@lo:400: 00000100:00080000:2.0:1782216858.768703:0:8455:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000040:00080000:2.0:1782216858.770984:0:8455:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1782216858.771184:0:8426:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1782216858.771212:0:8426:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782216858.771230:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e413fd200/0x92b8e04cbf5f9129 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f9130 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.771242:0:8426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e413fd200/0x92b8e04cbf5f9129 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f9130 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1782216858.771308:0:8426:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1782216858.771311:0:8426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1782216858.771312:0:8426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782216858.771313:0:8426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782216858.771315:0:8426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782216858.771316:0:8426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782216858.771318:0:8426:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782216858.771320:0:8426:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782216858.771321:0:8426:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782216858.771323:0:8426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782216858.771325:0:8426:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1782216858.771333:0:8426:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1782216858.771336:0:8426:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782216858.771337:0:8426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1782216858.771338:0:8426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782216858.771339:0:8426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782216858.771340:0:8426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782216858.771342:0:8426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782216858.771343:0:8426:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782216858.771344:0:8426:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782216858.771345:0:8426:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782216858.771346:0:8426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782216858.771347:0:8426:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1782216858.771378:0:8426:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1782216858.771396:0:8426:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:8426:1868789712966912:0@lo:253: 00000100:00100000:3.0:1782216858.771465:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216858.771507:0:8426:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d42279780 going to sleep for 11 seconds 00000100:00100000:2.0:1782216858.771574:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712966912 00000100:00100000:2.0:1782216858.771609:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712966912 00000100:00100000:2.0:1782216858.771653:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1782216858.771663:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e197850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:8426:x1868789712966912:12345-0@lo:253: 20000000:01000000:2.0:1782216858.771689:0:6514:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1782216858.771702:0:6514:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1782216858.795816:0:6514:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1782216858.795831:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1782216858.796788:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e197850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:8426:x1868789712966912:12345-0@lo:253: Request processed in 25120us (25316us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216858.796800:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1782216858.796916:0:8426:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:8426:1868789712966912:0@lo:253: 10000000:01000000:2.0:1782216858.796930:0:8426:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1782216858.796933:0:8426:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782216858.796935:0:8426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782216858.796936:0:8426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782216858.796937:0:8426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782216858.796939:0:8426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782216858.796940:0:8426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782216858.796942:0:8426:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782216858.796943:0:8426:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782216858.796944:0:8426:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782216858.796946:0:8426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782216858.796947:0:8426:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1782216858.796960:0:8426:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1782216858.803501:0:6534:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1782216858.803511:0:6534:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1782216858.803537:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff952e41680e00/0x92b8e04cbf5f9161 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216858.803554:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952e7c449e00/0x92b8e04cbf5f905e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9057 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216858.803561:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952e41680c00/0x92b8e04cbf5f9088 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9081 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216858.803569:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff952e41680e00/0x92b8e04cbf5f9161 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216858.803629:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952e41680c00/0x92b8e04cbf5f9088 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5f9081 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216858.803644:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff952e41680c00/0x92b8e04cbf5f9088 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9081 expref: 15 pid: 6511 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216858.803675:0:6534:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b09c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1868789712967040:0@lo:104: 00000100:00100000:1.0:1782216858.803737:0:6534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782216858.803803:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952e7c449e00/0x92b8e04cbf5f905e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5f9057 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216858.803811:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff952e7c449e00/0x92b8e04cbf5f905e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9057 expref: 15 pid: 6513 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216858.803819:0:6534:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b09d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1868789712967168:0@lo:104: 00000100:00100000:1.0:1782216858.803836:0:6534:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e460e8000 going to sleep for 11 seconds 00000100:00100000:3.0:1782216858.803914:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1782216858.803933:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216858.803949:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712967040 00000100:00100000:3.0:1782216858.803956:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712967040 00000100:00100000:0.0:1782216858.803968:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712967168 00000100:00100000:0.0:1782216858.803972:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712967168 00000100:00100000:3.0:1782216858.803989:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782216858.803996:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e73ae6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+4:6534:x1868789712967040:12345-0@lo:104: 00010000:00010000:3.0:1782216858.804008:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff952e41681000/0x92b8e04cbf5f9081 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f9088 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.804085:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782216858.804092:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e73ae6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+4:6534:x1868789712967040:12345-0@lo:104: Request processed in 96us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216858.804098:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782216858.804136:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782216858.804141:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+3:6534:x1868789712967168:12345-0@lo:104: 00010000:00010000:3.0:1782216858.804149:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff952e413fd000/0x92b8e04cbf5f9057 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f905e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.804187:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1782216858.804192:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+3:6534:x1868789712967168:12345-0@lo:104: Request processed in 52us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216858.804197:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1782216858.804731:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782216858.804737:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e41681000/0x92b8e04cbf5f9081 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f9088 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.804744:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e41681000 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:3.0:1782216858.804748:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e41681000/0x92b8e04cbf5f9081 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5f9088 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.804755:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e41681000/0x92b8e04cbf5f9081 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5f9088 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782216858.804762:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e41681000/0x92b8e04cbf5f9081 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5f9088 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782216858.804767:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1782216858.804803:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e41681000/0x92b8e04cbf5f9081 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f9088 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.804810:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782216858.804825:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e41681000/0x92b8e04cbf5f9081 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f9088 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.804831:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e41681000/0x92b8e04cbf5f9081 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f9088 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.804844:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782216858.804847:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e413fd000/0x92b8e04cbf5f9057 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f905e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.804852:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e413fd000 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:3.0:1782216858.804855:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e413fd000/0x92b8e04cbf5f9057 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5f905e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.804861:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e413fd000/0x92b8e04cbf5f9057 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5f905e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782216858.804867:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e413fd000/0x92b8e04cbf5f9057 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5f905e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782216858.804872:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1782216858.804884:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e413fd000/0x92b8e04cbf5f9057 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f905e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.804889:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782216858.804899:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e413fd000/0x92b8e04cbf5f9057 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f905e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.804915:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e413fd000/0x92b8e04cbf5f9057 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f905e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.804927:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216858.804929:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216858.804931:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782216858.805201:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782216858.805220:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17bce19a-7a0f-4c9d-b31c-4e0155298487:3650:1868789712967296:0@lo:103: 00000100:00100000:0.0:1782216858.805260:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216858.805319:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789712967424:0@lo:103: 00000100:00100000:0.0:1782216858.805342:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216858.805502:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712967296 00000100:00100000:3.0:1782216858.805508:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712967296 00010000:00010000:3.0:1782216858.805529:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952e41680c00/0x92b8e04cbf5f9088 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9081 expref: 16 pid: 6511 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216858.805558:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712967424 00000100:00100000:3.0:1782216858.805562:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712967424 00010000:00010000:3.0:1782216858.805572:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952e7c449e00/0x92b8e04cbf5f905e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9057 expref: 17 pid: 6513 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216858.805612:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782216858.805619:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72e8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:3650:x1868789712967296:12345-0@lo:103: 00010000:00010000:3.0:1782216858.805629:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782216858.805633:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952e41680c00/0x92b8e04cbf5f9088 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9081 expref: 17 pid: 6511 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.805644:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952e41680c00/0x92b8e04cbf5f9088 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9081 expref: 17 pid: 6511 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.805657:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782216858.805683:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72e8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:3650:x1868789712967296:12345-0@lo:103: Request processed in 64us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216858.805689:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782216858.805711:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782216858.805716:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72e8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:3647:x1868789712967424:12345-0@lo:103: 00010000:00010000:3.0:1782216858.805723:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782216858.805728:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952e7c449e00/0x92b8e04cbf5f905e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9057 expref: 16 pid: 6513 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.805735:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952e7c449e00/0x92b8e04cbf5f905e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9057 expref: 16 pid: 6513 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.805746:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff952e41680e00/0x92b8e04cbf5f9161 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.805754:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e41680e00/0x92b8e04cbf5f9161 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1782216858.805766:0:6506:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007026663s 00010000:00010000:3.0:1782216858.805771:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff952e41680e00/0x92b8e04cbf5f9161 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.805778:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff952e41680e00/0x92b8e04cbf5f9161 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.805784:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff952e41680e00/0x92b8e04cbf5f9161 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.805790:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff952e41680e00/0x92b8e04cbf5f9161 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.805795:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e41680e00 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:3.0:1782216858.805799:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff952e41680e00/0x92b8e04cbf5f9161 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216858.805802:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17bce19a-7a0f-4c9d-b31c-4e0155298487:3650:1868789712967296:0@lo:103: 00010000:00010000:3.0:1782216858.805815:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff952e41680e00/0x92b8e04cbf5f9161 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.805824:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff952e41680e00/0x92b8e04cbf5f9161 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216858.805833:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782216858.805869:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72e8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:3647:x1868789712967424:12345-0@lo:103: Request processed in 152us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216858.805875:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782216858.807796:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789712967424:0@lo:103: 00010000:00010000:1.0:1782216858.808386:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e41680c00/0x92b8e04cbf5f9088 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5f9081 expref: 15 pid: 6511 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216858.808406:0:6534:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b09c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1868789712967040:0@lo:104: 00010000:00010000:1.0:1782216858.808417:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e7c449e00/0x92b8e04cbf5f905e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5f9057 expref: 14 pid: 6513 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216858.808426:0:6534:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b09d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1868789712967168:0@lo:104: 00010000:00010000:1.0:1782216858.808442:0:6534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff952e41680e00/0x92b8e04cbf5f9161 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216858.808451:0:6534:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff952e41680e00/0x92b8e04cbf5f9161 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216858.808457:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff952e41680e00/0x92b8e04cbf5f9161 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216858.808463:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e41680e00/0x92b8e04cbf5f9161 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1782216858.811274:0:8426:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1782216858.811658:0:8426:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1782216858.811862:0:8426:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1782216858.812024:0:8426:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1782216858.812232:0:8426:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1782216858.812456:0:8426:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1782216858.823100:0:8426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1782216858.844185:0:8426:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1782216858.844195:0:8426:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1782216858.844233:0:8426:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1782216858.844282:0:8426:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.130@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1782216858.844300:0:8426:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1782216858.844325:0:8426:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1782216858.849294:0:8426:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782216858.850309:0:8426:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1782216859.131457:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1782216859.808135:0:8511:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1782216859.808334:0:8511:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1782216860.026771:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1782216860.026779:0:6516:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff952e7b38d800 from 30 10000000:01000000:0.0:1782216860.026785:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1782216860.026827:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7c449a00/0x92b8e04cbf5f9168 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.026838:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e7c449a00/0x92b8e04cbf5f9168 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.026849:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e7c449a00/0x92b8e04cbf5f9168 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216860.026872:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e72e8c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712967552:0@lo:101: 00000100:00100000:0.0:1782216860.026955:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216860.027072:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e42c59b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782216860.027342:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712967552 00000100:00100000:2.0:1782216860.027351:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712967552 00000100:00100000:2.0:1782216860.027449:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1782216860.027461:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e194050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+14:6516:x1868789712967552:12345-0@lo:101: 00010000:00010000:2.0:1782216860.027476:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782216860.027489:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e413fc200/0x92b8e04cbf5f916f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f9168 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.027522:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e413fc200/0x92b8e04cbf5f916f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9168 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.027533:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e413fc200/0x92b8e04cbf5f916f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9168 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.027542:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e413fc200, rc 0) 00000100:00100000:2.0:1782216860.027626:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e194050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:6516:x1868789712967552:12345-0@lo:101: Request processed in 168us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216860.027635:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1782216860.027749:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e72e8c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712967552:0@lo:101: 00010000:00010000:0.0:1782216860.027765:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e7c449a00/0x92b8e04cbf5f9168 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f916f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.027775:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e7c449a00/0x92b8e04cbf5f9168 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f916f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216860.027851:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e72e8c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712967680:0@lo:501: 00000100:00100000:0.0:1782216860.027908:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216860.028155:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e42c59b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782216860.028189:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712967680 00000100:00100000:1.0:1782216860.028194:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712967680 00000100:00100000:1.0:1782216860.028224:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1782216860.028232:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e194850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:6516:x1868789712967680:12345-0@lo:501: 00000100:00100000:1.0:1782216860.028356:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e194850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:6516:x1868789712967680:12345-0@lo:501: Request processed in 125us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216860.028364:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1782216860.028480:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e72e8c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712967680:0@lo:501: 00000100:00100000:0.0:1782216860.028511:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e72e8c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712967808:0@lo:503: 00000100:00100000:0.0:1782216860.028552:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216860.028654:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e42c59b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782216860.028726:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712967808 00000100:00100000:1.0:1782216860.028731:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712967808 00000100:00100000:1.0:1782216860.028796:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1782216860.028805:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e196450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:6516:x1868789712967808:12345-0@lo:503: 00000100:00100000:1.0:1782216860.029005:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e196450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:6516:x1868789712967808:12345-0@lo:503: Request processed in 95us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216860.029013:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1782216860.029124:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e72e8c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712967808:0@lo:503: 00000100:00100000:0.0:1782216860.029319:0:8526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e72e8c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:8526:1868789712967936:0@lo:502: 00000100:00100000:0.0:1782216860.029355:0:8526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216860.029426:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712967936 00000100:00100000:2.0:1782216860.029430:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712967936 00000100:00100000:2.0:1782216860.029449:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1782216860.029455:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e196850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:8526:x1868789712967936:12345-0@lo:502: 00000100:00100000:2.0:1782216860.029524:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e196850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:8526:x1868789712967936:12345-0@lo:502: Request processed in 67us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216860.029530:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1782216860.029752:0:8526:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e42c59c00 going to sleep for 11 seconds 00000100:00100000:0.0:1782216860.029766:0:8526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e72e8c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:8526:1868789712967936:0@lo:502: 00000100:00100000:0.0:1782216860.029804:0:8526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e72e8c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:8526:1868789712968064:0@lo:502: 00000100:00100000:0.0:1782216860.029833:0:8526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216860.029857:0:8526:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e42c59c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782216860.032397:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712968064 00000100:00100000:3.0:1782216860.032410:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712968064 00000100:00100000:3.0:1782216860.032478:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1782216860.032489:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e195c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:8526:x1868789712968064:12345-0@lo:502: 00000100:00100000:3.0:1782216860.032672:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e195c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:8526:x1868789712968064:12345-0@lo:502: Request processed in 184us (2836us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216860.032680:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1782216860.033052:0:8526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e72e8c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:8526:1868789712968064:0@lo:502: 00000040:00080000:2.0:1782216860.033087:0:8526:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1782216860.033226:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1782216860.033253:0:6516:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782216860.033263:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7c449a00/0x92b8e04cbf5f9168 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f916f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.033274:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e7c449a00/0x92b8e04cbf5f9168 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f916f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782216860.033283:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1782216860.033285:0:6516:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff952e7b38d800 from 5 10000000:01000000:0.0:1782216860.033288:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1782216860.033319:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7c449600/0x92b8e04cbf5f9176 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.033333:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e7c449600/0x92b8e04cbf5f9176 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.033343:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e7c449600/0x92b8e04cbf5f9176 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216860.033360:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e72e8f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712968192:0@lo:101: 00000100:00100000:0.0:1782216860.033401:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216860.033439:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e42c59d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782216860.033473:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712968192 00000100:00100000:2.0:1782216860.033478:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712968192 00000100:00100000:2.0:1782216860.033517:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1782216860.033524:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e197050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:6516:x1868789712968192:12345-0@lo:101: 00010000:00010000:2.0:1782216860.033534:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782216860.033549:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e413fc800/0x92b8e04cbf5f917d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f9176 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.033604:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e413fc800/0x92b8e04cbf5f917d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9176 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.033615:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e413fc800/0x92b8e04cbf5f917d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9176 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.033624:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e413fc800, rc 0) 00000100:00100000:2.0:1782216860.033660:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e197050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:6516:x1868789712968192:12345-0@lo:101: Request processed in 136us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216860.033667:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1782216860.035900:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e72e8f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712968192:0@lo:101: 00010000:00010000:0.0:1782216860.035930:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e7c449600/0x92b8e04cbf5f9176 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f917d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.035941:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e7c449600/0x92b8e04cbf5f9176 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f917d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216860.036034:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e72e8f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712968320:0@lo:256: 00000100:00100000:0.0:1782216860.036107:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216860.036153:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e42c59d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782216860.036636:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712968320 00000100:00100000:2.0:1782216860.036644:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712968320 00000100:00100000:2.0:1782216860.036691:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1782216860.036700:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e196050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:6516:x1868789712968320:12345-0@lo:256: 20000000:01000000:2.0:1782216860.036721:0:6511:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1782216860.036737:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1782216860.036741:0:6511:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1782216860.036825:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e196050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:6516:x1868789712968320:12345-0@lo:256: Request processed in 125us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216860.036834:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1782216860.036931:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e72e8f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712968320:0@lo:256: 10000000:01000000:0.0:1782216860.036972:0:6516:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1782216860.036980:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7c449600/0x92b8e04cbf5f9176 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f917d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.036990:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e7c449600/0x92b8e04cbf5f9176 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f917d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782216860.037011:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1782216860.037014:0:6516:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:0.0:1782216860.037017:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1782216860.037056:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7c448e00/0x92b8e04cbf5f9184 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.037065:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e7c448e00/0x92b8e04cbf5f9184 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.037074:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e7c448e00/0x92b8e04cbf5f9184 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216860.037089:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e72e8f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712968448:0@lo:101: 00000100:00100000:0.0:1782216860.037130:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216860.037239:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e42c59d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782216860.037627:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712968448 00000100:00100000:2.0:1782216860.037634:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712968448 00000100:00100000:2.0:1782216860.037667:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1782216860.037675:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e194450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:6516:x1868789712968448:12345-0@lo:101: 00010000:00010000:2.0:1782216860.037686:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782216860.037699:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e413fd600/0x92b8e04cbf5f918b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f9184 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.037737:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e413fd600/0x92b8e04cbf5f918b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9184 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.037748:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e413fd600/0x92b8e04cbf5f918b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9184 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216860.037759:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e413fd600, rc 0) 00000100:00100000:2.0:1782216860.037794:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e194450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:6516:x1868789712968448:12345-0@lo:101: Request processed in 120us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216860.037801:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1782216860.037920:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e72e8f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712968448:0@lo:101: 00010000:00010000:0.0:1782216860.037934:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e7c448e00/0x92b8e04cbf5f9184 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f918b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.037944:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e7c448e00/0x92b8e04cbf5f9184 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f918b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216860.038005:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e72e8f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712968576:0@lo:501: 00000100:00100000:0.0:1782216860.038036:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216860.038076:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e42c59d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782216860.038090:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712968576 00000100:00100000:0.0:1782216860.038094:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712968576 00000100:00100000:0.0:1782216860.038122:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1782216860.038324:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e197450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:6516:x1868789712968576:12345-0@lo:501: 00000100:00100000:0.0:1782216860.038446:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e197450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:6516:x1868789712968576:12345-0@lo:501: Request processed in 310us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216860.038453:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1782216860.038484:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e72e8f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712968576:0@lo:501: 00000100:00100000:0.0:1782216860.038513:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e72e8f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712968704:0@lo:503: 00000100:00100000:0.0:1782216860.038549:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216860.038562:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e42c59d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782216860.038574:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712968704 00000100:00100000:0.0:1782216860.038577:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712968704 00000100:00100000:0.0:1782216860.038620:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1782216860.038626:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e195850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:6516:x1868789712968704:12345-0@lo:503: 00000100:00100000:0.0:1782216860.038699:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e195850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:6516:x1868789712968704:12345-0@lo:503: Request processed in 72us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216860.038705:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1782216860.038742:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e72e8f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712968704:0@lo:503: 00000100:00100000:2.0:1782216860.039190:0:8528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41bfb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:8528:1868789712968832:0@lo:502: 00000100:00100000:2.0:1782216860.039781:0:8528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216860.039813:0:8528:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d42279540 going to sleep for 11 seconds 00000100:00100000:0.0:1782216860.039852:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712968832 00000100:00100000:0.0:1782216860.039858:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712968832 00000100:00100000:0.0:1782216860.039895:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1782216860.039904:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e194c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:8528:x1868789712968832:12345-0@lo:502: 00000100:00100000:0.0:1782216860.040002:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e194c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:8528:x1868789712968832:12345-0@lo:502: Request processed in 87us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216860.040009:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1782216860.040259:0:8528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41bfb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:8528:1868789712968832:0@lo:502: 00000020:01000000:2.0:1782216860.040286:0:8528:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1782216860.040293:0:8528:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1782216860.040300:0:8528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782216860.040303:0:8528:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1782216860.040310:0:8528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1782216860.040314:0:8528:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:01000000:2.0:1782216860.040336:0:8528:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1782216860.040339:0:8528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782216860.040366:0:8528:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff952e7dbd99c0) 00000020:00000080:2.0:1782216860.040387:0:8528:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1782216860.040394:0:8528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1782216860.040479:0:8528:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1782216860.040485:0:8528:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:2.0:1782216860.040498:0:8528:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x92b8e04cbf5f9199 00010000:00080000:2.0:1782216860.040525:0:8528:0:(ldlm_lib.c:102:import_set_conn()) imp ffff952d4245f800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.130@tcp at head 00010000:00010000:3.0:1782216860.041087:0:8528:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1782216860.051080:0:8528:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1782216860.051104:0:8528:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1782216860.051326:0:8528:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782216860.051542:0:8528:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782216860.051713:0:8528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1782216860.051852:0:8528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1782216860.053557:0:8530:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782216860.053563:0:8530:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1782216860.054349:0:8528:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1782216860.054360:0:8528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1782216860.054415:0:8528:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1782216860.054436:0:8528:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x92b8e04cbf5f91a0 00000100:00080000:0.0:1782216860.054446:0:8528:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782216860.054452:0:8528:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff952d4245f800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1782216860.054484:0:8528:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff952e72e8f480 x1868789712968960/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782216860.054512:0:8528:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1782216860.054631:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e72e8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1868789712969088:0@lo:400: 00000100:00100000:0.0:1782216860.054691:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216860.054721:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e72e8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1868789712969600:0@lo:400: 00000100:00100000:0.0:1782216860.054744:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216860.054763:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782216860.054768:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e72e8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789712969472:0@lo:400: 00000100:00100000:0.0:1782216860.054790:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216860.054823:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e72e8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789712969216:0@lo:400: 00000100:00100000:0.0:1782216860.054846:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216860.054862:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1868789712969728:0@lo:400: 00000100:00100000:0.0:1782216860.054879:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216860.055080:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782216860.055091:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e72e8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1868789712969344:0@lo:400: 00000100:00100000:0.0:1782216860.055115:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216860.055147:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712969088 00000100:00100000:0.0:1782216860.055153:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712969088 00000100:00100000:0.0:1782216860.055185:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712969600 00000100:00100000:0.0:1782216860.055188:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712969600 00000100:00100000:0.0:1782216860.055211:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712969728 00000100:00100000:0.0:1782216860.055214:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712969728 00000100:00100000:0.0:1782216860.055236:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712969344 00000100:00100000:0.0:1782216860.055239:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712969344 00000100:00100000:0.0:1782216860.055252:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782216860.055257:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e72e8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1868789712968960:0@lo:8: 00000100:00100000:0.0:1782216860.055262:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1868789712969088:12345-0@lo:400: 00000100:00100000:2.0:1782216860.055304:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216860.055318:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1868789712969088:12345-0@lo:400: Request processed in 58us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216860.055325:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782216860.055344:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782216860.055351:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1868789712969600:12345-0@lo:400: 00000100:00100000:0.0:1782216860.055374:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1868789712969600:12345-0@lo:400: Request processed in 25us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216860.055379:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782216860.055388:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782216860.055393:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1868789712969728:12345-0@lo:400: 00000100:00100000:0.0:1782216860.055465:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1868789712969728:12345-0@lo:400: Request processed in 71us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216860.055471:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782216860.055481:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782216860.055486:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1868789712969344:12345-0@lo:400: 00000100:00100000:0.0:1782216860.055509:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1868789712969344:12345-0@lo:400: Request processed in 24us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216860.055515:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782216860.055533:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712969472 00000100:00100000:0.0:1782216860.055536:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712969472 00000100:00100000:0.0:1782216860.055553:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712969216 00000100:00100000:0.0:1782216860.055555:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712969216 00000100:00100000:0.0:1782216860.055564:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782216860.055569:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789712969472:12345-0@lo:400: 00000100:00100000:0.0:1782216860.055622:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789712969472:12345-0@lo:400: Request processed in 52us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216860.055629:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782216860.055639:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782216860.055645:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789712969216:12345-0@lo:400: 00000100:00100000:0.0:1782216860.055681:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789712969216:12345-0@lo:400: Request processed in 36us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216860.055686:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782216860.055728:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e72e8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789712969472:0@lo:400: 00010000:00080000:0.0:1782216860.055739:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952e72e8c380 x1868789712969088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216860.055748:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e72e8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1868789712969088:0@lo:400: 00010000:00080000:0.0:1782216860.055756:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952e72e8c000 x1868789712969600/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216860.055763:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e72e8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1868789712969600:0@lo:400: 00000020:01000000:0.0:1782216860.055844:0:8528:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782216860.055850:0:8528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782216860.055852:0:8528:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1782216860.055855:0:8528:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782216860.055859:0:8528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782216860.055861:0:8528:0:(obd_config.c:1561:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:0.0:1782216860.055863:0:8528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782216860.055865:0:8528:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1782216860.056033:0:8528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6d5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:8528:1868789712969856:0@lo:502: 00000100:00100000:0.0:1782216860.056080:0:8528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216860.056104:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712969856 00000100:00100000:0.0:1782216860.056111:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712969856 00000100:00100000:0.0:1782216860.056134:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1782216860.056140:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e190c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:8528:x1868789712969856:12345-0@lo:502: 00000100:00100000:0.0:1782216860.056217:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e190c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:8528:x1868789712969856:12345-0@lo:502: Request processed in 76us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216860.056223:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1782216860.056253:0:8528:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e42c593c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782216860.056263:0:8528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6d5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:8528:1868789712969856:0@lo:502: 00000020:01000000:0.0:1782216860.056280:0:8528:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782216860.056283:0:8528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782216860.056285:0:8528:0:(obd_config.c:1561:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:0.0:1782216860.056287:0:8528:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:0.0:1782216860.056330:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:0.0:1782216860.056349:0:6516:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1782216860.056358:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7c448e00/0x92b8e04cbf5f9184 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f918b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.056367:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e7c448e00/0x92b8e04cbf5f9184 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f918b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782216860.056377:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1782216860.056379:0:6516:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff952e70905800 from 30 10000000:01000000:0.0:1782216860.056382:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1782216860.056400:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7c449c00/0x92b8e04cbf5f91a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.056408:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e7c449c00/0x92b8e04cbf5f91a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.056416:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e7c449c00/0x92b8e04cbf5f91a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216860.056432:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712969984:0@lo:101: 00000100:00100000:0.0:1782216860.056454:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216860.056466:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e42c593c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782216860.056477:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712969984 00000100:00100000:0.0:1782216860.056480:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712969984 00000100:00100000:0.0:1782216860.056497:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1782216860.056502:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:6516:x1868789712969984:12345-0@lo:101: 00010000:00010000:0.0:1782216860.056509:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782216860.056519:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e7c448a00/0x92b8e04cbf5f91ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f91a7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.056536:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e7c448a00/0x92b8e04cbf5f91ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f91a7 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.056546:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e7c448a00/0x92b8e04cbf5f91ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f91a7 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.056555:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7c448a00, rc 0) 00000100:00100000:0.0:1782216860.056575:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+18:6516:x1868789712969984:12345-0@lo:101: Request processed in 73us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216860.056598:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1782216860.056625:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712969984:0@lo:101: 00010000:00010000:0.0:1782216860.056636:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e7c449c00/0x92b8e04cbf5f91a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f91ae expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.056644:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e7c449c00/0x92b8e04cbf5f91a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f91ae expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216860.056689:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712970112:0@lo:501: 00000100:00100000:0.0:1782216860.056711:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216860.056721:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e42c593c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782216860.056731:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712970112 00000100:00100000:0.0:1782216860.056733:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712970112 00000100:00100000:0.0:1782216860.056750:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1782216860.056755:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e191050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+18:6516:x1868789712970112:12345-0@lo:501: 00000100:00100000:0.0:1782216860.056836:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e191050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+18:6516:x1868789712970112:12345-0@lo:501: Request processed in 80us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216860.056841:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1782216860.056863:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712970112:0@lo:501: 00000100:00100000:0.0:1782216860.056881:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712970240:0@lo:503: 00000100:00100000:3.0:1782216860.059157:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712968960 00000100:00100000:3.0:1782216860.059170:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712968960 00000100:00100000:3.0:1782216860.059214:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782216860.059221:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1868789712968960:12345-0@lo:8: 00010000:00080000:3.0:1782216860.059252:0:8432:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 223 last 0 00000020:00000080:3.0:1782216860.059280:0:8432:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x92b8e04cbf5f91b5 00002000:00100000:3.0:1782216860.059318:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff952d4229a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1782216860.059322:0:8432:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:3.0:1782216860.059326:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1782216860.059384:0:8432:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1782216860.059626:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1782216860.059654:0:8432:0:(import.c:65:import_set_state_nolock()) ffff952d4229b000 : changing import state from RECOVER to FULL 00010000:00080000:2.0:1782216860.060152:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952e7c6d5c00 x1868789712969728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216860.060170:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1868789712969728:0@lo:400: 00010000:00080000:2.0:1782216860.060211:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952e72e8ed80 x1868789712969344/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216860.060220:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e72e8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1868789712969344:0@lo:400: 00000100:00100000:2.0:1782216860.060235:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e72e8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789712969216:0@lo:400: 00000100:00100000:0.0:1782216860.060260:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216860.060297:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712970240 00000100:00100000:2.0:1782216860.060302:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712970240 00000100:00100000:0.0:1782216860.060307:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e42c593c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782216860.060350:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1782216860.060358:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e193c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+18:6516:x1868789712970240:12345-0@lo:503: 00000100:00100000:2.0:1782216860.060469:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e193c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+18:6516:x1868789712970240:12345-0@lo:503: Request processed in 110us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216860.060551:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1782216860.060573:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712970240:0@lo:503: 00000100:00100000:2.0:1782216860.060905:0:8532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41bf8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:8532:1868789712970368:0@lo:502: 00000100:00100000:2.0:1782216860.060948:0:8532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216860.060996:0:8532:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d422793c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782216860.061131:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712970368 00000100:00100000:0.0:1782216860.061136:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712970368 00000100:00100000:0.0:1782216860.061200:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1782216860.061209:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+18:8532:x1868789712970368:12345-0@lo:502: 00000100:00100000:0.0:1782216860.061296:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+18:8532:x1868789712970368:12345-0@lo:502: Request processed in 88us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216860.061303:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1782216860.061373:0:8532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41bf8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:8532:1868789712970368:0@lo:502: 00000100:00100000:0.0:1782216860.061416:0:8532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6d5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:8532:1868789712970496:0@lo:502: 00000100:00100000:0.0:1782216860.061454:0:8532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216860.061505:0:8532:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e42c59a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782216860.061535:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712970496 00000100:00100000:2.0:1782216860.061539:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712970496 00000100:00100000:2.0:1782216860.061612:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1782216860.061620:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+18:8532:x1868789712970496:12345-0@lo:502: 00000100:00100000:2.0:1782216860.061694:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+18:8532:x1868789712970496:12345-0@lo:502: Request processed in 75us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216860.061701:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1782216860.061766:0:8532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6d5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:8532:1868789712970496:0@lo:502: 00000040:00080000:0.0:1782216860.061784:0:8532:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1782216860.061830:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1782216860.061850:0:6516:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782216860.061859:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7c449c00/0x92b8e04cbf5f91a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f91ae expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.061868:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e7c449c00/0x92b8e04cbf5f91a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f91ae expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782216860.061877:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1782216860.061880:0:6516:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff952e70905800 from 5 10000000:01000000:0.0:1782216860.061883:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1782216860.061907:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7c449e00/0x92b8e04cbf5f91bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.061916:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e7c449e00/0x92b8e04cbf5f91bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.061924:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e7c449e00/0x92b8e04cbf5f91bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216860.061938:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712970624:0@lo:101: 00000100:00100000:0.0:1782216860.061970:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216860.061987:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e42c59a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782216860.062000:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712970624 00000100:00100000:0.0:1782216860.062003:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712970624 00000100:00100000:0.0:1782216860.062143:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1782216860.062151:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+18:6516:x1868789712970624:12345-0@lo:101: 00010000:00010000:0.0:1782216860.062160:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782216860.062171:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e7c448800/0x92b8e04cbf5f91c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f91bc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.062191:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e7c448800/0x92b8e04cbf5f91c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f91bc expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.062201:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e7c448800/0x92b8e04cbf5f91c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f91bc expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.062209:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7c448800, rc 0) 00000100:00100000:0.0:1782216860.062238:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+19:6516:x1868789712970624:12345-0@lo:101: Request processed in 88us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216860.062244:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1782216860.062276:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712970624:0@lo:101: 00010000:00010000:0.0:1782216860.062288:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e7c449e00/0x92b8e04cbf5f91bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f91c3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.062296:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e7c449e00/0x92b8e04cbf5f91bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f91c3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216860.062336:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712970752:0@lo:256: 00000100:00100000:0.0:1782216860.062367:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216860.062381:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e42c59a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782216860.062391:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712970752 00000100:00100000:0.0:1782216860.062395:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712970752 00000100:00100000:0.0:1782216860.062415:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1782216860.062426:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e190850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+19:6516:x1868789712970752:12345-0@lo:256: 20000000:01000000:0.0:1782216860.062439:0:6514:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1782216860.062451:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1782216860.062454:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1782216860.062520:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e190850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+19:6516:x1868789712970752:12345-0@lo:256: Request processed in 94us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216860.062527:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1782216860.062557:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712970752:0@lo:256: 00000100:00100000:3.0:1782216860.063207:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1868789712968960:12345-0@lo:8: Request processed in 3982us (7900us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216860.063216:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1782216860.063354:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952e72e8f480 x1868789712968960/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782216870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216860.063365:0:3646:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1782216860.063372:0:3646:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1782216860.063380:0:3646:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1782216860.063386:0:3646:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1782216860.063389:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952d4245f800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1782216860.063402:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1782216860.063408:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e72e8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1868789712968960:0@lo:8: 00000004:00080000:3.0:1782216860.063440:0:8530:0:(osp_sync.c:1060:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1782216860.063511:0:8530:0:(osp_sync.c:1862:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 223046927506ns, next at 0ns, rc = 0 00080000:00080000:3.0:1782216860.063517:0:8530:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 10000000:01000000:0.0:1782216860.063697:0:6516:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1782216860.063706:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7c449e00/0x92b8e04cbf5f91bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f91c3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.063715:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e7c449e00/0x92b8e04cbf5f91bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f91c3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782216860.063723:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1782216860.063726:0:6516:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1782216860.063728:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1782216860.063753:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7c448600/0x92b8e04cbf5f91ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.063760:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e7c448600/0x92b8e04cbf5f91ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.063769:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e7c448600/0x92b8e04cbf5f91ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216860.063783:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712970880:0@lo:101: 00000100:00100000:0.0:1782216860.063820:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216860.063854:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e42c59a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782216860.063868:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712970880 00000100:00100000:0.0:1782216860.063873:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712970880 00000100:00100000:0.0:1782216860.063901:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1782216860.063909:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+19:6516:x1868789712970880:12345-0@lo:101: 00010000:00010000:0.0:1782216860.063918:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782216860.063928:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e7c448000/0x92b8e04cbf5f91d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f91ca expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.063945:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e7c448000/0x92b8e04cbf5f91d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f91ca expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.063953:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e7c448000/0x92b8e04cbf5f91d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f91ca expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.063960:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7c448000, rc 0) 00000100:00100000:0.0:1782216860.063988:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+20:6516:x1868789712970880:12345-0@lo:101: Request processed in 80us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216860.063994:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1782216860.064027:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712970880:0@lo:101: 00000100:00100000:2.0:1782216860.064109:0:8531:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41bf9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8531:1868789712971008:0@lo:700: 00000100:00100000:2.0:1782216860.064138:0:8531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216860.064163:0:8531:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d422793c0 going to sleep for 11 seconds 00010000:00010000:0.0:1782216860.064191:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e7c448600/0x92b8e04cbf5f91ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f91d1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.064201:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e7c448600/0x92b8e04cbf5f91ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f91d1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216860.064250:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712971136:0@lo:501: 00000100:00100000:0.0:1782216860.064271:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216860.064291:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e42c59a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782216860.064576:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712971136 00000100:00100000:2.0:1782216860.064605:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712971136 00000100:00100000:2.0:1782216860.064637:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1782216860.064643:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+20:6516:x1868789712971136:12345-0@lo:501: 00000100:00100000:2.0:1782216860.064749:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+20:6516:x1868789712971136:12345-0@lo:501: Request processed in 106us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216860.064756:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1782216860.064831:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712971136:0@lo:501: 00000100:00100000:0.0:1782216860.064857:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712971264:0@lo:503: 00000100:00100000:0.0:1782216860.064896:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216860.064916:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e42c59a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782216860.064956:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712971264 00000100:00100000:2.0:1782216860.064960:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712971264 00000100:00100000:2.0:1782216860.064987:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1782216860.064994:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+20:6516:x1868789712971264:12345-0@lo:503: 00000100:00100000:2.0:1782216860.065082:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+20:6516:x1868789712971264:12345-0@lo:503: Request processed in 88us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216860.065089:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1782216860.065232:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712971008 00000100:00100000:3.0:1782216860.065237:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712971008 00000100:00100000:3.0:1782216860.065278:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782216860.065286:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8531:x1868789712971008:12345-0@lo:700: 00000100:00100000:3.0:1782216860.065318:0:8441:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be5880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8441:1868789712971392:0@lo:700: 00000100:00100000:3.0:1782216860.065351:0:8441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216860.065384:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712971264:0@lo:503: 00000100:00100000:3.0:1782216860.065529:0:8441:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e7c7d1840 going to sleep for 11 seconds 00000100:00100000:0.0:1782216860.065572:0:8533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6d5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:8533:1868789712971520:0@lo:502: 00000100:00100000:0.0:1782216860.065635:0:8533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216860.065658:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712971520 00000100:00100000:0.0:1782216860.065662:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712971520 00000100:00100000:0.0:1782216860.065692:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1782216860.065699:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+20:8533:x1868789712971520:12345-0@lo:502: 00000100:00100000:0.0:1782216860.065771:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+20:8533:x1868789712971520:12345-0@lo:502: Request processed in 72us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216860.065777:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1782216860.065814:0:8533:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e42c599c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782216860.065825:0:8533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6d5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:8533:1868789712971520:0@lo:502: 00000020:01000000:0.0:1782216860.065846:0:8533:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1782216860.065852:0:8533:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1782216860.065858:0:8533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782216860.065860:0:8533:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1782216860.065863:0:8533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1782216860.065867:0:8533:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:01000000:0.0:1782216860.065887:0:8533:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1782216860.065890:0:8533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1782216860.065903:0:8533:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff952e74c80000) 00000020:00000080:0.0:1782216860.065923:0:8533:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:0.0:1782216860.065935:0:8533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1782216860.066004:0:8533:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1782216860.066009:0:8533:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:0.0:1782216860.066016:0:8533:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x92b8e04cbf5f91df 00000100:00100000:2.0:1782216860.066127:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712971392 00000100:00100000:2.0:1782216860.066132:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712971392 00000100:00100000:2.0:1782216860.066159:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782216860.066165:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8441:x1868789712971392:12345-0@lo:700: 00010000:00080000:0.0:1782216860.066292:0:8533:0:(ldlm_lib.c:102:import_set_conn()) imp ffff952e7c6c9800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.130@tcp at head 00010000:00010000:0.0:1782216860.066521:0:8533:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000100:00080000:2.0:1782216860.066637:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782216860.066642:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782216860.066645:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1782216860.067254:0:7451:0:(osp_sync.c:1827:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 40000000:02000000:1.0:1782216860.078995:0:6525:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000040:01000000:0.0:1782216860.079561:0:8533:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1782216860.079593:0:8533:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1782216860.079793:0:8533:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782216860.080076:0:8533:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782216860.080166:0:8533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1782216860.080782:0:8533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1782216860.081707:0:8536:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782216860.081712:0:8536:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1782216860.082375:0:8533:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1782216860.082386:0:8533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1782216860.082432:0:8533:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1782216860.082455:0:8533:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x92b8e04cbf5f91e6 00000100:00080000:2.0:1782216860.082466:0:8533:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782216860.082473:0:8533:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff952e7c6c9800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1782216860.082505:0:8533:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff952d41bf9180 x1868789712971648/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782216860.082533:0:8533:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1782216860.082605:0:8533:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782216860.082610:0:8533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782216860.082612:0:8533:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1782216860.082615:0:8533:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782216860.082619:0:8533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782216860.082620:0:8533:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:2.0:1782216860.082623:0:8533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1782216860.082625:0:8533:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1782216860.082650:0:8533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41bf9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:8533:1868789712971776:0@lo:502: 00000100:00100000:2.0:1782216860.082729:0:8533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216860.082766:0:8533:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e64b92600 going to sleep for 11 seconds 00000100:00100000:0.0:1782216860.082903:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41bf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1868789712971648:0@lo:8: 00000100:00100000:0.0:1782216860.082939:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216860.083004:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712971776 00000100:00100000:0.0:1782216860.083010:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712971776 00000100:00100000:0.0:1782216860.083059:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1782216860.083068:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e192050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+20:8533:x1868789712971776:12345-0@lo:502: 00000100:00100000:0.0:1782216860.083191:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e192050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+20:8533:x1868789712971776:12345-0@lo:502: Request processed in 123us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216860.083198:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1782216860.083253:0:8533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41bf9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:8533:1868789712971776:0@lo:502: 00000020:01000000:0.0:1782216860.083279:0:8533:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782216860.083284:0:8533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782216860.083286:0:8533:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:0.0:1782216860.083289:0:8533:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1782216860.083339:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1782216860.083358:0:6516:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1782216860.083367:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7c448600/0x92b8e04cbf5f91ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f91d1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.083384:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e7c448600/0x92b8e04cbf5f91ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f91d1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782216860.083393:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1782216860.083395:0:6516:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff952e5021b380 from 1 10000000:01000000:0.0:1782216860.083398:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1782216860.083555:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7c449200/0x92b8e04cbf5f91ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.083565:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e7c449200/0x92b8e04cbf5f91ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.083574:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e7c449200/0x92b8e04cbf5f91ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216860.083608:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6d6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712971904:0@lo:101: 00000100:00100000:0.0:1782216860.083636:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216860.083657:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e42c59900 going to sleep for 11 seconds 00000100:00100000:0.0:1782216860.083669:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712971904 00000100:00100000:0.0:1782216860.083672:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712971904 00000100:00100000:0.0:1782216860.083695:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1782216860.083701:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e190450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+20:6516:x1868789712971904:12345-0@lo:101: 00010000:00010000:0.0:1782216860.083710:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782216860.083721:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e7c449400/0x92b8e04cbf5f91f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f91ed expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.083739:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e7c449400/0x92b8e04cbf5f91f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f91ed expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.083760:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e7c449400/0x92b8e04cbf5f91f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f91ed expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.083768:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7c449400, rc 0) 00000100:00100000:0.0:1782216860.083797:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e190450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:6516:x1868789712971904:12345-0@lo:101: Request processed in 96us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216860.083803:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1782216860.083833:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6d6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712971904:0@lo:101: 00010000:00010000:0.0:1782216860.083844:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e7c449200/0x92b8e04cbf5f91ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f91f4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.083852:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e7c449200/0x92b8e04cbf5f91ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f91f4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216860.083892:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6d6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712972032:0@lo:501: 00000100:00100000:0.0:1782216860.083914:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216860.083925:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d42279480 going to sleep for 11 seconds 00000100:00100000:0.0:1782216860.083935:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712972032 00000100:00100000:0.0:1782216860.083938:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712972032 00000100:00100000:2.0:1782216860.084202:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712971648 00000100:00100000:2.0:1782216860.084207:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712971648 00000100:00100000:2.0:1782216860.084230:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782216860.084235:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3646:x1868789712971648:12345-0@lo:8: 00010000:00080000:2.0:1782216860.084258:0:8435:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 223 last 0 00000020:00000080:2.0:1782216860.084282:0:8435:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x92b8e04cbf5f91fb 00002000:00100000:2.0:1782216860.084295:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff952d42004000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1782216860.084305:0:8435:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1782216860.084308:0:8435:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1782216860.084373:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1782216860.084395:0:8435:0:(import.c:65:import_set_state_nolock()) ffff952d42003800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782216860.084450:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1868789712971648:12345-0@lo:8: Request processed in 213us (1509us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216860.084457:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782216860.084610:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1782216860.084618:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e193450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:6516:x1868789712972032:12345-0@lo:501: 00000100:00100000:0.0:1782216860.084683:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e193450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:6516:x1868789712972032:12345-0@lo:501: Request processed in 66us (768us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782216860.084690:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00010000:00080000:0.0:1782216860.084724:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952d41bf9180 x1868789712971648/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782216870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216860.084747:0:3646:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782216860.084753:0:3646:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1782216860.084761:0:3646:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1782216860.084766:0:3646:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1782216860.084769:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952e7c6c9800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1782216860.084780:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1782216860.084786:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41bf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1868789712971648:0@lo:8: 00000100:00100000:0.0:1782216860.084813:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6d6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712972032:0@lo:501: 10000000:01000000:0.0:1782216860.084834:0:6516:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1782216860.084841:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7c449200/0x92b8e04cbf5f91ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f91f4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216860.084850:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e7c449200/0x92b8e04cbf5f91ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f91f4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782216860.085839:0:8536:0:(osp_sync.c:1060:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1782216860.085907:0:8536:0:(osp_sync.c:1862:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 223069324105ns, next at 0ns, rc = 0 00080000:00080000:2.0:1782216860.085915:0:8536:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1782216860.091811:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8441:x1868789712971392:12345-0@lo:700: Request processed in 25635us (26449us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216860.091827:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1782216860.091889:0:8441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952d41be5880 x1868789712971392/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1782216876 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216860.091906:0:8441:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be5880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8441:1868789712971392:0@lo:700: 40000000:02000000:1.0:1782216860.091936:0:8441:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000004:00080000:2.0:1782216860.098110:0:6498:0:(osp_sync.c:1827:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:0.0:1782216860.098530:0:8537:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1782216860.098561:0:8537:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6d6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8537:1868789712972288:0@lo:7: 00000100:00100000:3.0:1782216860.098628:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782216860.098646:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789712972160:0@lo:13: 00000100:00100000:0.0:1782216860.098651:0:8537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216860.098682:0:8537:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d42279480 going to sleep for 11 seconds 00000100:00100000:3.0:1782216860.098722:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216860.098761:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712972288 00000100:00100000:3.0:1782216860.098767:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712972288 00000100:00100000:0.0:1782216860.098794:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712972160 00000100:00100000:0.0:1782216860.098800:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712972160 00000100:00100000:3.0:1782216860.098830:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782216860.098841:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:8537:x1868789712972288:12345-0@lo:7: 00000100:00100000:0.0:1782216860.098845:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782216860.098856:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1868789712972160:12345-0@lo:13: 00002000:00000024:0.0:1782216860.098879:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:0.0:1782216860.098929:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1868789712972160:12345-0@lo:13: Request processed in 74us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216860.098945:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00100000:1.0:1782216860.103449:0:8428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1782216860.103457:0:8428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1782216860.103630:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8531:x1868789712971008:12345-0@lo:700: Request processed in 38340us (39486us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216860.103648:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1782216860.103697:0:8531:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952d41bf9c00 x1868789712971008/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1782216876 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216860.103711:0:8531:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41bf9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8531:1868789712971008:0@lo:700: 00000100:00080000:2.0:1782216860.104743:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:3.0:1782216860.106523:0:8432:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1782216860.106534:0:8432:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1782216860.107539:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8537:x1868789712972288:12345-0@lo:7: Request processed in 8693us (8884us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216860.107552:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1782216860.107639:0:8537:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952e7c6d6a00 x1868789712972288/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1782216876 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1782216860.107652:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952e7c6d6d80 x1868789712972160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216876 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216860.107659:0:8537:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6d6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8537:1868789712972288:0@lo:7: 00000100:00100000:3.0:1782216860.107678:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789712972160:0@lo:13: 00000004:00080000:2.0:1782216860.107678:0:8537:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1782216860.107731:0:8537:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41bf9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8537:1868789712972416:0@lo:5: 00000100:00100000:2.0:1782216860.107770:0:8537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216860.107815:0:8537:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e64b92300 going to sleep for 11 seconds 00000100:00100000:3.0:1782216860.108216:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712972416 00000100:00100000:3.0:1782216860.108225:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712972416 00000100:00100000:3.0:1782216860.108274:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782216860.108283:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8537:x1868789712972416:12345-0@lo:5: 00002000:00080000:3.0:1782216860.108311:0:8434:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1782216860.108330:0:8434:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1782216860.108843:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8537:x1868789712972416:12345-0@lo:5: Request processed in 560us (1071us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1782216860.108851:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1782216860.108997:0:8537:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952d41bf9c00 x1868789712972416/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782216876 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216860.109024:0:8537:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41bf9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8537:1868789712972416:0@lo:5: 00000004:00080000:2.0:1782216860.109036:0:8537:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1782216860.109075:0:8537:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41bfb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8537:1868789712972544:0@lo:700: 00000100:00100000:2.0:1782216860.109105:0:8537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216860.109212:0:8537:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e64b92300 going to sleep for 11 seconds 00000100:00100000:3.0:1782216860.110208:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712972544 00000100:00100000:3.0:1782216860.110218:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712972544 00000100:00100000:3.0:1782216860.110389:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782216860.110399:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:8537:x1868789712972544:12345-0@lo:700: 00000004:00080000:3.0:1782216860.112442:0:8531:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1782216860.112470:0:8531:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8531:1868789712972800:0@lo:7: 00000100:00100000:3.0:1782216860.112537:0:8531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216860.112562:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789712972672:0@lo:13: 00000100:00100000:3.0:1782216860.112615:0:8531:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e7c722e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782216860.112622:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216860.112641:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712972800 00000100:00100000:3.0:1782216860.112649:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712972800 00000100:00100000:0.0:1782216860.112670:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712972672 00000100:00100000:0.0:1782216860.112677:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712972672 00000100:00100000:3.0:1782216860.112699:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782216860.112711:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:8531:x1868789712972800:12345-0@lo:7: 00000100:00100000:0.0:1782216860.112714:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782216860.112727:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1868789712972672:12345-0@lo:13: 00002000:00000024:0.0:1782216860.112743:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:0.0:1782216860.112797:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1868789712972672:12345-0@lo:13: Request processed in 72us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216860.112805:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1782216860.112872:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952d41be4700 x1868789712972672/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216876 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216860.112894:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789712972672:0@lo:13: 00000001:00080000:1.0:1782216860.115767:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00010000:00080000:0.0:1782216860.116229:0:8537:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952d41bfb100 x1868789712972544/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1782216876 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216860.116241:0:8537:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1782216860.116258:0:8537:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41bfb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8537:1868789712972544:0@lo:700: 00000100:00100000:3.0:1782216860.116382:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8537:x1868789712972544:12345-0@lo:700: Request processed in 5982us (7274us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216860.116392:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00002000:00080000:2.0:1782216860.116839:0:8432:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1782216860.116846:0:8432:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1782216860.116909:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8531:x1868789712972800:12345-0@lo:7: Request processed in 4200us (4371us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216860.116918:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1782216860.116944:0:8531:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952d41be6680 x1868789712972800/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1782216876 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216860.116965:0:8531:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8531:1868789712972800:0@lo:7: 00000004:00080000:3.0:1782216860.116974:0:8531:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:3.0:1782216860.117007:0:8531:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8531:1868789712972928:0@lo:5: 00000100:00100000:3.0:1782216860.117050:0:8531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216860.117077:0:8531:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e7c722e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782216860.117179:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712972928 00000100:00100000:2.0:1782216860.117185:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712972928 00000100:00100000:2.0:1782216860.117232:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782216860.117241:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8531:x1868789712972928:12345-0@lo:5: 00002000:00080000:2.0:1782216860.117267:0:8434:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1782216860.117306:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8531:x1868789712972928:12345-0@lo:5: Request processed in 66us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216860.117313:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1782216860.117364:0:8531:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952d41be6680 x1868789712972928/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782216876 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216860.117386:0:8531:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8531:1868789712972928:0@lo:5: 00000004:00080000:3.0:1782216860.117394:0:8531:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1782216860.117415:0:8531:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8531:1868789712973056:0@lo:5: 00000100:00100000:3.0:1782216860.117439:0:8531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216860.117524:0:8531:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e7c722e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782216860.117554:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712973056 00000100:00100000:2.0:1782216860.117559:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712973056 00000100:00100000:2.0:1782216860.117768:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782216860.117776:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8531:x1868789712973056:12345-0@lo:5: 00002000:00080000:2.0:1782216860.117806:0:8432:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1782216860.119412:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:8531:x1868789712973056:12345-0@lo:5: Request processed in 1632us (1967us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1782216860.119421:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1782216860.119633:0:8531:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952d41be6680 x1868789712973056/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782216876 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216860.119647:0:8531:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8531:1868789712973056:0@lo:5: 00000004:00080000:3.0:1782216860.119659:0:8531:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:3.0:1782216860.119693:0:8531:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8531:1868789712973184:0@lo:900: 00000100:00100000:3.0:1782216860.119726:0:8531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216860.119751:0:8531:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e7c722e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782216860.119876:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712973184 00000100:00100000:2.0:1782216860.119882:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712973184 00000100:00100000:2.0:1782216860.119968:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782216860.119977:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8531:x1868789712973184:12345-0@lo:900: 00000100:00100000:2.0:1782216860.120034:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8531:x1868789712973184:12345-0@lo:900: Request processed in 57us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216860.120050:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1782216860.120107:0:8531:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952d41be4700 x1868789712973184/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1782216876 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216860.120116:0:8531:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8531:1868789712973184:0@lo:900: 00000004:02000040:1.0:1782216860.120411:0:8537:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:0.0:1782216860.124484:0:8537:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6d4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8537:1868789712973312:0@lo:5: 00000100:00100000:0.0:1782216860.124560:0:8537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216860.124613:0:8537:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d42279480 going to sleep for 11 seconds 00000100:00100000:2.0:1782216860.124677:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712973312 00000100:00100000:2.0:1782216860.124685:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712973312 00000100:00100000:2.0:1782216860.124880:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782216860.124891:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8537:x1868789712973312:12345-0@lo:5: 00002000:00080000:2.0:1782216860.129577:0:8432:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1782216860.129652:0:8432:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:2.0:1782216860.132216:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8537:x1868789712973312:12345-0@lo:5: Request processed in 7321us (7650us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1782216860.132229:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1782216860.132942:0:8537:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952e7c6d4380 x1868789712973312/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782216876 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216860.132962:0:8537:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6d4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8537:1868789712973312:0@lo:5: 00000004:00080000:0.0:1782216860.132988:0:8537:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:0.0:1782216860.154822:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782216860.734298:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789712973440:0@lo:41: 00000100:00100000:1.0:1782216860.734365:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216860.734428:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712973440 00000100:00100000:1.0:1782216860.734435:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712973440 00000100:00100000:1.0:1782216860.734477:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782216860.734485:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b09d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789712973440:12345-0@lo:41: 00000004:00000024:1.0:1782216860.734516:0:7938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1782216860.734551:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b09d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789712973440:12345-0@lo:41: Request processed in 67us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216860.734558:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782216860.734628:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789712973440:0@lo:41: 00010000:00010000:2.0:1782216861.178972:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782216861.752904:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41bf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789712973568:0@lo:41: 00000100:00100000:3.0:1782216861.752989:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216861.753348:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712973568 00000100:00100000:1.0:1782216861.753356:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712973568 00000100:00100000:1.0:1782216861.753410:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782216861.753419:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789712973568:12345-0@lo:41: 00000004:00000024:1.0:1782216861.753452:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1782216861.753505:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789712973568:12345-0@lo:41: Request processed in 87us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216861.753512:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782216861.753847:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41bf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789712973568:0@lo:41: 00010000:00010000:0.0:1782216862.202361:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216863.227712:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782216864.250669:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782216865.001547:0:8809:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1782216865.273613:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782216865.336713:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17bce19a-7a0f-4c9d-b31c-4e0155298487:3650:1868789712973696:0@lo:400: 00000100:00100000:3.0:1782216865.336759:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789712974080:0@lo:400: 00000100:00100000:0.0:1782216865.336785:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216865.336800:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216865.336830:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1868789712974592:0@lo:400: 00000100:00100000:0.0:1782216865.336839:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1868789712974208:0@lo:400: 00000100:00100000:3.0:1782216865.336865:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216865.336894:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789712973824:0@lo:13: 00000100:00100000:0.0:1782216865.336982:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216865.338067:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789712974336:0@lo:400: 00000100:00100000:3.0:1782216865.338074:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712974080 00000100:00100000:0.0:1782216865.338104:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216865.338121:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789712974848:0@lo:400: 00000100:00100000:3.0:1782216865.338140:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712974080 00000100:00100000:0.0:1782216865.338145:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216865.338167:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782216865.338174:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1868789712973952:0@lo:400: 00000100:00100000:3.0:1782216865.338187:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712974336 00000100:00100000:3.0:1782216865.338192:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712974336 00000100:00100000:0.0:1782216865.338201:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216865.338221:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782216865.338230:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46db1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789712974080:12345-0@lo:400: 00000100:00100000:3.0:1782216865.338285:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46db1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789712974080:12345-0@lo:400: Request processed in 56us (1485us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216865.338294:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782216865.338314:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1782216865.338321:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789712974336:12345-0@lo:400: 00000100:00100000:3.0:1782216865.338351:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789712974336:12345-0@lo:400: Request processed in 30us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216865.338358:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1782216865.338375:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789712974080:0@lo:400: 00000100:00100000:0.0:1782216865.338433:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1868789712974464:0@lo:400: 00000100:00100000:0.0:1782216865.338455:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216865.338485:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789712974336:0@lo:400: 00000100:00100000:0.0:1782216865.338512:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712973696 00000100:00100000:0.0:1782216865.338515:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712973696 00000100:00100000:0.0:1782216865.338549:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1782216865.338556:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e191850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:3650:x1868789712973696:12345-0@lo:400: 00000100:00100000:0.0:1782216865.338607:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e191850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:3650:x1868789712973696:12345-0@lo:400: Request processed in 51us (1824us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216865.338624:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1782216865.338650:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712974592 00000100:00100000:0.0:1782216865.338654:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712974592 00000100:00100000:0.0:1782216865.338685:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712973952 00000100:00100000:0.0:1782216865.338689:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712973952 00000100:00100000:0.0:1782216865.338700:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712974464 00000100:00100000:0.0:1782216865.338702:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712974464 00000100:00100000:0.0:1782216865.338714:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782216865.338720:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46db3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1868789712974592:12345-0@lo:400: 00000100:00100000:0.0:1782216865.338756:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46db3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1868789712974592:12345-0@lo:400: Request processed in 36us (1891us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216865.338762:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782216865.338773:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782216865.338779:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1868789712973952:12345-0@lo:400: 00000100:00100000:0.0:1782216865.338808:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1868789712973952:12345-0@lo:400: Request processed in 28us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216865.338814:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782216865.338823:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782216865.338828:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1868789712974464:12345-0@lo:400: 00000100:00100000:0.0:1782216865.338850:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1868789712974464:12345-0@lo:400: Request processed in 22us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216865.338856:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782216865.339650:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712973824 00000100:00100000:0.0:1782216865.339659:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712973824 00000100:00100000:0.0:1782216865.339729:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782216865.339738:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1868789712973824:12345-0@lo:13: 00002000:00000024:0.0:1782216865.339774:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782216865.339818:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1868789712973824:12345-0@lo:13: Request processed in 82us (2899us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216865.339825:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782216865.342566:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712974848 00000100:00100000:0.0:1782216865.342577:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712974848 00000100:00100000:2.0:1782216865.342689:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216865.342729:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789712974720:0@lo:400: 00000100:00100000:2.0:1782216865.342776:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216865.342815:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17bce19a-7a0f-4c9d-b31c-4e0155298487:3650:1868789712973696:0@lo:400: 00000100:00100000:0.0:1782216865.343367:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712974720 00000100:00100000:0.0:1782216865.343371:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712974720 00000100:00100000:0.0:1782216865.343389:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782216865.343397:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1868789712974848:12345-0@lo:400: 00000100:00100000:0.0:1782216865.343443:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1868789712974848:12345-0@lo:400: Request processed in 46us (5300us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216865.343449:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782216865.343463:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782216865.343468:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3650:x1868789712974720:12345-0@lo:400: 00000100:00100000:0.0:1782216865.343495:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3650:x1868789712974720:12345-0@lo:400: Request processed in 26us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216865.343501:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1782216865.343516:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782216865.343520:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782216865.343523:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782216865.343531:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712974208 00000100:00100000:0.0:1782216865.343534:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712974208 00000100:00100000:0.0:1782216865.343555:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782216865.343561:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1868789712974208:12345-0@lo:400: 00000100:00100000:0.0:1782216865.343603:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1868789712974208:12345-0@lo:400: Request processed in 42us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216865.343610:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1782216865.343643:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952d41be7100 x1868789712974208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216865.343661:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1868789712974208:0@lo:400: 00010000:00080000:0.0:1782216865.343676:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952d41be6300 x1868789712974720/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216865.343686:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789712974720:0@lo:400: 00010000:00080000:0.0:1782216865.343719:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952d41be4000 x1868789712974592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216865.343728:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1868789712974592:0@lo:400: 00010000:00080000:0.0:1782216865.343753:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952d41be5f80 x1868789712973952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216865.343762:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1868789712973952:0@lo:400: 00010000:00080000:0.0:1782216865.343772:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952d41be5500 x1868789712974464/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216865.343779:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1868789712974464:0@lo:400: 00010000:00080000:0.0:1782216865.343789:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952e7c6d4700 x1868789712973824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216881 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216865.343801:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789712973824:0@lo:13: 00010000:00080000:0.0:1782216865.343810:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952d41be4700 x1868789712974848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216865.343817:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789712974848:0@lo:400: 00000100:00100000:0.0:1782216865.343833:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782216865.343840:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41bf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789712974976:0@lo:13: 00000100:00100000:0.0:1782216865.343872:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216865.343999:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712974976 00000100:00100000:3.0:1782216865.344015:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712974976 00000100:00100000:3.0:1782216865.344044:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782216865.344053:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1868789712974976:12345-0@lo:13: 00002000:00000024:3.0:1782216865.344068:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782216865.344118:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1868789712974976:12345-0@lo:13: Request processed in 66us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216865.344125:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1782216865.344503:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952d41bf9f80 x1868789712974976/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216881 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216865.344518:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41bf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789712974976:0@lo:13: 00000100:00100000:0.0:1782216865.850361:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782216865.850386:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789712975104:0@lo:41: 00000100:00100000:0.0:1782216865.850453:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216865.850619:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712975104 00000100:00100000:2.0:1782216865.850628:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712975104 00000100:00100000:2.0:1782216865.850675:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782216865.850683:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72e8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789712975104:12345-0@lo:41: 00000004:00000024:2.0:1782216865.850715:0:7938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1782216865.850762:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72e8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789712975104:12345-0@lo:41: Request processed in 79us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216865.850769:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782216865.850811:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789712975104:0@lo:41: 00000001:00080000:1.0:1782216865.856846:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00080000:1.0:1782216865.856866:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000020:00000004:1.0:1782216865.928825:0:8861:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782216865.929049:0:8861:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1782216866.303157:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216866.877959:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782216866.877985:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41bf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789712975232:0@lo:41: 00000100:00100000:2.0:1782216866.878061:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216866.878124:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712975232 00000100:00100000:2.0:1782216866.878131:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712975232 00000100:00100000:2.0:1782216866.878189:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1782216866.878199:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789712975232:12345-0@lo:41: 00000004:00000024:2.0:1782216866.878232:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1782216866.878276:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789712975232:12345-0@lo:41: Request processed in 78us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216866.878283:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1782216866.878711:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41bf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789712975232:0@lo:41: 00010000:00010000:1.0:1782216867.321327:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782216868.347555:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1782216868.946864:0:8962:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1782216868.947098:0:8962:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1782216869.369841:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1782216869.960471:0:9011:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782216869.960481:0:9011:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:0.0:1782216870.392712:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782216870.457266:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782216870.457297:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e72e8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789712975360:0@lo:13: 00000100:00100000:3.0:1782216870.457364:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216870.457646:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712975360 00000100:00100000:1.0:1782216870.457654:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712975360 00000100:00100000:2.0:1782216870.457668:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e72e8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1868789712975616:0@lo:400: 00000100:00100000:3.0:1782216870.457730:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e72e8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17bce19a-7a0f-4c9d-b31c-4e0155298487:3648:1868789712975488:0@lo:400: 00000100:00100000:3.0:1782216870.457759:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216870.457800:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216870.465554:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782216870.465576:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46db2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789712975360:12345-0@lo:13: 00002000:00000024:1.0:1782216870.465626:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782216870.465773:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46db2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789712975360:12345-0@lo:13: Request processed in 139us (8339us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216870.465783:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1782216870.466516:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782216870.466544:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e72e8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1868789712975872:0@lo:400: 00000100:00100000:1.0:1782216870.466609:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216870.467775:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712975616 00000100:00100000:0.0:1782216870.467786:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712975616 00000100:00100000:0.0:1782216870.467834:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712975872 00000100:00100000:0.0:1782216870.467837:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712975872 00000100:00100000:0.0:1782216870.467856:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782216870.467863:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1868789712975616:12345-0@lo:400: 00000100:00100000:0.0:1782216870.467936:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1868789712975616:12345-0@lo:400: Request processed in 73us (10135us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216870.467944:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782216870.467960:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782216870.467975:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b09c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1868789712975872:12345-0@lo:400: 00000100:00100000:0.0:1782216870.468001:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b09c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1868789712975872:12345-0@lo:400: Request processed in 36us (1393us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216870.468007:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782216870.468310:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712975488 00000100:00100000:0.0:1782216870.468315:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712975488 00000100:00100000:0.0:1782216870.468355:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1782216870.468362:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e58053450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:3648:x1868789712975488:12345-0@lo:400: 00000100:00100000:0.0:1782216870.468394:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e58053450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:3648:x1868789712975488:12345-0@lo:400: Request processed in 33us (10634us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216870.468400:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1782216870.469264:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e72e8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789712975744:0@lo:400: 00000100:00100000:2.0:1782216870.469311:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216870.469353:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712975744 00000100:00100000:1.0:1782216870.469359:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712975744 00000100:00100000:1.0:1782216870.469391:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1782216870.469398:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789712975744:12345-0@lo:400: 00000100:00100000:1.0:1782216870.469435:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789712975744:12345-0@lo:400: Request processed in 37us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216870.469442:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1782216870.470198:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e72e8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17bce19a-7a0f-4c9d-b31c-4e0155298487:3648:1868789712975488:0@lo:400: 00000100:00100000:3.0:1782216870.470210:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789712976000:0@lo:400: 00000100:00100000:3.0:1782216870.470242:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216870.470273:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41bf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789712976512:0@lo:13: 00000100:00100000:3.0:1782216870.470294:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1782216870.470330:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952e72e8ea00 x1868789712975360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216886 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216870.470340:0:3648:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1782216870.470359:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e72e8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789712975360:0@lo:13: 00010000:00080000:3.0:1782216870.470407:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952e72e8c000 x1868789712975616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216870.470518:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e72e8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789712975744:0@lo:400: 00000100:00100000:2.0:1782216870.470526:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1868789712976256:0@lo:400: 00000100:00100000:2.0:1782216870.470549:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216870.470593:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712976256 00000100:00100000:2.0:1782216870.470598:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712976256 00000100:00100000:2.0:1782216870.470634:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1782216870.470641:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1868789712976256:12345-0@lo:400: 00000100:00100000:2.0:1782216870.470677:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1868789712976256:12345-0@lo:400: Request processed in 36us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216870.470683:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1782216870.470709:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952e7c6f3800 x1868789712976256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216870.470719:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1868789712976256:0@lo:400: 00000100:00100000:0.0:1782216870.470977:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712976000 00000100:00100000:0.0:1782216870.470981:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712976000 00000100:00100000:0.0:1782216870.471015:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1782216870.471023:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46db1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789712976000:12345-0@lo:400: 00000100:00100000:0.0:1782216870.471233:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46db1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789712976000:12345-0@lo:400: Request processed in 210us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216870.471240:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1782216870.471307:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782216870.471319:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712976512 00000100:00100000:1.0:1782216870.471322:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712976512 00000100:00100000:1.0:1782216870.471357:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782216870.471364:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46db0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789712976512:12345-0@lo:13: 00002000:00000024:1.0:1782216870.471385:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782216870.471412:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46db0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789712976512:12345-0@lo:13: Request processed in 49us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216870.471507:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e72e8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1868789712975616:0@lo:400: 00000100:00100000:3.0:1782216870.471518:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1868789712976128:0@lo:400: 00000100:00100000:3.0:1782216870.471542:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216870.471564:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712976128 00000100:00100000:3.0:1782216870.471567:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712976128 00000100:00100000:3.0:1782216870.471603:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782216870.471608:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46db3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1868789712976128:12345-0@lo:400: 00000100:00100000:3.0:1782216870.471638:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46db3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1868789712976128:12345-0@lo:400: Request processed in 26us (91us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216870.471644:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782216870.471669:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789712976000:0@lo:400: 00010000:00080000:3.0:1782216870.471679:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952d41bf9180 x1868789712976512/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216886 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216870.471688:0:3648:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1782216870.471699:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41bf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789712976512:0@lo:13: 00010000:00080000:3.0:1782216870.471721:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952e7c6f2680 x1868789712976128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216870.471737:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1868789712976128:0@lo:400: 00000100:00100000:1.0:1782216870.471955:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1782216870.471998:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952e72e8c700 x1868789712975872/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216870.472007:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e72e8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1868789712975872:0@lo:400: 00000100:00100000:1.0:1782216870.472014:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789712976384:0@lo:400: 00000100:00100000:1.0:1782216870.472559:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1782216870.472661:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782216870.472666:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782216870.472705:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712976384 00000100:00100000:2.0:1782216870.472711:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712976384 00000100:00100000:2.0:1782216870.472750:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782216870.472758:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b09ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789712976384:12345-0@lo:400: 00000100:00100000:2.0:1782216870.472795:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b09ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789712976384:12345-0@lo:400: Request processed in 38us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216870.472801:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1782216870.472828:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952e7c6f0a80 x1868789712976384/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216870.472838:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789712976384:0@lo:400: 00000100:00100000:2.0:1782216870.974369:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782216870.974416:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41bf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789712976640:0@lo:41: 00000100:00100000:2.0:1782216870.974524:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216870.981973:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712976640 00000100:00100000:0.0:1782216870.981996:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712976640 00000100:00100000:0.0:1782216870.982098:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1782216870.982110:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789712976640:12345-0@lo:41: 00000004:00000024:0.0:1782216870.982160:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1782216870.982277:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789712976640:12345-0@lo:41: Request processed in 168us (7753us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216870.982286:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1782216870.982519:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41bf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789712976640:0@lo:41: 00010000:00010000:3.0:1782216871.416761:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782216871.993608:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782216871.993642:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41bf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789712976768:0@lo:41: 00000100:00100000:0.0:1782216871.993741:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216871.994017:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712976768 00000100:00100000:2.0:1782216871.994027:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712976768 00000100:00100000:2.0:1782216871.994099:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1782216871.994111:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789712976768:12345-0@lo:41: 00000004:00000024:2.0:1782216871.994155:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1782216871.994209:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789712976768:12345-0@lo:41: Request processed in 100us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216871.994217:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1782216871.994371:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41bf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789712976768:0@lo:41: 00010000:00010000:1.0:1782216872.441806:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216873.465319:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216874.489421:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216875.514800:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782216875.577125:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b09c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1868789712977024:0@lo:400: 00000100:00100000:1.0:1782216875.577196:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216875.577243:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1868789712977536:0@lo:400: 00000100:00100000:1.0:1782216875.577265:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216875.577293:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1782216875.577299:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b09d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17bce19a-7a0f-4c9d-b31c-4e0155298487:3648:1868789712976896:0@lo:400: 00000100:00100000:1.0:1782216875.577328:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216875.577356:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789712977408:0@lo:400: 00000100:00100000:1.0:1782216875.577378:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216875.577394:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789712977920:0@lo:400: 00000100:00100000:1.0:1782216875.577419:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216875.577444:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b09e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789712977152:0@lo:400: 00000100:00100000:1.0:1782216875.577465:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216875.577482:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1868789712977664:0@lo:400: 00000100:00100000:1.0:1782216875.577512:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216875.577530:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1782216875.577537:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1868789712977280:0@lo:400: 00000100:00100000:1.0:1782216875.577556:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216875.577570:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789712977792:0@lo:400: 00000100:00100000:1.0:1782216875.577654:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216875.577689:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712977024 00000100:00100000:1.0:1782216875.577697:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712977024 00000100:00100000:1.0:1782216875.577743:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712977536 00000100:00100000:1.0:1782216875.577746:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712977536 00000100:00100000:1.0:1782216875.577769:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712977664 00000100:00100000:1.0:1782216875.577772:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712977664 00000100:00100000:1.0:1782216875.577783:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712977280 00000100:00100000:1.0:1782216875.577785:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712977280 00000100:00100000:1.0:1782216875.577800:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1782216875.577808:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d410b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1868789712977024:12345-0@lo:400: 00000100:00100000:1.0:1782216875.578078:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d410b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1868789712977024:12345-0@lo:400: Request processed in 269us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216875.578086:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1782216875.578105:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1782216875.578112:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d410b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1868789712977536:12345-0@lo:400: 00000100:00100000:1.0:1782216875.578141:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d410b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1868789712977536:12345-0@lo:400: Request processed in 31us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216875.578147:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1782216875.578159:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782216875.578165:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d410b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1868789712977664:12345-0@lo:400: 00000100:00100000:1.0:1782216875.578195:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d410b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1868789712977664:12345-0@lo:400: Request processed in 31us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216875.578206:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782216875.578217:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782216875.578222:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d410b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1868789712977280:12345-0@lo:400: 00000100:00100000:1.0:1782216875.578246:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d410b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1868789712977280:12345-0@lo:400: Request processed in 24us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216875.578251:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782216875.578273:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712977408 00000100:00100000:1.0:1782216875.578277:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712977408 00000100:00100000:1.0:1782216875.578300:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712977152 00000100:00100000:1.0:1782216875.578303:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712977152 00000100:00100000:1.0:1782216875.578314:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1782216875.578319:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d410b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789712977408:12345-0@lo:400: 00000100:00100000:1.0:1782216875.578348:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d410b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789712977408:12345-0@lo:400: Request processed in 28us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216875.578353:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1782216875.578365:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1782216875.578371:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d410b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789712977152:12345-0@lo:400: 00000100:00100000:1.0:1782216875.578397:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d410b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789712977152:12345-0@lo:400: Request processed in 26us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216875.578402:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1782216875.578420:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712977920 00000100:00100000:1.0:1782216875.578423:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712977920 00000100:00100000:1.0:1782216875.578443:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712977792 00000100:00100000:1.0:1782216875.578445:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712977792 00000100:00100000:1.0:1782216875.578457:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782216875.578462:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d410b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789712977920:12345-0@lo:400: 00000100:00100000:1.0:1782216875.578488:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d410b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789712977920:12345-0@lo:400: Request processed in 26us (1068us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216875.578500:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782216875.578512:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782216875.578517:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d410b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789712977792:12345-0@lo:400: 00000100:00100000:1.0:1782216875.578546:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d410b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789712977792:12345-0@lo:400: Request processed in 29us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216875.578552:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1782216875.578575:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782216875.578579:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782216875.578603:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782216875.578632:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789712977408:0@lo:400: 00010000:00080000:1.0:1782216875.582390:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952d410b3800 x1868789712977920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216875.582411:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789712977920:0@lo:400: 00010000:00080000:1.0:1782216875.582448:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952e7b09c000 x1868789712977024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216875.582457:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b09c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1868789712977024:0@lo:400: 00010000:00080000:1.0:1782216875.582468:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952d410b3480 x1868789712977536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216875.582476:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1868789712977536:0@lo:400: 00010000:00080000:1.0:1782216875.582533:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952d410b1880 x1868789712977280/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216875.582542:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1868789712977280:0@lo:400: 00010000:00080000:1.0:1782216875.582553:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952d410b2680 x1868789712977792/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216875.582578:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789712977792:0@lo:400: 00000100:00100000:1.0:1782216875.582608:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b09e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789712977152:0@lo:400: 00010000:00080000:1.0:1782216875.582618:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952d410b0700 x1868789712977664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216875.582626:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1868789712977664:0@lo:400: 00000100:00100000:3.0:1782216875.582987:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712976896 00000100:00100000:3.0:1782216875.582996:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712976896 00000100:00100000:3.0:1782216875.583038:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1782216875.583046:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e43998c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:3648:x1868789712976896:12345-0@lo:400: 00000100:00100000:3.0:1782216875.583125:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e43998c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:3648:x1868789712976896:12345-0@lo:400: Request processed in 79us (5796us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216875.583132:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1782216875.584016:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789712978048:0@lo:13: 00000100:00100000:1.0:1782216875.584062:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216875.584100:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b09d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17bce19a-7a0f-4c9d-b31c-4e0155298487:3648:1868789712976896:0@lo:400: 00000100:00100000:1.0:1782216875.584128:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712978048 00000100:00100000:1.0:1782216875.584131:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712978048 00000100:00100000:1.0:1782216875.584162:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782216875.584169:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d410b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789712978048:12345-0@lo:13: 00002000:00000024:1.0:1782216875.584193:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782216875.584227:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d410b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789712978048:12345-0@lo:13: Request processed in 58us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216875.584233:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1782216875.584261:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952d410b0700 x1868789712978048/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216891 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216875.584275:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789712978048:0@lo:13: 00000100:00100000:1.0:1782216875.584633:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789712978176:0@lo:13: 00000100:00100000:1.0:1782216875.584672:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216875.584702:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712978176 00000100:00100000:1.0:1782216875.584706:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712978176 00000100:00100000:1.0:1782216875.584915:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782216875.584925:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d410b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789712978176:12345-0@lo:13: 00002000:00000024:1.0:1782216875.584948:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782216875.584981:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d410b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789712978176:12345-0@lo:13: Request processed in 57us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216875.584987:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1782216875.585016:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952e7c6f0000 x1868789712978176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216891 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216875.585033:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789712978176:0@lo:13: 00000100:00100000:0.0:1782216876.088840:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782216876.088877:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41bfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789712978304:0@lo:41: 00000100:00100000:0.0:1782216876.088954:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216876.089223:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712978304 00000100:00100000:3.0:1782216876.089241:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712978304 00000100:00100000:3.0:1782216876.089310:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1782216876.089322:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789712978304:12345-0@lo:41: 00000004:00000024:3.0:1782216876.089383:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1782216876.089492:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789712978304:12345-0@lo:41: Request processed in 172us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216876.089503:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1782216876.089549:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41bfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789712978304:0@lo:41: 00010000:00010000:1.0:1782216876.536783:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782216877.114772:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789712978432:0@lo:41: 00000100:00100000:3.0:1782216877.114866:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216877.124354:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712978432 00000100:00100000:1.0:1782216877.124372:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712978432 00000100:00100000:1.0:1782216877.124460:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1782216877.124472:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72e8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789712978432:12345-0@lo:41: 00000004:00000024:1.0:1782216877.126284:0:7938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1782216877.126427:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72e8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789712978432:12345-0@lo:41: Request processed in 1951us (11555us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216877.126438:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1782216877.126653:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789712978432:0@lo:41: 00010000:00010000:3.0:1782216877.561491:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216878.590708:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216879.612603:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216880.639696:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782216880.696856:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789712978560:0@lo:13: 00000100:00100000:0.0:1782216880.696963:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e72e8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789712978688:0@lo:400: 00000100:00100000:3.0:1782216880.697009:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216880.697039:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216880.697088:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789712979200:0@lo:400: 00000100:00100000:0.0:1782216880.697117:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216880.697148:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e72e8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1868789712979072:0@lo:400: 00000100:00100000:0.0:1782216880.697154:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789712979712:0@lo:400: 00000100:00100000:0.0:1782216880.697201:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216880.697214:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216880.697238:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1782216880.697250:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e72e8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1868789712978816:0@lo:400: 00000100:00100000:3.0:1782216880.697261:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789712979584:0@lo:400: 00000100:00100000:0.0:1782216880.697289:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216880.697307:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216880.697325:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1868789712979328:0@lo:400: 00000100:00100000:0.0:1782216880.697355:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216880.697376:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789712979840:0@lo:13: 00000100:00100000:0.0:1782216880.697396:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216880.697429:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712978688 00000100:00100000:0.0:1782216880.697436:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712978688 00000100:00100000:0.0:1782216880.697481:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1782216880.697489:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4399b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:3649:x1868789712978688:12345-0@lo:400: 00000100:00100000:0.0:1782216880.697538:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4399b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:3649:x1868789712978688:12345-0@lo:400: Request processed in 49us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216880.697546:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1782216880.697547:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1782216880.697563:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e72e8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789712978944:0@lo:400: 00000100:00100000:0.0:1782216880.697637:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712979712 00000100:00100000:0.0:1782216880.697643:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712979712 00000100:00100000:3.0:1782216880.697655:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216880.697685:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1868789712979456:0@lo:400: 00000100:00100000:0.0:1782216880.697689:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712979584 00000100:00100000:0.0:1782216880.697710:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712979584 00000100:00100000:0.0:1782216880.697739:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782216880.697742:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216880.697755:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789712979712:12345-0@lo:400: 00000100:00100000:0.0:1782216880.697809:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789712979712:12345-0@lo:400: Request processed in 57us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216880.697816:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712979200 00000100:00100000:0.0:1782216880.697817:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782216880.697828:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712979200 00000100:00100000:0.0:1782216880.697839:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782216880.697849:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789712979584:12345-0@lo:400: 00000100:00100000:3.0:1782216880.697887:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712978944 00000100:00100000:3.0:1782216880.697903:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712978944 00000100:00100000:0.0:1782216880.697909:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789712979584:12345-0@lo:400: Request processed in 58us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216880.697920:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782216880.697936:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1782216880.697950:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789712979200:12345-0@lo:400: 00000100:00100000:0.0:1782216880.697953:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712979072 00000100:00100000:0.0:1782216880.697960:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712979072 00000100:00100000:0.0:1782216880.697982:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712978816 00000100:00100000:0.0:1782216880.697985:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712978816 00000100:00100000:0.0:1782216880.697995:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712979328 00000100:00100000:0.0:1782216880.697997:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712979328 00000100:00100000:0.0:1782216880.698008:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712979456 00000100:00100000:0.0:1782216880.698011:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712979456 00000100:00100000:0.0:1782216880.698022:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782216880.698028:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1868789712979072:12345-0@lo:400: 00000100:00100000:0.0:1782216880.698062:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1868789712979072:12345-0@lo:400: Request processed in 33us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216880.698067:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782216880.698077:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782216880.698082:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1868789712978816:12345-0@lo:400: 00000100:00100000:0.0:1782216880.698106:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1868789712978816:12345-0@lo:400: Request processed in 24us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216880.698121:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782216880.698132:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782216880.698138:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1868789712979328:12345-0@lo:400: 00000100:00100000:0.0:1782216880.698165:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1868789712979328:12345-0@lo:400: Request processed in 27us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216880.698170:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782216880.698181:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782216880.698188:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4263df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1868789712979456:12345-0@lo:400: 00000100:00100000:0.0:1782216880.698247:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4263df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1868789712979456:12345-0@lo:400: Request processed in 59us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216880.698253:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782216880.698273:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712978560 00000100:00100000:0.0:1782216880.698276:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712978560 00000100:00100000:0.0:1782216880.698290:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712979840 00000100:00100000:0.0:1782216880.698292:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712979840 00000100:00100000:3.0:1782216880.698299:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789712979200:12345-0@lo:400: Request processed in 291us (1121us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216880.698306:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782216880.698316:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1782216880.698323:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789712978560:12345-0@lo:13: 00002000:00000024:0.0:1782216880.698347:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782216880.698378:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789712978560:12345-0@lo:13: Request processed in 61us (1373us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216880.698383:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782216880.698394:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782216880.698399:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789712979840:12345-0@lo:13: 00002000:00000024:0.0:1782216880.698407:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782216880.698428:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789712979840:12345-0@lo:13: Request processed in 29us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216880.698442:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1782216880.698460:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782216880.698464:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782216880.698466:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782216880.698498:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952e72e8c380 x1868789712978816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216880.698511:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e72e8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1868789712978816:0@lo:400: 00000100:00100000:3.0:1782216880.698519:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1782216880.698528:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952e46da5880 x1868789712979328/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216880.698535:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789712978944:12345-0@lo:400: 00000100:00100000:0.0:1782216880.698556:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1868789712979328:0@lo:400: 00010000:00080000:0.0:1782216880.698572:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952e7c6f1500 x1868789712979840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216896 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216880.698627:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789712979840:0@lo:13: 00000100:00100000:3.0:1782216880.698637:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789712978944:12345-0@lo:400: Request processed in 105us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216880.698646:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e72e8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789712978688:0@lo:400: 00000100:00100000:3.0:1782216880.698647:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1782216880.698679:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46db2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789712979200:0@lo:400: 00010000:00080000:0.0:1782216880.698690:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952e46da4000 x1868789712979712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216880.698697:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789712979712:0@lo:400: 00000100:00100000:0.0:1782216880.698748:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e72e8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789712978944:0@lo:400: 00010000:00080000:0.0:1782216880.698758:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952e46da4380 x1868789712979456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216880.698765:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1868789712979456:0@lo:400: 00010000:00080000:0.0:1782216880.698787:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952d410b1880 x1868789712978560/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216896 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216880.698797:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789712978560:0@lo:13: 00010000:00080000:0.0:1782216880.698806:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952e72e8ed80 x1868789712979072/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216880.698814:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e72e8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1868789712979072:0@lo:400: 00010000:00080000:0.0:1782216880.698822:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952e46da7b80 x1868789712979584/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216880.698828:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789712979584:0@lo:400: 00000100:00100000:1.0:1782216881.211860:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782216881.211885:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41bfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789712979968:0@lo:41: 00000100:00100000:1.0:1782216881.211972:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216881.212184:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712979968 00000100:00100000:2.0:1782216881.212192:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712979968 00000100:00100000:2.0:1782216881.212242:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1782216881.212258:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d410b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789712979968:12345-0@lo:41: 00000004:00000024:2.0:1782216881.212290:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1782216881.212342:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d410b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789712979968:12345-0@lo:41: Request processed in 85us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216881.212349:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1782216881.212453:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41bfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789712979968:0@lo:41: 00000020:01000004:1.0:1782216881.323390:0:9510:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1782216881.323394:0:9510:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1782216881.323396:0:9510:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1782216881.323529:0:9510:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff952e7dbbd800 00000020:01000004:1.0:1782216881.323548:0:9510:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1782216881.323562:0:9510:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1782216881.324428:0:9510:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff952d4272b380) 00000020:00000080:1.0:1782216881.324455:0:9510:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1782216881.386152:0:9510:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1782216881.386205:0:9510:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:3.0:1782216881.416650:0:9510:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1782216881.416882:0:9510:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1782216881.416908:0:9510:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1782216881.416918:0:9510:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x92b8e04cbf5f9209 00000020:01000004:3.0:1782216881.416926:0:9510:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1782216881.416947:0:9510:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.130@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1782216881.416951:0:9510:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1782216881.416957:0:9510:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1782216881.417000:0:9510:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1782216881.417005:0:9510:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.130@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1782216881.453988:0:9510:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.130@tcp ctxt 0 is initialized 00000020:01000004:0.0:1782216881.454025:0:9510:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.130@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1782216881.454030:0:9510:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1782216881.454031:0:9510:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1782216881.454033:0:9510:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782216881.454034:0:9510:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782216881.454035:0:9510:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782216881.454036:0:9510:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782216881.454038:0:9510:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782216881.454039:0:9510:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782216881.454040:0:9510:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782216881.454042:0:9510:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782216881.454043:0:9510:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1782216881.454047:0:9510:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1782216881.454050:0:9510:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1782216881.454051:0:9510:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1782216881.454052:0:9510:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782216881.454053:0:9510:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782216881.454054:0:9510:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782216881.454056:0:9510:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782216881.454057:0:9510:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782216881.454058:0:9510:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782216881.454064:0:9510:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782216881.454065:0:9510:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782216881.454066:0:9510:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1782216881.454091:0:9510:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1782216881.454108:0:9510:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:9510:1868789712980096:0@lo:253: 00000100:00100000:0.0:1782216881.454178:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216881.454491:0:9510:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e50087d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782216881.456153:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712980096 00000100:00100000:2.0:1782216881.456165:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712980096 00000100:00100000:2.0:1782216881.456253:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1782216881.456262:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e43999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:9510:x1868789712980096:12345-0@lo:253: 20000000:01000000:2.0:1782216881.456297:0:6511:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1782216881.456313:0:6511:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1782216881.456318:0:6511:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1782216881.456321:0:6511:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1782216881.456566:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782216881.456729:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:2.0:1782216881.456744:0:6511:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1782216881.456759:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:2.0:1782216881.456764:0:6511:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1782216881.456775:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:2.0:1782216881.456788:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:2.0:1782216881.456865:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:2.0:1782216881.456879:0:6511:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.203.130@tcp 20000000:01000000:2.0:1782216881.456881:0:6511:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.130@tcp (null) (null) (null) 00000040:00080000:2.0:1782216881.456909:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:2.0:1782216881.456915:0:6511:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1782216881.456927:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:2.0:1782216881.456932:0:6511:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.130@tcp (null) (null) 00000040:00080000:2.0:1782216881.456944:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:2.0:1782216881.456950:0:6511:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1782216881.456961:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:2.0:1782216881.456975:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:2.0:1782216881.457041:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:2.0:1782216881.457051:0:6511:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.203.130@tcp 20000000:01000000:2.0:1782216881.457052:0:6511:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.130@tcp (null) (null) (null) 00000040:00080000:2.0:1782216881.457065:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:2.0:1782216881.457069:0:6511:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1782216881.457081:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:2.0:1782216881.457086:0:6511:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.130@tcp (null) (null) 00000040:00080000:2.0:1782216881.457114:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:2.0:1782216881.457121:0:6511:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1782216881.457133:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:2.0:1782216881.457147:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:2.0:1782216881.457509:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:2.0:1782216881.457521:0:6511:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.203.130@tcp 20000000:01000000:2.0:1782216881.457523:0:6511:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.203.130@tcp (null) (null) (null) 00000040:00080000:2.0:1782216881.457544:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:2.0:1782216881.457550:0:6511:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1782216881.457561:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:2.0:1782216881.457566:0:6511:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.130@tcp (null) (null) 00000040:00080000:2.0:1782216881.457576:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:2.0:1782216881.457602:0:6511:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1782216881.457615:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:2.0:1782216881.457630:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:2.0:1782216881.457642:0:6511:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1782216881.457645:0:6511:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1782216881.457648:0:6511:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1782216881.457686:0:6511:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1782216881.457689:0:6511:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1782216881.460831:0:9516:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:2.0:1782216881.460878:0:9516:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:2.0:1782216881.460917:0:9516:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:3.0:1782216881.461057:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:3.0:1782216881.461082:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:3.0:1782216881.461096:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:3.0:1782216881.461107:0:6511:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1782216881.461109:0:6511:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1782216881.461369:0:9517:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:2.0:1782216881.461556:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:2.0:1782216881.461576:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:2.0:1782216881.461630:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:2.0:1782216881.461638:0:6511:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1782216881.461640:0:6511:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1782216881.462088:0:9518:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 36 marker 26 1->4: lustre sys.timeout 20000000:01000000:0.0:1782216881.462108:0:9518:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 38 marker 26 2->4: lustre sys.timeout 00000040:00080000:0.0:1782216881.462122:0:9518:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:2.0:1782216881.462206:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:2.0:1782216881.462223:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:2.0:1782216881.462235:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:2.0:1782216881.462245:0:6511:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1782216881.462247:0:6511:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1782216881.462520:0:9519:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 5 marker 27 1->4: lustre sys.timeout 20000000:01000000:0.0:1782216881.462544:0:9519:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 7 marker 27 2->4: lustre sys.timeout 00000040:00080000:0.0:1782216881.462555:0:9519:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1782216881.462648:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1782216881.462667:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:2.0:1782216881.462682:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:2.0:1782216881.462690:0:6511:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1782216881.462692:0:6511:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1782216881.463052:0:9520:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:0.0:1782216881.463070:0:9520:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:0.0:1782216881.463086:0:9520:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:2.0:1782216881.463491:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:2.0:1782216881.463512:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:2.0:1782216881.463539:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 10000000:01000000:2.0:1782216881.463555:0:6511:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1782216881.463573:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff952e413fda00/0x92b8e04cbf5f9210 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216881.463656:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952e7c448c00/0x92b8e04cbf5f9106 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f90ff expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216881.463665:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952e413fc400/0x92b8e04cbf5f9130 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9129 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216881.463672:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952e413fc200/0x92b8e04cbf5f916f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9168 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216881.463679:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952e413fd600/0x92b8e04cbf5f918b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9184 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216881.463685:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952e7c448a00/0x92b8e04cbf5f91ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f91a7 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216881.463691:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952e7c448000/0x92b8e04cbf5f91d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f91ca expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216881.463697:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952e7c449400/0x92b8e04cbf5f91f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f91ed expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216881.463704:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff952e413fda00/0x92b8e04cbf5f9210 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216881.463741:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952e7c449400/0x92b8e04cbf5f91f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5f91ed expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216881.463766:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff952e7c449400/0x92b8e04cbf5f91f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5f91ed expref: 21 pid: 6511 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216881.463780:0:6511:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41bfaa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6511:1868789712980224:0@lo:104: 00000100:00100000:2.0:1782216881.463914:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782216881.464111:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952e7c448000/0x92b8e04cbf5f91d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5f91ca expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216881.464120:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff952e7c448000/0x92b8e04cbf5f91d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5f91ca expref: 21 pid: 6514 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216881.464129:0:6511:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41bf8380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6511:1868789712980352:0@lo:104: 00000100:00100000:2.0:1782216881.464153:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782216881.465578:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952e7c448a00/0x92b8e04cbf5f91ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5f91a7 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216881.465606:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff952e7c448a00/0x92b8e04cbf5f91ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5f91a7 expref: 21 pid: 6514 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216881.465617:0:6511:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41bf9f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6511:1868789712980480:0@lo:104: 00000100:00100000:2.0:1782216881.465650:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216881.465780:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712980224 00000100:00100000:3.0:1782216881.465788:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712980224 00000100:00100000:3.0:1782216881.465837:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712980352 00000100:00100000:3.0:1782216881.465840:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712980352 00000100:00100000:3.0:1782216881.465855:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782216881.465862:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bfad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+4:6511:x1868789712980224:12345-0@lo:104: 00010000:00010000:3.0:1782216881.465874:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff952e7c449200/0x92b8e04cbf5f91ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f91f4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216881.465938:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782216881.465945:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bfad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+4:6511:x1868789712980224:12345-0@lo:104: Request processed in 83us (2031us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216881.465959:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782216881.465980:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782216881.465986:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bf9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+3:6511:x1868789712980352:12345-0@lo:104: 00010000:00010000:3.0:1782216881.466006:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff952e7c448600/0x92b8e04cbf5f91ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f91d1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216881.466037:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1782216881.466042:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bf9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+3:6511:x1868789712980352:12345-0@lo:104: Request processed in 57us (1889us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216881.466048:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:2.0:1782216881.466362:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952e413fd600/0x92b8e04cbf5f918b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5f9184 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216881.466371:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff952e413fd600/0x92b8e04cbf5f918b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9184 expref: 21 pid: 6511 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216881.466391:0:6511:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6d5c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6511:1868789712980608:0@lo:104: 00000100:00100000:2.0:1782216881.466425:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782216881.466442:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952e413fc200/0x92b8e04cbf5f916f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5f9168 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216881.466450:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff952e413fc200/0x92b8e04cbf5f916f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9168 expref: 21 pid: 6513 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216881.467222:0:6511:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be4700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6511:1868789712980736:0@lo:104: 00000100:00100000:2.0:1782216881.467256:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782216881.467280:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952e413fc400/0x92b8e04cbf5f9130 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5f9129 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216881.467288:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff952e413fc400/0x92b8e04cbf5f9130 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9129 expref: 21 pid: 6513 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216881.467297:0:6511:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be5f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6511:1868789712980864:0@lo:104: 00000100:00100000:2.0:1782216881.467337:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782216881.467355:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952e7c448c00/0x92b8e04cbf5f9106 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5f90ff expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216881.467363:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff952e7c448c00/0x92b8e04cbf5f9106 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5f90ff expref: 21 pid: 6513 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216881.467371:0:6511:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be4000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6511:1868789712980992:0@lo:104: 00000100:00100000:2.0:1782216881.467399:0:6511:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d427fb900 going to sleep for 11 seconds 00000100:00100000:2.0:1782216881.467420:0:6511:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41bfaa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6511:1868789712980224:0@lo:104: 00000100:00100000:2.0:1782216881.467428:0:6511:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41bf8380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6511:1868789712980352:0@lo:104: 00010000:00010000:1.0:1782216881.468407:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782216881.468417:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e7c449200/0x92b8e04cbf5f91ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f91f4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.468427:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7c449200 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:1.0:1782216881.468430:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e7c449200/0x92b8e04cbf5f91ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5f91f4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.468440:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e7c449200/0x92b8e04cbf5f91ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5f91f4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782216881.468447:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e7c449200/0x92b8e04cbf5f91ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5f91f4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782216881.468453:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782216881.468494:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e7c449200/0x92b8e04cbf5f91ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f91f4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.468501:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782216881.468523:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e7c449200/0x92b8e04cbf5f91ed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f91f4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.468530:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e7c449200/0x92b8e04cbf5f91ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f91f4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.468544:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782216881.468547:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e7c448600/0x92b8e04cbf5f91ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f91d1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.468563:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7c448600 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:1.0:1782216881.468566:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e7c448600/0x92b8e04cbf5f91ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5f91d1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.468574:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e7c448600/0x92b8e04cbf5f91ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5f91d1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782216881.468580:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e7c448600/0x92b8e04cbf5f91ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5f91d1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782216881.468606:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782216881.468619:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e7c448600/0x92b8e04cbf5f91ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f91d1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.468625:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782216881.468640:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e7c448600/0x92b8e04cbf5f91ca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f91d1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.468647:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e7c448600/0x92b8e04cbf5f91ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f91d1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.468656:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216881.468657:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216881.468659:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216881.468665:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782216881.468678:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17bce19a-7a0f-4c9d-b31c-4e0155298487:3648:1868789712981120:0@lo:103: 00000100:00100000:1.0:1782216881.468720:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216881.468766:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789712981248:0@lo:103: 00000100:00100000:1.0:1782216881.468808:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216881.468841:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712981120 00000100:00100000:1.0:1782216881.468847:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712981120 00010000:00010000:1.0:1782216881.468872:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952e7c449400/0x92b8e04cbf5f91f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f91ed expref: 22 pid: 6511 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216881.468905:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712981248 00000100:00100000:1.0:1782216881.468909:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712981248 00010000:00010000:1.0:1782216881.468920:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952e7c448000/0x92b8e04cbf5f91d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f91ca expref: 23 pid: 6514 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216881.468947:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782216881.468954:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d410b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:3648:x1868789712981120:12345-0@lo:103: 00010000:00010000:1.0:1782216881.468967:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782216881.468972:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952e7c449400/0x92b8e04cbf5f91f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f91ed expref: 23 pid: 6511 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.468982:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952e7c449400/0x92b8e04cbf5f91f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5f91ed expref: 23 pid: 6511 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.468995:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e7c449400/0x92b8e04cbf5f91f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5f91ed expref: 23 pid: 6511 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.469008:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782216881.469039:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d410b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17bce19a-7a0f-4c9d-b31c-4e0155298487+22:3648:x1868789712981120:12345-0@lo:103: Request processed in 84us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216881.469046:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782216881.469060:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782216881.469066:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d410b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:3649:x1868789712981248:12345-0@lo:103: 00010000:00010000:1.0:1782216881.469083:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782216881.469092:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952e7c448000/0x92b8e04cbf5f91d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f91ca expref: 21 pid: 6514 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.469101:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952e7c448000/0x92b8e04cbf5f91d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5f91ca expref: 21 pid: 6514 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.469111:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e7c448000/0x92b8e04cbf5f91d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5f91ca expref: 21 pid: 6514 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.469120:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782216881.469153:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d410b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17bce19a-7a0f-4c9d-b31c-4e0155298487+20:3649:x1868789712981248:12345-0@lo:103: Request processed in 87us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216881.469160:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782216881.469192:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17bce19a-7a0f-4c9d-b31c-4e0155298487:3648:1868789712981120:0@lo:103: 00000100:00100000:2.0:1782216881.469473:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789712981248:0@lo:103: 00000100:00100000:3.0:1782216881.470310:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1782216881.470338:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216881.470351:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712980480 00000100:00100000:3.0:1782216881.470356:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712980480 00000100:00100000:3.0:1782216881.470389:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712980608 00000100:00100000:3.0:1782216881.470391:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712980608 00000100:00100000:3.0:1782216881.470400:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712980736 00000100:00100000:3.0:1782216881.470402:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712980736 00000100:00100000:3.0:1782216881.470410:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712980864 00000100:00100000:3.0:1782216881.470412:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712980864 00000100:00100000:3.0:1782216881.470420:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712980992 00000100:00100000:3.0:1782216881.470422:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712980992 00000100:00100000:3.0:1782216881.470432:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782216881.470438:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+7:6511:x1868789712980480:12345-0@lo:104: 00010000:00010000:3.0:1782216881.470450:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff952e7c449c00/0x92b8e04cbf5f91a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f91ae expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216881.470500:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782216881.470505:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+7:6511:x1868789712980480:12345-0@lo:104: Request processed in 68us (4855us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216881.470511:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782216881.470523:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782216881.470528:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+6:6511:x1868789712980608:12345-0@lo:104: 00010000:00010000:3.0:1782216881.470542:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff952e7c448e00/0x92b8e04cbf5f9184 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f918b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216881.470569:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1782216881.470573:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+6:6511:x1868789712980608:12345-0@lo:104: Request processed in 46us (4148us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216881.470578:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782216881.470606:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1782216881.470611:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+5:6511:x1868789712980736:12345-0@lo:104: 00010000:00010000:3.0:1782216881.470618:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff952e7c449a00/0x92b8e04cbf5f9168 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f916f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216881.470638:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1782216881.470642:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+5:6511:x1868789712980736:12345-0@lo:104: Request processed in 32us (3387us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216881.470647:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1782216881.470655:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782216881.470660:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4228bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+4:6511:x1868789712980864:12345-0@lo:104: 00010000:00010000:3.0:1782216881.470666:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff952e413fd200/0x92b8e04cbf5f9129 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f9130 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216881.470684:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1782216881.470687:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4228bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+4:6511:x1868789712980864:12345-0@lo:104: Request processed in 28us (3352us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216881.470692:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782216881.470715:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782216881.470720:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4263ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+3:6511:x1868789712980992:12345-0@lo:104: 00010000:00010000:3.0:1782216881.470738:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff952e7b363a00/0x92b8e04cbf5f90ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f9106 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216881.470766:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1782216881.470770:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4263ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+3:6511:x1868789712980992:12345-0@lo:104: Request processed in 51us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216881.470775:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1782216881.470976:0:6511:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41bf9f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6511:1868789712980480:0@lo:104: 00000100:00100000:2.0:1782216881.470985:0:6511:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6d5c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6511:1868789712980608:0@lo:104: 00000100:00100000:2.0:1782216881.470991:0:6511:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be4700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6511:1868789712980736:0@lo:104: 00000100:00100000:2.0:1782216881.470997:0:6511:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be5f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6511:1868789712980864:0@lo:104: 00000100:00100000:2.0:1782216881.471003:0:6511:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be4000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6511:1868789712980992:0@lo:104: 00010000:00010000:2.0:1782216881.471030:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff952e413fda00/0x92b8e04cbf5f9210 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.472952:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1782216881.472964:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e7c449c00/0x92b8e04cbf5f91a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f91ae expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.472974:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7c449c00 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:1.0:1782216881.472978:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e7c449c00/0x92b8e04cbf5f91a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5f91ae expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.472987:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e7c449c00/0x92b8e04cbf5f91a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5f91ae expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782216881.472994:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e7c449c00/0x92b8e04cbf5f91a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5f91ae expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782216881.472999:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782216881.473054:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e7c449c00/0x92b8e04cbf5f91a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f91ae expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.473074:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782216881.473102:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e7c449c00/0x92b8e04cbf5f91a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f91ae expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.473110:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e7c449c00/0x92b8e04cbf5f91a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f91ae expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.473127:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1782216881.473130:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e7c448e00/0x92b8e04cbf5f9184 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f918b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.473136:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7c448e00 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:1.0:1782216881.473139:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e7c448e00/0x92b8e04cbf5f9184 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5f918b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.473146:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e7c448e00/0x92b8e04cbf5f9184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5f918b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782216881.473153:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e7c448e00/0x92b8e04cbf5f9184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5f918b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782216881.473159:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782216881.473171:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e7c448e00/0x92b8e04cbf5f9184 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f918b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.473177:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782216881.473189:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e7c448e00/0x92b8e04cbf5f9184 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f918b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.473196:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e7c448e00/0x92b8e04cbf5f9184 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f918b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.473212:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1782216881.473215:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e7c449a00/0x92b8e04cbf5f9168 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f916f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.473221:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7c449a00 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:1.0:1782216881.473224:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e7c449a00/0x92b8e04cbf5f9168 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5f916f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.473232:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e7c449a00/0x92b8e04cbf5f9168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5f916f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782216881.473239:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e7c449a00/0x92b8e04cbf5f9168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5f916f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782216881.473244:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782216881.473256:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e7c449a00/0x92b8e04cbf5f9168 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f916f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.473262:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782216881.473267:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e7c449a00/0x92b8e04cbf5f9168 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f916f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.473275:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e7c449a00/0x92b8e04cbf5f9168 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f916f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.473283:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782216881.473287:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e413fd200/0x92b8e04cbf5f9129 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f9130 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.473302:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e413fd200 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:1.0:1782216881.473305:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e413fd200/0x92b8e04cbf5f9129 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5f9130 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.473312:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e413fd200/0x92b8e04cbf5f9129 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5f9130 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782216881.473319:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e413fd200/0x92b8e04cbf5f9129 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5f9130 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782216881.473324:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782216881.473338:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e413fd200/0x92b8e04cbf5f9129 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f9130 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.473343:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782216881.473347:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e413fd200/0x92b8e04cbf5f9129 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f9130 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.473353:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e413fd200/0x92b8e04cbf5f9129 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f9130 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.473362:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782216881.473364:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e7b363a00/0x92b8e04cbf5f90ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f9106 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.473370:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b363a00 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:1.0:1782216881.473373:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e7b363a00/0x92b8e04cbf5f90ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5f9106 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.473389:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e7b363a00/0x92b8e04cbf5f90ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5f9106 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782216881.473395:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e7b363a00/0x92b8e04cbf5f90ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5f9106 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782216881.473400:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782216881.473412:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e7b363a00/0x92b8e04cbf5f90ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f9106 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.473418:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782216881.473422:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e7b363a00/0x92b8e04cbf5f90ff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f9106 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.473429:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e7b363a00/0x92b8e04cbf5f90ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f9106 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.473443:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216881.473444:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216881.473447:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782216881.473463:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789712981504:0@lo:103: 00000100:00100000:1.0:1782216881.473520:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216881.473552:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782216881.473558:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789712981632:0@lo:103: 00000100:00100000:1.0:1782216881.473598:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216881.473628:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712981504 00000100:00100000:1.0:1782216881.473634:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712981504 00010000:00010000:1.0:1782216881.473658:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952e413fd600/0x92b8e04cbf5f918b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9184 expref: 20 pid: 6511 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216881.473691:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712981632 00000100:00100000:1.0:1782216881.473694:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712981632 00010000:00010000:1.0:1782216881.473705:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952e413fc200/0x92b8e04cbf5f916f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9168 expref: 21 pid: 6513 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216881.473724:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1782216881.473731:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b09d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:3647:x1868789712981504:12345-0@lo:103: 00010000:00010000:1.0:1782216881.473742:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782216881.473747:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952e413fd600/0x92b8e04cbf5f918b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9184 expref: 21 pid: 6511 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.473756:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952e413fd600/0x92b8e04cbf5f918b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9184 expref: 21 pid: 6511 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.473769:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e413fd600/0x92b8e04cbf5f918b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5f9184 expref: 21 pid: 6511 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.473780:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782216881.473811:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b09d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+20:3647:x1868789712981504:12345-0@lo:103: Request processed in 79us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216881.473818:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1782216881.473833:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782216881.473839:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e6f92ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+19:3647:x1868789712981632:12345-0@lo:103: 00010000:00010000:1.0:1782216881.473845:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782216881.473850:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952e413fc200/0x92b8e04cbf5f916f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9168 expref: 19 pid: 6513 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.473858:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952e413fc200/0x92b8e04cbf5f916f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9168 expref: 19 pid: 6513 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.473874:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e413fc200/0x92b8e04cbf5f916f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5f9168 expref: 19 pid: 6513 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.473895:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782216881.473917:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e6f92ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+18:3647:x1868789712981632:12345-0@lo:103: Request processed in 79us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216881.473924:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782216881.473970:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789712981760:0@lo:103: 00000100:00100000:1.0:1782216881.473993:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216881.474010:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1782216881.474016:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789712981376:0@lo:103: 00000100:00100000:1.0:1782216881.474033:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216881.474046:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789712981888:0@lo:103: 00000100:00100000:1.0:1782216881.474064:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216881.474084:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712981760 00000100:00100000:1.0:1782216881.474087:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712981760 00010000:00010000:1.0:1782216881.474100:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952e413fc400/0x92b8e04cbf5f9130 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9129 expref: 18 pid: 6513 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216881.474112:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712981376 00000100:00100000:1.0:1782216881.474115:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712981376 00010000:00010000:1.0:1782216881.474123:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952e7c448a00/0x92b8e04cbf5f91ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f91a7 expref: 19 pid: 6514 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216881.474133:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712981888 00000100:00100000:1.0:1782216881.474135:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712981888 00010000:00010000:1.0:1782216881.474143:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952e7c448c00/0x92b8e04cbf5f9106 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f90ff expref: 20 pid: 6513 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216881.474166:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1782216881.474172:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b09d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+20:3649:x1868789712981760:12345-0@lo:103: 00010000:00010000:1.0:1782216881.474179:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782216881.474183:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952e413fc400/0x92b8e04cbf5f9130 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9129 expref: 20 pid: 6513 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.474191:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952e413fc400/0x92b8e04cbf5f9130 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9129 expref: 20 pid: 6513 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.474200:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e413fc400/0x92b8e04cbf5f9130 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5f9129 expref: 20 pid: 6513 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.474208:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782216881.474244:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b09d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+19:3649:x1868789712981760:12345-0@lo:103: Request processed in 71us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216881.474250:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1782216881.474261:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1782216881.474266:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b09e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+18:3649:x1868789712981376:12345-0@lo:103: 00010000:00010000:1.0:1782216881.474273:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782216881.474277:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952e7c448a00/0x92b8e04cbf5f91ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f91a7 expref: 18 pid: 6514 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.474287:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952e7c448a00/0x92b8e04cbf5f91ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5f91a7 expref: 18 pid: 6514 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.474296:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e7c448a00/0x92b8e04cbf5f91ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5f91a7 expref: 18 pid: 6514 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.474314:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782216881.474334:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b09e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:3649:x1868789712981376:12345-0@lo:103: Request processed in 67us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216881.474340:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1782216881.474352:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782216881.474358:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b09c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:3649:x1868789712981888:12345-0@lo:103: 00010000:00010000:1.0:1782216881.474364:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782216881.474368:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952e7c448c00/0x92b8e04cbf5f9106 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f90ff expref: 16 pid: 6513 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.474377:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952e7c448c00/0x92b8e04cbf5f9106 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5f90ff expref: 16 pid: 6513 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.474386:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e7c448c00/0x92b8e04cbf5f9106 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5f90ff expref: 16 pid: 6513 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.474396:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff952e413fda00/0x92b8e04cbf5f9210 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.474404:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e413fda00/0x92b8e04cbf5f9210 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.474417:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff952e413fda00/0x92b8e04cbf5f9210 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.474423:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff952e413fda00/0x92b8e04cbf5f9210 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.474430:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff952e413fda00/0x92b8e04cbf5f9210 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.474442:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff952e413fda00/0x92b8e04cbf5f9210 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.474448:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e413fda00 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:1.0:1782216881.474452:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff952e413fda00/0x92b8e04cbf5f9210 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.474459:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff952e413fda00/0x92b8e04cbf5f9210 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.474474:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff952e413fda00/0x92b8e04cbf5f9210 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216881.474479:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789712981376:0@lo:103: 00010000:00010000:1.0:1782216881.474482:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782216881.474487:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789712981760:0@lo:103: 00000100:00100000:3.0:1782216881.474502:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789712981888:0@lo:103: 00000100:00100000:1.0:1782216881.474502:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b09c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:3649:x1868789712981888:12345-0@lo:103: Request processed in 145us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216881.474509:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782216881.474537:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789712981632:0@lo:103: 00000100:00100000:1.0:1782216881.474545:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789712981504:0@lo:103: 00010000:00010000:1.0:1782216881.474560:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216881.474576:0:6511:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff952e413fda00/0x92b8e04cbf5f9210 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.474601:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff952e413fda00/0x92b8e04cbf5f9210 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.474608:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e413fda00/0x92b8e04cbf5f9210 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1782216881.474631:0:6511:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1782216881.478613:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e43999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+14:9510:x1868789712980096:12345-0@lo:253: Request processed in 22343us (24425us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216881.478627:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1782216881.478748:0:9510:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:9510:1868789712980096:0@lo:253: 10000000:01000000:2.0:1782216881.478764:0:9510:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1782216881.478767:0:9510:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782216881.478769:0:9510:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782216881.478770:0:9510:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782216881.478772:0:9510:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1782216881.478773:0:9510:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782216881.478775:0:9510:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782216881.478776:0:9510:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782216881.478778:0:9510:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1782216881.478779:0:9510:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782216881.478781:0:9510:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1782216881.478801:0:9510:0:(tgt_mount.c:101:server_register_mount()) register mount ffff952e7dbbd800 from lustre-OST0001 10000000:01000000:2.0:1782216881.478831:0:9510:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1782216881.478834:0:9510:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1782216881.478842:0:9510:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff952e5021b380 local copy 10000000:01000000:2.0:1782216881.478846:0:9510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1782216881.478878:0:9510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e413fc000/0x92b8e04cbf5f9217 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216881.478897:0:9510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.130@tcp lock: ffff952e413fc000/0x92b8e04cbf5f9217 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216881.478923:0:9510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e413fc000/0x92b8e04cbf5f9217 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216881.478941:0:9510:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:9510:1868789712982016:0@lo:101: 00000100:00100000:2.0:1782216881.478975:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216881.479007:0:9510:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d427fb900 going to sleep for 11 seconds 00000100:00100000:3.0:1782216881.479485:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712982016 00000100:00100000:3.0:1782216881.479492:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712982016 00000100:00100000:3.0:1782216881.479533:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1782216881.479541:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e43999c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+14:9510:x1868789712982016:12345-0@lo:101: 00010000:00010000:3.0:1782216881.479552:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782216881.479565:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e7b362e00/0x92b8e04cbf5f921e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f9217 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216881.479601:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e7b362e00/0x92b8e04cbf5f921e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9217 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216881.479611:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e7b362e00/0x92b8e04cbf5f921e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9217 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216881.479620:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b362e00, rc 0) 00000100:00100000:3.0:1782216881.479661:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e43999c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:9510:x1868789712982016:12345-0@lo:101: Request processed in 121us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216881.479679:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1782216881.479700:0:9510:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:9510:1868789712982016:0@lo:101: 00010000:00010000:2.0:1782216881.479712:0:9510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e413fc000/0x92b8e04cbf5f9217 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x92b8e04cbf5f921e expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216881.479721:0:9510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e413fc000/0x92b8e04cbf5f9217 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x92b8e04cbf5f921e expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216881.479801:0:9510:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:9510:1868789712982144:0@lo:501: 00000100:00100000:2.0:1782216881.479826:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216881.479853:0:9510:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d427fb900 going to sleep for 11 seconds 00000100:00100000:1.0:1782216881.479913:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712982144 00000100:00100000:1.0:1782216881.479918:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712982144 00000100:00100000:1.0:1782216881.479949:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1782216881.479956:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e582c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:9510:x1868789712982144:12345-0@lo:501: 00000100:00100000:1.0:1782216881.480026:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e582c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:9510:x1868789712982144:12345-0@lo:501: Request processed in 71us (198us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782216881.480033:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1782216881.480052:0:9510:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:9510:1868789712982144:0@lo:501: 10000000:01000000:3.0:1782216881.480063:0:9510:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1782216881.480082:0:9510:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1782216881.480087:0:9510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e413fc000/0x92b8e04cbf5f9217 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x92b8e04cbf5f921e expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216881.480095:0:9510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e413fc000/0x92b8e04cbf5f9217 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x92b8e04cbf5f921e expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216881.480102:0:9510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff952e413fc000/0x92b8e04cbf5f9217 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x92b8e04cbf5f921e expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216881.480123:0:9510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782216881.480144:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:3.0:1782216881.480146:0:9510:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff952e7dbbd800 00010000:00010000:1.0:1782216881.480149:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e413fc000/0x92b8e04cbf5f9217 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x92b8e04cbf5f921e expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782216881.480150:0:9510:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1782216881.480155:0:9510:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 00010000:00010000:1.0:1782216881.480156:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e413fc000 already unused, calling callback (ffffffffc1157c20) 10000000:01000000:3.0:1782216881.480158:0:9510:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:00010000:1.0:1782216881.480160:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e413fc000/0x92b8e04cbf5f9217 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x92b8e04cbf5f921e expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782216881.480162:0:9510:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1782216881.480164:0:9510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1782216881.480168:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e413fc000/0x92b8e04cbf5f9217 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x92b8e04cbf5f921e expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782216881.480175:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e413fc000/0x92b8e04cbf5f9217 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x92b8e04cbf5f921e expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216881.480179:0:9510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7b363600/0x92b8e04cbf5f9225 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782216881.480181:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782216881.480186:0:9510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e7b363600/0x92b8e04cbf5f9225 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216881.480193:0:9510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e7b363600/0x92b8e04cbf5f9225 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.480197:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e413fc000/0x92b8e04cbf5f9217 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0x92b8e04cbf5f921e expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.480210:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1782216881.480213:0:9510:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4263ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:9510:1868789712982272:0@lo:101: 00010000:00010000:1.0:1782216881.480234:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e413fc000/0x92b8e04cbf5f9217 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x92b8e04cbf5f921e expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216881.480236:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782216881.480242:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e413fc000/0x92b8e04cbf5f9217 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x92b8e04cbf5f921e expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216881.480247:0:9510:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e6fad80c0 going to sleep for 11 seconds 00010000:00010000:1.0:1782216881.480253:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216881.480255:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216881.480256:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782216881.480259:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712982272 00000100:00100000:3.0:1782216881.480262:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712982272 00000100:00100000:1.0:1782216881.480263:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782216881.480273:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17bce19a-7a0f-4c9d-b31c-4e0155298487:3648:1868789712982400:0@lo:103: 00000100:00100000:3.0:1782216881.480282:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1782216881.480287:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e582c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:9510:x1868789712982272:12345-0@lo:101: 00010000:00010000:3.0:1782216881.480295:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1782216881.480298:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782216881.480302:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e7b363c00/0x92b8e04cbf5f922c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f9225 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216881.480315:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e7b363c00/0x92b8e04cbf5f922c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9225 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216881.480324:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e7b363c00/0x92b8e04cbf5f922c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9225 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216881.480330:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b363c00, rc 0) 00000100:00100000:1.0:1782216881.480336:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712982400 00000100:00100000:1.0:1782216881.480339:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712982400 00000100:00100000:3.0:1782216881.480354:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e582c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:9510:x1868789712982272:12345-0@lo:101: Request processed in 67us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216881.480360:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1782216881.480362:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782216881.480368:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d410b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:3648:x1868789712982400:12345-0@lo:103: 00010000:00010000:1.0:1782216881.480375:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782216881.480386:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e7b362e00/0x92b8e04cbf5f921e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x92b8e04cbf5f9217 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.480395:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782216881.480399:0:9510:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4263ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:9510:1868789712982272:0@lo:101: 00010000:00010000:3.0:1782216881.480408:0:9510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e7b363600/0x92b8e04cbf5f9225 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f922c expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216881.480416:0:9510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e7b363600/0x92b8e04cbf5f9225 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f922c expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216881.480419:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d410b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:3648:x1868789712982400:12345-0@lo:103: Request processed in 52us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216881.480425:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782216881.480451:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17bce19a-7a0f-4c9d-b31c-4e0155298487:3648:1868789712982400:0@lo:103: 00000100:00100000:3.0:1782216881.480477:0:9510:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4263ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:9510:1868789712982528:0@lo:501: 00000100:00100000:3.0:1782216881.480499:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216881.480523:0:9510:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e6fad80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782216881.480577:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712982528 00000100:00100000:2.0:1782216881.480613:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712982528 00000100:00100000:2.0:1782216881.480642:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1782216881.480648:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:9510:x1868789712982528:12345-0@lo:501: 00000100:00100000:2.0:1782216881.480736:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:9510:x1868789712982528:12345-0@lo:501: Request processed in 87us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216881.480741:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1782216881.480770:0:9510:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4263ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:9510:1868789712982528:0@lo:501: 00000100:00100000:3.0:1782216881.480794:0:9510:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4263ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:9510:1868789712982656:0@lo:503: 00000100:00100000:3.0:1782216881.480840:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216881.480855:0:9510:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e6fad80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782216881.480857:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712982656 00000100:00100000:1.0:1782216881.480867:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712982656 00000100:00100000:1.0:1782216881.480901:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1782216881.480908:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:9510:x1868789712982656:12345-0@lo:503: 00000100:00100000:1.0:1782216881.480983:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:9510:x1868789712982656:12345-0@lo:503: Request processed in 75us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216881.480990:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1782216881.480991:0:9510:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4263ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:9510:1868789712982656:0@lo:503: 00000040:00080000:3.0:1782216881.481375:0:9510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782216881.481651:0:9510:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4263ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:9510:1868789712982784:0@lo:502: 00000100:00100000:3.0:1782216881.481692:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216881.481728:0:9510:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e6fad80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782216881.481917:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712982784 00000100:00100000:1.0:1782216881.481924:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712982784 00000100:00100000:1.0:1782216881.481950:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1782216881.481957:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:9510:x1868789712982784:12345-0@lo:502: 00000100:00100000:1.0:1782216881.482039:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:9510:x1868789712982784:12345-0@lo:502: Request processed in 81us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216881.482045:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1782216881.482369:0:9510:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4263ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:9510:1868789712982784:0@lo:502: 00000040:00080000:3.0:1782216881.482690:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1782216881.482723:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1782216881.482738:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1782216881.482749:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1782216881.482761:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1782216881.482775:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1782216881.483176:0:9510:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4263ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:9510:1868789712982912:0@lo:502: 00000100:00100000:3.0:1782216881.483240:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216881.483278:0:9510:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e6fad80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782216881.483538:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712982912 00000100:00100000:1.0:1782216881.483545:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712982912 00000100:00100000:1.0:1782216881.483609:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1782216881.483617:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:9510:x1868789712982912:12345-0@lo:502: 00000100:00100000:1.0:1782216881.483701:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:9510:x1868789712982912:12345-0@lo:502: Request processed in 84us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216881.483707:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1782216881.484136:0:9510:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4263ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:9510:1868789712982912:0@lo:502: 00000040:00080000:3.0:1782216881.484205:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1782216881.484946:0:9510:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:3.0:1782216881.491024:0:9521:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1782216881.491033:0:9521:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1782216881.491040:0:9521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782216881.491042:0:9521:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1782216881.491048:0:9521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782216881.491063:0:9521:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff952e502199c0) 00000020:00000080:3.0:1782216881.491085:0:9521:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:3.0:1782216881.491090:0:9521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1782216881.491172:0:9521:0:(tgt_mount.c:153:server_get_mount()) get mount ffff952e7dbbd800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1782216881.491181:0:9521:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1782216881.491188:0:9521:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x92b8e04cbf5f923a 00010000:00010000:2.0:1782216881.503088:0:9521:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:2.0:1782216881.503377:0:9521:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1782216881.513181:0:9521:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1782216881.513537:0:9521:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1782216881.518958:0:9521:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1782216881.519269:0:9521:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1782216881.525279:0:9521:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1782216881.526758:0:9521:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1782216881.526768:0:9521:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782216881.526774:0:9521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782216881.526776:0:9521:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1782216881.526780:0:9521:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782216881.526784:0:9521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782216881.526786:0:9521:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1782216881.526789:0:9521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1782216881.526791:0:9521:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1782216881.526811:0:9521:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782216881.526815:0:9521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782216881.526816:0:9521:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:2.0:1782216881.526819:0:9521:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1782216881.527021:0:9510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1782216881.527050:0:9510:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1782216881.527074:0:9510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7b363600/0x92b8e04cbf5f9225 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f922c expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216881.527086:0:9510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e7b363600/0x92b8e04cbf5f9225 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f922c expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782216881.527095:0:9510:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff952e7dbbd800 from 1 10000000:01000000:3.0:1782216881.527098:0:9510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782216881.527131:0:9510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7b362a00/0x92b8e04cbf5f9241 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216881.527140:0:9510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e7b362a00/0x92b8e04cbf5f9241 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216881.527151:0:9510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e7b362a00/0x92b8e04cbf5f9241 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216881.527174:0:9510:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4263ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:9510:1868789712983040:0@lo:101: 00000100:00100000:3.0:1782216881.527243:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216881.527282:0:9510:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e50d586c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782216881.527393:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712983040 00000100:00100000:3.0:1782216881.527400:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712983040 00000100:00100000:3.0:1782216881.527441:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1782216881.527449:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:9510:x1868789712983040:12345-0@lo:101: 00010000:00010000:3.0:1782216881.527463:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782216881.527474:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e7b362c00/0x92b8e04cbf5f9248 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f9241 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216881.527495:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e7b362c00/0x92b8e04cbf5f9248 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9241 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216881.527505:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e7b362c00/0x92b8e04cbf5f9248 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9241 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216881.527514:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b362c00, rc 0) 00000100:00100000:3.0:1782216881.527550:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:9510:x1868789712983040:12345-0@lo:101: Request processed in 101us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216881.527557:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1782216881.527622:0:9510:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4263ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:9510:1868789712983040:0@lo:101: 00010000:00010000:3.0:1782216881.527635:0:9510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e7b362a00/0x92b8e04cbf5f9241 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f9248 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216881.527644:0:9510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e7b362a00/0x92b8e04cbf5f9241 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f9248 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216881.527714:0:9510:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4263ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:9510:1868789712983168:0@lo:501: 00000100:00100000:3.0:1782216881.527747:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216881.527761:0:9510:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e50d586c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782216881.527773:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712983168 00000100:00100000:3.0:1782216881.527777:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712983168 00000100:00100000:3.0:1782216881.527797:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1782216881.527803:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:9510:x1868789712983168:12345-0@lo:501: 00000100:00100000:3.0:1782216881.528850:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:9510:x1868789712983168:12345-0@lo:501: Request processed in 1042us (1097us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216881.528861:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1782216881.528919:0:9510:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4263ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:9510:1868789712983168:0@lo:501: 00000100:00100000:3.0:1782216881.528954:0:9510:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4263ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:9510:1868789712983296:0@lo:503: 00000100:00100000:3.0:1782216881.529008:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216881.529030:0:9510:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e50d586c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782216881.530133:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712983296 00000100:00100000:0.0:1782216881.530142:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712983296 00000100:00100000:0.0:1782216881.530184:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1782216881.530193:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:9510:x1868789712983296:12345-0@lo:503: 00000100:00100000:0.0:1782216881.530321:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:9510:x1868789712983296:12345-0@lo:503: Request processed in 128us (1311us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216881.530328:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1782216881.530777:0:9510:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4263ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:9510:1868789712983296:0@lo:503: 00000040:00080000:3.0:1782216881.531105:0:9510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782216881.531176:0:9510:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4263ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:9510:1868789712983424:0@lo:502: 00000100:00100000:3.0:1782216881.531221:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216881.531257:0:9510:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e50d586c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782216881.532114:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712983424 00000100:00100000:1.0:1782216881.532121:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712983424 00000100:00100000:1.0:1782216881.532156:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1782216881.532165:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:9510:x1868789712983424:12345-0@lo:502: 00000100:00100000:1.0:1782216881.532273:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:9510:x1868789712983424:12345-0@lo:502: Request processed in 108us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216881.532281:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1782216881.532545:0:9510:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4263ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:9510:1868789712983424:0@lo:502: 00000040:00080000:1.0:1782216881.532791:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1782216881.532820:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1782216881.532848:0:9510:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:9510:1868789712983552:0@lo:502: 00000100:00100000:1.0:1782216881.532898:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216881.532919:0:9510:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e7b1a7540 going to sleep for 11 seconds 00000100:00100000:0.0:1782216881.533409:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712983552 00000100:00100000:0.0:1782216881.533415:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712983552 00000100:00100000:0.0:1782216881.533455:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1782216881.533463:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:9510:x1868789712983552:12345-0@lo:502: 00000100:00100000:0.0:1782216881.533551:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:9510:x1868789712983552:12345-0@lo:502: Request processed in 87us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216881.533558:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1782216881.533815:0:9510:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:9510:1868789712983552:0@lo:502: 00000040:00080000:1.0:1782216881.533861:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1782216881.533871:0:9510:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1782216881.544061:0:9525:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782216881.544072:0:9525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782216881.544074:0:9525:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1782216881.544082:0:9525:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff952e7dbbd800 00000020:00000080:3.0:1782216881.544085:0:9525:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1782216881.544094:0:9525:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782216881.544097:0:9525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782216881.544099:0:9525:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1782216881.544102:0:9525:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1782216881.544268:0:9510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1782216881.544293:0:9510:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782216881.544315:0:9510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7b362a00/0x92b8e04cbf5f9241 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f9248 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.544327:0:9510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e7b362a00/0x92b8e04cbf5f9241 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f9248 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782216881.544373:0:9510:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1782216881.544377:0:9510:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff952e7dbbd800 10000000:01000000:1.0:1782216881.544380:0:9510:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff952e7dbbd800 10000000:01000000:1.0:1782216881.544385:0:9510:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782216881.544390:0:9510:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff952e7dbbd800 from 1 10000000:01000000:1.0:1782216881.544393:0:9510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782216881.544426:0:9510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e41681000/0x92b8e04cbf5f924f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.544435:0:9510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e41681000/0x92b8e04cbf5f924f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216881.544446:0:9510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e41681000/0x92b8e04cbf5f924f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216881.544474:0:9510:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:9510:1868789712983680:0@lo:101: 00000100:00100000:1.0:1782216881.544539:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216881.544600:0:9510:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e7b1a7480 going to sleep for 11 seconds 00000100:00100000:3.0:1782216881.544795:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712983680 00000100:00100000:3.0:1782216881.544807:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712983680 00000100:00100000:3.0:1782216881.544843:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1782216881.544851:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:9510:x1868789712983680:12345-0@lo:101: 00010000:00010000:3.0:1782216881.544864:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782216881.544876:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e7b362800/0x92b8e04cbf5f9256 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f924f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216881.544905:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e7b362800/0x92b8e04cbf5f9256 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f924f expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216881.544916:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e7b362800/0x92b8e04cbf5f9256 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f924f expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216881.544924:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b362800, rc 0) 00000100:00100000:3.0:1782216881.545059:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:9510:x1868789712983680:12345-0@lo:101: Request processed in 208us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216881.545066:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1782216881.549440:0:9510:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:9510:1868789712983680:0@lo:101: 00010000:00010000:2.0:1782216881.549467:0:9510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e41681000/0x92b8e04cbf5f924f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f9256 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216881.549479:0:9510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e41681000/0x92b8e04cbf5f924f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f9256 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216881.552385:0:9510:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:9510:1868789712983808:0@lo:501: 00000100:00100000:3.0:1782216881.552455:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216881.552544:0:9510:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e50d58c00 going to sleep for 11 seconds 00000100:00100000:1.0:1782216881.554724:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712983808 00000100:00100000:1.0:1782216881.554737:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712983808 00000100:00100000:1.0:1782216881.554803:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1782216881.554813:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52589850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:9510:x1868789712983808:12345-0@lo:501: 00000100:00100000:1.0:1782216881.555222:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52589850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:9510:x1868789712983808:12345-0@lo:501: Request processed in 410us (2766us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216881.555231:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1782216881.555458:0:9510:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:9510:1868789712983808:0@lo:501: 00000100:00100000:3.0:1782216881.555518:0:9510:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4263e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:9510:1868789712983936:0@lo:503: 00000100:00100000:3.0:1782216881.555572:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216881.555761:0:9510:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e50d58c00 going to sleep for 11 seconds 00000100:00100000:0.0:1782216881.555795:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712983936 00000100:00100000:0.0:1782216881.555801:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712983936 00000100:00100000:0.0:1782216881.555863:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1782216881.555872:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52588c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:9510:x1868789712983936:12345-0@lo:503: 00000100:00100000:0.0:1782216881.556094:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52588c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:9510:x1868789712983936:12345-0@lo:503: Request processed in 222us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216881.556102:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1782216881.556171:0:9510:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4263e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:9510:1868789712983936:0@lo:503: 00000040:00080000:1.0:1782216881.556762:0:9510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782216881.556837:0:9510:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:9510:1868789712984064:0@lo:502: 00000100:00100000:1.0:1782216881.556892:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216881.556975:0:9510:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e7b1a7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782216881.557068:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712984064 00000100:00100000:0.0:1782216881.557074:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712984064 00000100:00100000:0.0:1782216881.557109:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1782216881.557117:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52589450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:9510:x1868789712984064:12345-0@lo:502: 00000100:00100000:0.0:1782216881.557210:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52589450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:9510:x1868789712984064:12345-0@lo:502: Request processed in 93us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216881.557218:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1782216881.557432:0:9510:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:9510:1868789712984064:0@lo:502: 00000040:00080000:1.0:1782216881.557763:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1782216881.557789:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1782216881.557802:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1782216881.557815:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1782216881.557827:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1782216881.557840:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1782216881.557854:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1782216881.557867:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1782216881.557879:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1782216881.557903:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1782216881.557926:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1782216881.557939:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1782216881.557953:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1782216881.558063:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1782216881.558079:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1782216881.558092:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1782216881.558121:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1782216881.558138:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1782216881.558150:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1782216881.558162:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1782216881.558174:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1782216881.558186:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1782216881.558198:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1782216881.558213:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1782216881.558227:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1782216881.558240:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1782216881.558251:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1782216881.558263:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1782216881.558275:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1782216881.558287:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1782216881.558377:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1782216881.558401:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1782216881.558425:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1782216881.558439:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1782216881.558453:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1782216881.558463:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1782216881.558473:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:1.0:1782216881.558485:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1782216881.558497:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:1.0:1782216881.558509:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:1.0:1782216881.558521:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:1.0:1782216881.558532:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:1.0:1782216881.558546:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:1.0:1782216881.558571:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:1.0:1782216881.558731:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:1.0:1782216881.558750:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:1.0:1782216881.558784:0:9510:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:9510:1868789712984192:0@lo:502: 00000100:00100000:1.0:1782216881.558845:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216881.558936:0:9510:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e7b1a7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782216881.559034:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712984192 00000100:00100000:0.0:1782216881.559041:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712984192 00000100:00100000:0.0:1782216881.559116:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1782216881.559128:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52589050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:9510:x1868789712984192:12345-0@lo:502: 00000100:00100000:0.0:1782216881.559233:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52589050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:9510:x1868789712984192:12345-0@lo:502: Request processed in 107us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216881.559241:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1782216881.559327:0:9510:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:9510:1868789712984192:0@lo:502: 00000040:00080000:3.0:1782216881.559377:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:3.0:1782216881.559387:0:9510:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:3.0:1782216881.559882:0:9526:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1782216881.559913:0:9526:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff952d43340000) 00000020:00000080:3.0:1782216881.559935:0:9526:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:3.0:1782216881.560108:0:9526:0:(tgt_mount.c:153:server_get_mount()) get mount ffff952e7dbbd800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1782216881.560112:0:9526:0:(tgt_mount.c:187:server_put_mount()) put mount ffff952e7dbbd800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1782216881.560115:0:9526:0:(obd_mount.c:701:lustre_put_lsi()) put ffff952e7dbbd800 3 00010000:00080000:3.0:1782216881.560141:0:9526:0:(ldlm_lib.c:102:import_set_conn()) imp ffff952d430ff800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.130@tcp at head 00010000:00010000:3.0:1782216881.562309:0:9526:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:3.0:1782216881.562415:0:9526:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1782216881.562464:0:9526:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1782216881.562476:0:9526:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x92b8e04cbf5f9264 00000100:00080000:3.0:1782216881.562486:0:9526:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782216881.562492:0:9526:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff952d430ff800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1782216881.562530:0:9526:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff952d4263d880 x1868789712984320/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782216881.562564:0:9526:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1782216881.564854:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4263d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1868789712984320:0@lo:38: 00000100:00100000:0.0:1782216881.564941:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216881.565169:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1868789712984832:0@lo:400: 00000100:00100000:0.0:1782216881.565193:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216881.565226:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1868789712984448:0@lo:400: 00000100:00100000:2.0:1782216881.566367:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789712984576:0@lo:400: 00000100:00100000:2.0:1782216881.566412:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216881.566443:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789712985088:0@lo:400: 00000100:00100000:2.0:1782216881.566465:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216881.566487:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1782216881.566502:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1868789712984704:0@lo:400: 00000100:00100000:3.0:1782216881.566875:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712984576 00000100:00100000:3.0:1782216881.566892:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712984576 00000100:00100000:3.0:1782216881.566945:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1782216881.566954:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789712984576:12345-0@lo:400: 00000100:00100000:3.0:1782216881.567147:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789712984576:12345-0@lo:400: Request processed in 193us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216881.567154:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000020:01000004:3.0:1782216881.567285:0:9526:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1782216881.567300:0:9526:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff952d433419c0) 00000020:00000080:3.0:1782216881.567323:0:9526:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:3.0:1782216881.567503:0:9526:0:(tgt_mount.c:153:server_get_mount()) get mount ffff952e7dbbd800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1782216881.567507:0:9526:0:(tgt_mount.c:187:server_put_mount()) put mount ffff952e7dbbd800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1782216881.567510:0:9526:0:(obd_mount.c:701:lustre_put_lsi()) put ffff952e7dbbd800 3 00010000:00080000:3.0:1782216881.567542:0:9526:0:(ldlm_lib.c:102:import_set_conn()) imp ffff952e7dbbf800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.130@tcp at head 00010000:00010000:3.0:1782216881.569705:0:9526:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:3.0:1782216881.569799:0:9526:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1782216881.569839:0:9526:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1782216881.569850:0:9526:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x92b8e04cbf5f9272 00000100:00080000:3.0:1782216881.569859:0:9526:0:(import.c:512:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782216881.569864:0:9526:0:(import.c:626:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff952e7dbbf800 using connection 192.168.203.130@tcp/0@lo 00000100:00080000:2.0:1782216881.570026:0:9527:0:(client.c:1831:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff952d41be7100 x1868789712985344/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216881.570039:0:9527:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d427fb180 going to sleep for 0 seconds 00000100:00100000:0.0:1782216881.570238:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712985088 00000100:00100000:0.0:1782216881.570244:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712985088 00000100:00100000:0.0:1782216881.570289:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782216881.570299:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789712985088:12345-0@lo:400: 00000100:00100000:0.0:1782216881.570360:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789712985088:12345-0@lo:400: Request processed in 62us (3892us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216881.570368:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782216881.570397:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216881.570425:0:9526:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff952d4263c380 x1868789712985472/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782216881.570443:0:9526:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1782216881.573228:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712984320 00000100:00100000:1.0:1782216881.573238:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712984320 00000100:00100000:1.0:1782216881.573299:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712984832 00000100:00100000:1.0:1782216881.573303:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712984832 00000100:00100000:1.0:1782216881.573336:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1782216881.573345:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1868789712984832:12345-0@lo:400: 00000100:00100000:1.0:1782216881.573424:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1868789712984832:12345-0@lo:400: Request processed in 80us (8229us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216881.573432:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1782216881.573446:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782216881.573451:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1868789712984320:12345-0@lo:38: 00010000:00080000:1.0:1782216881.573470:0:6548:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 244 last 0 00000020:00000080:1.0:1782216881.574911:0:6548:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x92b8e04cbf5f9279 00000004:00100000:1.0:1782216881.574931:0:6548:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1782216881.575028:0:6548:0:(import.c:65:import_set_state_nolock()) ffff952e7b2bb000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782216881.575091:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1868789712984320:12345-0@lo:38: Request processed in 1636us (10149us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216881.575100:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1782216881.575160:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952e7c6f3480 x1868789712984832/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216881.575175:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1868789712984832:0@lo:400: 00000100:00100000:0.0:1782216881.575325:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789712985216:0@lo:400: 00000100:00100000:0.0:1782216881.575360:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216881.575460:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789712984576:0@lo:400: 00010000:00080000:0.0:1782216881.575474:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952e7c6f0000 x1868789712985088/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216881.575483:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789712985088:0@lo:400: 00000100:00100000:0.0:1782216881.575509:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216881.575529:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1868789712984960:0@lo:400: 00000100:00100000:0.0:1782216881.575551:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216881.575576:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712985216 00000100:00100000:0.0:1782216881.575599:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712985216 00000100:00100000:0.0:1782216881.575633:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782216881.575642:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789712985216:12345-0@lo:400: 00000100:00100000:0.0:1782216881.575681:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789712985216:12345-0@lo:400: Request processed in 40us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216881.575688:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782216881.575707:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4263c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1868789712985472:0@lo:38: 00000100:00100000:0.0:1782216881.575735:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1782216881.575762:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952d4263d880 x1868789712984320/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782216891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216881.575782:0:3646:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782216881.575788:0:3646:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1782216881.575796:0:3646:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00100000:1.0:1782216881.575912:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712984704 00000100:00100000:1.0:1782216881.575917:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712984704 00000100:00100000:1.0:1782216881.575936:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712984448 00000100:00100000:1.0:1782216881.575938:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712984448 00000100:00100000:1.0:1782216881.575947:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712984960 00000100:00100000:1.0:1782216881.575949:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712984960 00000100:00100000:1.0:1782216881.575958:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712985472 00000100:00100000:2.0:1782216881.576085:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1782216881.576095:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1868789712984704:12345-0@lo:400: 00000100:00100000:2.0:1782216881.576131:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1868789712984704:12345-0@lo:400: Request processed in 38us (5734us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216881.576137:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1782216881.576148:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1782216881.576153:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1868789712984448:12345-0@lo:400: 00000100:00100000:2.0:1782216881.576182:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1868789712984448:12345-0@lo:400: Request processed in 29us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216881.576189:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1782216881.576199:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1782216881.576206:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1868789712984960:12345-0@lo:400: 00000100:00100000:2.0:1782216881.576228:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1868789712984960:12345-0@lo:400: Request processed in 23us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216881.576234:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782216881.576448:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712985472 00000100:00100000:1.0:1782216881.576472:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782216881.576478:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1868789712985472:12345-0@lo:38: 00010000:00080000:1.0:1782216881.576498:0:6548:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 244 last 0 00000020:00000080:1.0:1782216881.576528:0:6548:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x92b8e04cbf5f9280 00000004:00100000:1.0:1782216881.576541:0:6548:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1782216881.576566:0:6548:0:(import.c:65:import_set_state_nolock()) ffff952e7b2bd000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782216881.576622:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1868789712985472:12345-0@lo:38: Request processed in 142us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216881.576629:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1782216881.576686:0:3646:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1782216881.576689:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952d430ff800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1782216881.576697:0:3646:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000f6a80654): req@ffff952d41be7100 x1868789712985344/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216881.576721:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4263d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1868789712984320:0@lo:38: 00010000:00080000:0.0:1782216881.576748:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952d4263c380 x1868789712985472/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782216891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216881.576757:0:3646:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782216881.576761:0:3646:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1782216881.576767:0:3646:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1782216881.576770:0:3646:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1782216881.576772:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952e7dbbf800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1782216881.576776:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4263c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1868789712985472:0@lo:38: 00010000:00080000:0.0:1782216881.576917:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952e7c6f0380 x1868789712984704/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216881.576927:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1868789712984704:0@lo:400: 00010000:00080000:0.0:1782216881.576937:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952e7c6f0a80 x1868789712985216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216881.576945:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789712985216:0@lo:400: 00000040:00080000:3.0:1782216881.577185:0:9526:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000100:00100000:1.0:1782216881.577515:0:9527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216881.577549:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712985344 00000100:00100000:1.0:1782216881.577553:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712985344 00000100:00100000:1.0:1782216881.577615:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782216881.577622:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d410b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9527:x1868789712985344:12345-0@lo:901: 00000100:00100000:1.0:1782216881.577697:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d410b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9527:x1868789712985344:12345-0@lo:901: Request processed in 75us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216881.577704:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1782216881.577720:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1782216881.577739:0:9527:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952d41be7100 x1868789712985344/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1782216897 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216881.577768:0:9527:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be7100 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9527:1868789712985344:0@lo:901: 00010000:00080000:0.0:1782216881.577915:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952e7c6f2300 x1868789712984448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216881.577931:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1868789712984448:0@lo:400: 00010000:00080000:0.0:1782216881.577945:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952e7c6f1500 x1868789712984960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216881.577952:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1868789712984960:0@lo:400: 00000020:01000000:2.0:1782216881.578496:0:9510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:2.0:1782216881.578529:0:9510:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782216881.578546:0:9510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e41681000/0x92b8e04cbf5f924f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f9256 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216881.578558:0:9510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e41681000/0x92b8e04cbf5f924f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f9256 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1782216881.578633:0:9510:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1782216881.578635:0:9510:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782216881.578637:0:9510:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782216881.578638:0:9510:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782216881.578640:0:9510:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782216881.578642:0:9510:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782216881.578643:0:9510:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782216881.578645:0:9510:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782216881.578647:0:9510:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782216881.578649:0:9510:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782216881.578651:0:9510:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782216881.578655:0:9510:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1782216881.578658:0:9510:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782216881.578659:0:9510:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782216881.578660:0:9510:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782216881.578662:0:9510:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782216881.578663:0:9510:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782216881.578664:0:9510:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782216881.578665:0:9510:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782216881.578666:0:9510:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782216881.578667:0:9510:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782216881.578669:0:9510:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782216881.578670:0:9510:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782216881.578690:0:9510:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1782216881.578703:0:9510:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:9510:1868789712985600:0@lo:253: 00000100:00100000:2.0:1782216881.578748:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216881.578784:0:9510:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d427fb0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782216881.578918:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712985600 00000100:00100000:3.0:1782216881.578923:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712985600 00000100:00100000:3.0:1782216881.582494:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1782216881.582511:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:9510:x1868789712985600:12345-0@lo:253: 20000000:01000000:3.0:1782216881.582544:0:6514:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1782216881.582559:0:6514:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1782216881.609687:0:6514:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1782216881.609703:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1782216881.609912:0:6534:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1782216881.609918:0:6534:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1782216881.609939:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff952e7c449000/0x92b8e04cbf5f9287 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216881.609966:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952e413fc800/0x92b8e04cbf5f917d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9176 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216881.609974:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952e7c448800/0x92b8e04cbf5f91c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f91bc expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216881.609981:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff952e7c449000/0x92b8e04cbf5f9287 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216881.610015:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952e7c448800/0x92b8e04cbf5f91c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5f91bc expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216881.610028:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff952e7c448800/0x92b8e04cbf5f91c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5f91bc expref: 17 pid: 6514 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216881.610040:0:6534:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f1500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1868789712985728:0@lo:104: 00000100:00100000:3.0:1782216881.610048:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:9510:x1868789712985600:12345-0@lo:253: Request processed in 27543us (31299us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216881.610057:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1782216881.610074:0:6534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782216881.610114:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952e413fc800/0x92b8e04cbf5f917d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5f9176 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216881.610139:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff952e413fc800/0x92b8e04cbf5f917d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9176 expref: 16 pid: 6514 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216881.610148:0:6534:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f0a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1868789712985856:0@lo:104: 00000100:00100000:0.0:1782216881.610172:0:6534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216881.610187:0:9510:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:17bce19a-7a0f-4c9d-b31c-4e0155298487:9510:1868789712985600:0@lo:253: 00000100:00100000:0.0:1782216881.610194:0:6534:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d427ae0c0 going to sleep for 11 seconds 10000000:01000000:2.0:1782216881.610198:0:9510:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1782216881.610201:0:9510:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782216881.610202:0:9510:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782216881.610204:0:9510:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782216881.610205:0:9510:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782216881.610207:0:9510:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782216881.610208:0:9510:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000100:00100000:0.0:1782216881.610210:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712985728 00000020:01000004:2.0:1782216881.610214:0:9510:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000100:00100000:0.0:1782216881.610215:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712985728 00000020:01000004:2.0:1782216881.610216:0:9510:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782216881.610217:0:9510:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782216881.610219:0:9510:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782216881.610220:0:9510:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1782216881.610235:0:9510:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1782216881.610241:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712985856 00000100:00100000:0.0:1782216881.610243:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712985856 00000100:00100000:0.0:1782216881.610254:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782216881.610260:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+4:6534:x1868789712985728:12345-0@lo:104: 00010000:00010000:0.0:1782216881.610272:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff952e7c449e00/0x92b8e04cbf5f91bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f91c3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216881.610313:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782216881.610318:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+4:6534:x1868789712985728:12345-0@lo:104: Request processed in 59us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216881.610323:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782216881.610335:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782216881.610340:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+3:6534:x1868789712985856:12345-0@lo:104: 00010000:00010000:0.0:1782216881.610346:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff952e7c449600/0x92b8e04cbf5f9176 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f917d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216881.610373:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1782216881.610378:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+3:6534:x1868789712985856:12345-0@lo:104: Request processed in 37us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216881.610392:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782216881.610417:0:6534:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f1500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1868789712985728:0@lo:104: 00000100:00100000:0.0:1782216881.610424:0:6534:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f0a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1868789712985856:0@lo:104: 00010000:00010000:0.0:1782216881.610438:0:6534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff952e7c449000/0x92b8e04cbf5f9287 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216881.616015:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782216881.616027:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e7c449e00/0x92b8e04cbf5f91bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f91c3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216881.616038:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7c449e00 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:3.0:1782216881.616043:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e7c449e00/0x92b8e04cbf5f91bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5f91c3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216881.616075:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e7c449e00/0x92b8e04cbf5f91bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5f91c3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782216881.616084:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e7c449e00/0x92b8e04cbf5f91bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5f91c3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782216881.616090:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1782216881.616149:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e7c449e00/0x92b8e04cbf5f91bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f91c3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216881.616157:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782216881.616179:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e7c449e00/0x92b8e04cbf5f91bc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f91c3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216881.616187:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e7c449e00/0x92b8e04cbf5f91bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f91c3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216881.616203:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782216881.616206:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e7c449600/0x92b8e04cbf5f9176 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f917d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216881.616212:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7c449600 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:3.0:1782216881.616215:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e7c449600/0x92b8e04cbf5f9176 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5f917d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216881.616222:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e7c449600/0x92b8e04cbf5f9176 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5f917d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782216881.616229:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e7c449600/0x92b8e04cbf5f9176 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5f917d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782216881.616240:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1782216881.616254:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e7c449600/0x92b8e04cbf5f9176 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f917d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216881.616260:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782216881.616266:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e7c449600/0x92b8e04cbf5f9176 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f917d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216881.616273:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e7c449600/0x92b8e04cbf5f9176 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f917d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216881.616286:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216881.616288:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216881.616290:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782216881.616857:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4263c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17bce19a-7a0f-4c9d-b31c-4e0155298487:3648:1868789712986112:0@lo:103: 00000100:00100000:0.0:1782216881.616936:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216881.616946:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4263f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789712985984:0@lo:103: 00000100:00100000:1.0:1782216881.616985:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216881.617009:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712986112 00010000:00010000:1.0:1782216881.617012:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782216881.617015:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712986112 00000100:00100000:1.0:1782216881.617019:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712985984 00000100:00100000:1.0:1782216881.617022:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712985984 00010000:00010000:1.0:1782216881.617043:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952e7c448800/0x92b8e04cbf5f91c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f91bc expref: 18 pid: 6514 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216881.617043:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952e413fc800/0x92b8e04cbf5f917d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9176 expref: 18 pid: 6514 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216881.617071:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782216881.617079:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17bce19a-7a0f-4c9d-b31c-4e0155298487+18:3648:x1868789712986112:12345-0@lo:103: 00010000:00010000:0.0:1782216881.617091:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782216881.617096:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952e413fc800/0x92b8e04cbf5f917d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9176 expref: 18 pid: 6514 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216881.617106:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952e413fc800/0x92b8e04cbf5f917d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9176 expref: 18 pid: 6514 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216881.617120:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e413fc800/0x92b8e04cbf5f917d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5f9176 expref: 18 pid: 6514 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216881.617135:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782216881.617176:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:3648:x1868789712986112:12345-0@lo:103: Request processed in 98us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216881.617194:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782216881.617210:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782216881.617216:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d410b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:3647:x1868789712985984:12345-0@lo:103: 00010000:00010000:0.0:1782216881.617224:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782216881.617228:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952e7c448800/0x92b8e04cbf5f91c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f91bc expref: 16 pid: 6514 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216881.617239:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952e7c448800/0x92b8e04cbf5f91c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5f91bc expref: 16 pid: 6514 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216881.617249:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e7c448800/0x92b8e04cbf5f91c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5f91bc expref: 16 pid: 6514 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216881.617261:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff952e7c449000/0x92b8e04cbf5f9287 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216881.617269:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e7c449000/0x92b8e04cbf5f9287 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1782216881.617283:0:6506:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007366109s 00010000:00010000:0.0:1782216881.617288:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff952e7c449000/0x92b8e04cbf5f9287 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216881.617296:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff952e7c449000/0x92b8e04cbf5f9287 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216881.617303:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff952e7c449000/0x92b8e04cbf5f9287 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216881.617309:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff952e7c449000/0x92b8e04cbf5f9287 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216881.617321:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7c449000 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:0.0:1782216881.617326:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff952e7c449000/0x92b8e04cbf5f9287 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216881.617334:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff952e7c449000/0x92b8e04cbf5f9287 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216881.617347:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff952e7c449000/0x92b8e04cbf5f9287 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216881.617356:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782216881.617382:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d410b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:3647:x1868789712985984:12345-0@lo:103: Request processed in 165us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216881.617388:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782216881.617446:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4263c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17bce19a-7a0f-4c9d-b31c-4e0155298487:3648:1868789712986112:0@lo:103: 00080000:10000000:2.0:1782216881.620281:0:9510:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1782216881.620459:0:9510:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1782216881.620668:0:9510:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1782216881.622455:0:9510:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1782216881.624113:0:9510:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1782216881.624720:0:9510:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000100:00100000:0.0:1782216881.625104:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4263f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789712985984:0@lo:103: 00010000:00010000:3.0:1782216881.625210:0:6534:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff952e7c449000/0x92b8e04cbf5f9287 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216881.625221:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff952e7c449000/0x92b8e04cbf5f9287 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216881.625228:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e7c449000/0x92b8e04cbf5f9287 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:3.0:1782216881.626759:0:9510:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1782216881.635340:0:9510:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1782216881.635349:0:9510:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1782216881.635391:0:9510:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1782216881.635433:0:9510:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.130@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1782216881.635453:0:9510:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1782216881.635474:0:9510:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1782216881.637779:0:9510:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782216881.641566:0:9510:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1782216881.657306:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782216882.234944:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782216882.234979:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4263c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789712986240:0@lo:41: 00000100:00100000:3.0:1782216882.235045:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216882.235108:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712986240 00000100:00100000:3.0:1782216882.235127:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712986240 00000100:00100000:3.0:1782216882.235173:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1782216882.235181:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4263e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789712986240:12345-0@lo:41: 00000004:00000024:3.0:1782216882.235213:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1782216882.235254:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4263e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789712986240:12345-0@lo:41: Request processed in 73us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216882.235261:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1782216882.235305:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4263c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789712986240:0@lo:41: 00000020:00000004:2.0:1782216882.556489:0:9582:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782216882.557284:0:9582:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1782216882.690320:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216883.707275:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216884.729933:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216885.759741:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782216885.816894:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782216885.816919:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789712986368:0@lo:13: 00000100:00100000:0.0:1782216885.816986:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216885.817062:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712986368 00000100:00100000:0.0:1782216885.817069:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712986368 00000100:00100000:0.0:1782216885.817117:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782216885.817127:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46db2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789712986368:12345-0@lo:13: 00002000:00000024:0.0:1782216885.817156:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782216885.817197:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46db2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789712986368:12345-0@lo:13: Request processed in 72us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216885.817205:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1782216885.817224:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782216885.817265:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7c6f1500 x1868789712986368/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216901 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216885.817282:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789712986368:0@lo:13: 00000100:00100000:3.0:1782216885.817738:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782216885.817750:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789712986496:0@lo:13: 00000100:00100000:3.0:1782216885.817786:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216885.817915:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712986496 00000100:00100000:2.0:1782216885.817921:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712986496 00000100:00100000:2.0:1782216885.817963:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782216885.817970:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4263c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789712986496:12345-0@lo:13: 00002000:00000024:2.0:1782216885.817983:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782216885.818016:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4263c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789712986496:12345-0@lo:13: Request processed in 47us (229us total) trans 0 rc 0/0 00000100:00080000:3.0:1782216885.818085:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782216885.818106:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d41be6d80 x1868789712986496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216901 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216885.818120:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789712986496:0@lo:13: 00000100:00100000:2.0:1782216885.818171:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782216886.332054:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789712986624:0@lo:41: 00000100:00100000:0.0:1782216886.332125:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216886.332196:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712986624 00000100:00100000:0.0:1782216886.332203:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712986624 00000100:00100000:0.0:1782216886.332243:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1782216886.332252:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789712986624:12345-0@lo:41: 00000004:00000024:0.0:1782216886.332283:0:7938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1782216886.332325:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789712986624:12345-0@lo:41: Request processed in 73us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216886.332333:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1782216886.332378:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789712986624:0@lo:41: 00010000:00010000:1.0:1782216886.778114:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782216886.841971:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789712987008:0@lo:400: 00000100:00100000:0.0:1782216886.842069:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216886.842120:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e72e8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789712987520:0@lo:400: 00000100:00100000:0.0:1782216886.842145:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216886.842173:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782216886.842179:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1868789712987136:0@lo:400: 00000100:00100000:0.0:1782216886.842203:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216886.842222:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e72e8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789712987648:0@lo:400: 00000100:00100000:0.0:1782216886.842240:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216886.842271:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712987520 00000100:00100000:0.0:1782216886.842276:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712987520 00000100:00100000:0.0:1782216886.842316:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712987648 00000100:00100000:0.0:1782216886.842326:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712987648 00000100:00100000:0.0:1782216886.842346:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782216886.842354:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42613100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789712987520:12345-0@lo:400: 00000100:00100000:0.0:1782216886.842402:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42613100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789712987520:12345-0@lo:400: Request processed in 47us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216886.842409:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782216886.842424:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782216886.842430:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42611f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789712987648:12345-0@lo:400: 00000100:00100000:0.0:1782216886.842457:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42611f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789712987648:12345-0@lo:400: Request processed in 27us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216886.842462:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782216886.842479:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712987136 00000100:00100000:0.0:1782216886.842482:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712987136 00000100:00100000:0.0:1782216886.842506:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1782216886.842512:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1868789712987136:12345-0@lo:400: 00000100:00100000:0.0:1782216886.842541:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1868789712987136:12345-0@lo:400: Request processed in 28us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216886.842547:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1782216886.842608:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7c6f1500 x1868789712987136/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216886.842621:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1868789712987136:0@lo:400: 00010000:00080000:0.0:1782216886.842635:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e72e8ea00 x1868789712987648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216886.842643:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e72e8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789712987648:0@lo:400: 00010000:00080000:0.0:1782216886.842652:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e72e8ed80 x1868789712987520/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216886.842672:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e72e8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789712987520:0@lo:400: 00000100:00100000:3.0:1782216886.842922:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789712986752:0@lo:400: 00000100:00100000:3.0:1782216886.842955:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216886.842977:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e72e8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1868789712987264:0@lo:400: 00000100:00100000:3.0:1782216886.842998:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216886.843015:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e72e8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1868789712987776:0@lo:400: 00000100:00100000:3.0:1782216886.843049:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216886.843067:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1782216886.843073:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1868789712986880:0@lo:400: 00000100:00100000:3.0:1782216886.843092:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216886.843104:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e72e8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1868789712987392:0@lo:400: 00000100:00100000:3.0:1782216886.843134:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216886.843150:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e72e8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1868789712987904:0@lo:400: 00000100:00100000:3.0:1782216886.843172:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216886.843195:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712987008 00000100:00100000:3.0:1782216886.843199:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712987008 00000100:00100000:3.0:1782216886.843226:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1782216886.843232:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789712987008:12345-0@lo:400: 00000100:00100000:3.0:1782216886.843266:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789712987008:12345-0@lo:400: Request processed in 34us (1199us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216886.843272:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1782216886.843287:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712987264 00000100:00100000:3.0:1782216886.843289:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712987264 00000100:00100000:3.0:1782216886.843309:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712987776 00000100:00100000:3.0:1782216886.843311:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712987776 00000100:00100000:3.0:1782216886.843321:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712986880 00000100:00100000:3.0:1782216886.843323:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712986880 00000100:00100000:3.0:1782216886.843332:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712987392 00000100:00100000:3.0:1782216886.843334:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712987392 00000100:00100000:3.0:1782216886.843343:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712987904 00000100:00100000:3.0:1782216886.843346:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712987904 00000100:00100000:3.0:1782216886.843358:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782216886.843362:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4263f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1868789712987264:12345-0@lo:400: 00000100:00100000:3.0:1782216886.843391:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4263f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1868789712987264:12345-0@lo:400: Request processed in 28us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216886.843396:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782216886.843406:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1782216886.843411:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4263ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1868789712987776:12345-0@lo:400: 00000100:00100000:3.0:1782216886.843435:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4263ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1868789712987776:12345-0@lo:400: Request processed in 24us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216886.843446:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1782216886.843457:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1782216886.843462:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4263dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1868789712986880:12345-0@lo:400: 00000100:00100000:3.0:1782216886.843489:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4263dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1868789712986880:12345-0@lo:400: Request processed in 26us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216886.843495:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1782216886.843519:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1782216886.843525:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4263c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1868789712987392:12345-0@lo:400: 00000100:00100000:3.0:1782216886.843550:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4263c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1868789712987392:12345-0@lo:400: Request processed in 26us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216886.843556:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1782216886.843567:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1782216886.843572:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4263d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1868789712987904:12345-0@lo:400: 00000100:00100000:3.0:1782216886.843616:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4263d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1868789712987904:12345-0@lo:400: Request processed in 43us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216886.843621:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1782216886.843642:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782216886.843645:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1782216886.843665:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e46da4000 x1868789712986880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216886.843675:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1868789712986880:0@lo:400: 00010000:00080000:3.0:1782216886.843685:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e72e8e300 x1868789712987392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216886.843692:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e72e8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1868789712987392:0@lo:400: 00010000:00080000:3.0:1782216886.843711:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e72e8c380 x1868789712987904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216886.843719:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e72e8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1868789712987904:0@lo:400: 00010000:00080000:3.0:1782216886.843729:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e72e8ca80 x1868789712987264/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216886.843735:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e72e8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1868789712987264:0@lo:400: 00010000:00080000:3.0:1782216886.843743:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e72e8c000 x1868789712987776/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216886.843750:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e72e8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1868789712987776:0@lo:400: 00000100:00100000:3.0:1782216886.843778:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789712987008:0@lo:400: 00000100:00100000:0.0:1782216886.843930:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712986752 00000100:00100000:0.0:1782216886.843935:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712986752 00000100:00100000:0.0:1782216886.843977:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1782216886.843983:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:3649:x1868789712986752:12345-0@lo:400: 00000100:00100000:0.0:1782216886.844017:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:3649:x1868789712986752:12345-0@lo:400: Request processed in 35us (1062us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216886.844024:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1782216886.844150:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789712986752:0@lo:400: 00000100:00100000:0.0:1782216887.352839:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4263d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789712988032:0@lo:41: 00000100:00100000:0.0:1782216887.352928:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216887.353130:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712988032 00000100:00100000:3.0:1782216887.353138:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712988032 00000100:00100000:3.0:1782216887.353187:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1782216887.353196:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789712988032:12345-0@lo:41: 00000004:00000024:3.0:1782216887.353228:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1782216887.353356:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789712988032:12345-0@lo:41: Request processed in 160us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216887.353364:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1782216887.353425:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4263d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789712988032:0@lo:41: 00000001:02000400:0.0:1782216887.683740:0:9872:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1782216887.801146:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1782216888.478007:0:9924:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1782216888.478244:0:9924:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1782216888.825153:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216889.851153:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216890.873734:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782216890.936887:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789712988160:0@lo:13: 00000100:00100000:1.0:1782216890.937119:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216890.937770:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712988160 00000100:00100000:0.0:1782216890.937779:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712988160 00000100:00100000:0.0:1782216890.937851:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782216890.937862:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d410b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789712988160:12345-0@lo:13: 00002000:00000024:0.0:1782216890.937898:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782216890.937953:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d410b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789712988160:12345-0@lo:13: Request processed in 93us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216890.937961:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1782216890.937999:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d42612a00 x1868789712988160/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216906 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216890.938018:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789712988160:0@lo:13: 00000100:00080000:2.0:1782216890.938156:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782216890.939831:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782216890.939852:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789712988288:0@lo:13: 00000100:00100000:2.0:1782216890.939918:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216890.939963:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712988288 00000100:00100000:2.0:1782216890.939968:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712988288 00000100:00100000:2.0:1782216890.940014:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782216890.940022:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789712988288:12345-0@lo:13: 00002000:00000024:2.0:1782216890.940041:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782216890.940079:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789712988288:12345-0@lo:13: Request processed in 57us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216890.940086:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1782216890.940107:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782216890.940127:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d41be4e00 x1868789712988288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216906 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216890.940142:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789712988288:0@lo:13: 10000000:01000000:1.0:1782216890.940475:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1782216890.940480:0:6516:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff952e74b5e800 from 39 10000000:01000000:1.0:1782216890.940484:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782216890.940515:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e41680e00/0x92b8e04cbf5f928e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216890.940525:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e41680e00/0x92b8e04cbf5f928e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216890.940534:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e41680e00/0x92b8e04cbf5f928e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216890.940566:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712988416:0@lo:101: 00000100:00100000:1.0:1782216890.940634:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216890.940703:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e7c793780 going to sleep for 11 seconds 00000100:00100000:3.0:1782216890.942324:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712988416 00000100:00100000:3.0:1782216890.942337:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712988416 00000100:00100000:3.0:1782216890.942408:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1782216890.942418:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:6516:x1868789712988416:12345-0@lo:101: 00010000:00010000:3.0:1782216890.942433:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782216890.942448:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e7b362200/0x92b8e04cbf5f9295 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f928e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216890.942474:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e7b362200/0x92b8e04cbf5f9295 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f928e expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216890.942484:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e7b362200/0x92b8e04cbf5f9295 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f928e expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216890.942492:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b362200, rc 0) 00000100:00100000:3.0:1782216890.942609:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:6516:x1868789712988416:12345-0@lo:101: Request processed in 192us (1973us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216890.942616:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1782216890.943020:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712988416:0@lo:101: 00010000:00010000:1.0:1782216890.943039:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e41680e00/0x92b8e04cbf5f928e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f9295 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216890.943048:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e41680e00/0x92b8e04cbf5f928e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f9295 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216890.943117:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712988544:0@lo:501: 00000100:00100000:1.0:1782216890.943151:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216890.943225:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e7c793780 going to sleep for 11 seconds 00000100:00100000:3.0:1782216890.943327:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712988544 00000100:00100000:3.0:1782216890.943332:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712988544 00000100:00100000:3.0:1782216890.943393:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1782216890.943401:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52588050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:6516:x1868789712988544:12345-0@lo:501: 00000100:00100000:3.0:1782216890.943517:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52588050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:6516:x1868789712988544:12345-0@lo:501: Request processed in 116us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216890.943524:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1782216890.943610:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712988544:0@lo:501: 00000100:00100000:1.0:1782216890.943636:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712988672:0@lo:503: 00000100:00100000:1.0:1782216890.943676:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216890.943702:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e7c793780 going to sleep for 11 seconds 00000100:00100000:3.0:1782216890.943803:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712988672 00000100:00100000:3.0:1782216890.943807:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712988672 00000100:00100000:3.0:1782216890.943835:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1782216890.943840:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52588850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:6516:x1868789712988672:12345-0@lo:503: 00000100:00100000:3.0:1782216890.943928:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52588850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:6516:x1868789712988672:12345-0@lo:503: Request processed in 87us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216890.943940:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1782216890.944070:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712988672:0@lo:503: 00000100:00100000:1.0:1782216890.946155:0:10007:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10007:1868789712988800:0@lo:502: 00000100:00100000:1.0:1782216890.946228:0:10007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216890.946302:0:10007:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e7c793840 going to sleep for 11 seconds 00000100:00100000:3.0:1782216890.946336:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712988800 00000100:00100000:3.0:1782216890.946343:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712988800 00000100:00100000:3.0:1782216890.946386:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1782216890.946394:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:10007:x1868789712988800:12345-0@lo:502: 00000100:00100000:3.0:1782216890.946535:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:10007:x1868789712988800:12345-0@lo:502: Request processed in 140us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216890.946542:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1782216890.946828:0:10007:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10007:1868789712988800:0@lo:502: 00000100:00100000:1.0:1782216890.946876:0:10007:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10007:1868789712988928:0@lo:502: 00000100:00100000:1.0:1782216890.947194:0:10007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216890.947254:0:10007:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e45c70780 going to sleep for 11 seconds 00000100:00100000:2.0:1782216890.947288:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712988928 00000100:00100000:2.0:1782216890.947293:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712988928 00000100:00100000:2.0:1782216890.947328:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1782216890.947335:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:10007:x1868789712988928:12345-0@lo:502: 00000100:00100000:2.0:1782216890.947449:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:10007:x1868789712988928:12345-0@lo:502: Request processed in 115us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216890.947456:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1782216890.947544:0:10007:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10007:1868789712988928:0@lo:502: 00000040:00080000:1.0:1782216890.947562:0:10007:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1782216890.947990:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1782216890.948012:0:6516:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782216890.948022:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e41680e00/0x92b8e04cbf5f928e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f9295 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216890.948033:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e41680e00/0x92b8e04cbf5f928e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f9295 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782216890.948042:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1782216890.948045:0:6516:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1782216890.948048:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1782216890.948073:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7b362000/0x92b8e04cbf5f929c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216890.948080:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e7b362000/0x92b8e04cbf5f929c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216890.948088:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e7b362000/0x92b8e04cbf5f929c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216890.948101:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4263fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712989056:0@lo:101: 00000100:00100000:3.0:1782216890.948139:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216890.948208:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d427aec00 going to sleep for 11 seconds 00000100:00100000:0.0:1782216890.948246:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712989056 00000100:00100000:0.0:1782216890.948257:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712989056 00000100:00100000:0.0:1782216890.948328:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1782216890.948336:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52589c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:6516:x1868789712989056:12345-0@lo:101: 00010000:00010000:0.0:1782216890.948345:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782216890.948356:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e7c449200/0x92b8e04cbf5f92a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f929c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216890.948375:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e7c449200/0x92b8e04cbf5f92a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f929c expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216890.948385:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e7c449200/0x92b8e04cbf5f92a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f929c expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216890.948392:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7c449200, rc 0) 00000100:00100000:0.0:1782216890.948431:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52589c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:6516:x1868789712989056:12345-0@lo:101: Request processed in 96us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216890.948436:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1782216890.948494:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4263fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712989056:0@lo:101: 00010000:00010000:3.0:1782216890.948506:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e7b362000/0x92b8e04cbf5f929c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f92a3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216890.948515:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e7b362000/0x92b8e04cbf5f929c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f92a3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216890.948561:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4263fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712989184:0@lo:501: 00000100:00100000:3.0:1782216890.948613:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216890.948699:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d427aec00 going to sleep for 11 seconds 00000100:00100000:2.0:1782216890.949016:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712989184 00000100:00100000:2.0:1782216890.949022:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712989184 00000100:00100000:2.0:1782216890.949047:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1782216890.949053:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:6516:x1868789712989184:12345-0@lo:501: 00000100:00100000:2.0:1782216890.949181:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:6516:x1868789712989184:12345-0@lo:501: Request processed in 126us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216890.949188:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1782216890.949263:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4263fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712989184:0@lo:501: 00000100:00100000:3.0:1782216890.949291:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4263fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712989312:0@lo:503: 00000100:00100000:3.0:1782216890.949326:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216890.949351:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d427aec00 going to sleep for 11 seconds 00000100:00100000:2.0:1782216890.949399:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712989312 00000100:00100000:2.0:1782216890.949403:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712989312 00000100:00100000:2.0:1782216890.949420:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1782216890.949426:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:6516:x1868789712989312:12345-0@lo:503: 00000100:00100000:2.0:1782216890.949506:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:6516:x1868789712989312:12345-0@lo:503: Request processed in 79us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216890.949513:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1782216890.949606:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4263fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712989312:0@lo:503: 00000100:00100000:3.0:1782216890.951523:0:10008:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4263fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10008:1868789712989440:0@lo:502: 00000100:00100000:3.0:1782216890.951632:0:10008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216890.951669:0:10008:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d427ae600 going to sleep for 11 seconds 00000100:00100000:0.0:1782216890.951995:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712989440 00000100:00100000:0.0:1782216890.952001:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712989440 00000100:00100000:0.0:1782216890.952043:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1782216890.952052:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52588450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:10008:x1868789712989440:12345-0@lo:502: 00000100:00100000:0.0:1782216890.952164:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52588450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:10008:x1868789712989440:12345-0@lo:502: Request processed in 113us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216890.952171:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1782216890.952260:0:10008:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4263fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10008:1868789712989440:0@lo:502: 00000020:01000000:3.0:1782216890.952286:0:10008:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782216890.952294:0:10008:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782216890.952296:0:10008:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1782216890.952301:0:10008:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1782216890.952302:0:10008:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1782216890.952324:0:10008:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4263fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10008:1868789712989568:0@lo:502: 00000100:00100000:3.0:1782216890.952357:0:10008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216890.952381:0:10008:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d427ae600 going to sleep for 11 seconds 00000100:00100000:2.0:1782216890.952458:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712989568 00000100:00100000:2.0:1782216890.952463:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712989568 00000100:00100000:2.0:1782216890.952486:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1782216890.952492:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e195450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:10008:x1868789712989568:12345-0@lo:502: 00000100:00100000:2.0:1782216890.952562:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e195450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:10008:x1868789712989568:12345-0@lo:502: Request processed in 69us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216890.952568:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1782216890.952728:0:10008:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4263fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10008:1868789712989568:0@lo:502: 00000020:01000000:3.0:1782216890.953022:0:10008:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782216890.953027:0:10008:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782216890.953029:0:10008:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:3.0:1782216890.953033:0:10008:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1782216890.953241:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1782216890.953263:0:6516:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1782216890.953273:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7b362000/0x92b8e04cbf5f929c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f92a3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216890.953284:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e7b362000/0x92b8e04cbf5f929c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f92a3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782216890.953294:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1782216890.953297:0:6516:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff952e7b38d800 from 39 10000000:01000000:2.0:1782216890.953300:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782216890.953333:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e413fc400/0x92b8e04cbf5f92aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216890.953341:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e413fc400/0x92b8e04cbf5f92aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216890.953350:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e413fc400/0x92b8e04cbf5f92aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216890.953363:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712989696:0@lo:101: 00000100:00100000:2.0:1782216890.953395:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216890.953429:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d427ffa80 going to sleep for 11 seconds 00000100:00100000:3.0:1782216890.953490:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712989696 00000100:00100000:3.0:1782216890.953496:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712989696 00000100:00100000:3.0:1782216890.953535:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1782216890.953543:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e195050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:6516:x1868789712989696:12345-0@lo:101: 00010000:00010000:3.0:1782216890.953554:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782216890.953567:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e7b362e00/0x92b8e04cbf5f92b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f92aa expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216890.953626:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e7b362e00/0x92b8e04cbf5f92b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f92aa expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216890.953638:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e7b362e00/0x92b8e04cbf5f92b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f92aa expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216890.953648:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b362e00, rc 0) 00000100:00100000:3.0:1782216890.953681:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e195050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+18:6516:x1868789712989696:12345-0@lo:101: Request processed in 139us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216890.953687:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1782216890.953874:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712989696:0@lo:101: 00010000:00010000:2.0:1782216890.953886:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e413fc400/0x92b8e04cbf5f92aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f92b1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216890.954030:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e413fc400/0x92b8e04cbf5f92aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f92b1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216890.954092:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712989824:0@lo:501: 00000100:00100000:2.0:1782216890.954120:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216890.954149:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d427ffa80 going to sleep for 11 seconds 00000100:00100000:3.0:1782216890.954209:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712989824 00000100:00100000:3.0:1782216890.954214:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712989824 00000100:00100000:3.0:1782216890.954286:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1782216890.954304:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e197c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+18:6516:x1868789712989824:12345-0@lo:501: 00000100:00100000:3.0:1782216890.954434:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e197c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+18:6516:x1868789712989824:12345-0@lo:501: Request processed in 131us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216890.954441:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1782216890.954557:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712989824:0@lo:501: 00000100:00100000:2.0:1782216890.954598:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712989952:0@lo:503: 00000100:00100000:2.0:1782216890.954634:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216890.954909:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d427ffa80 going to sleep for 11 seconds 00000100:00100000:0.0:1782216890.955277:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712989952 00000100:00100000:0.0:1782216890.955283:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712989952 00000100:00100000:0.0:1782216890.955313:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1782216890.955320:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e196c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+18:6516:x1868789712989952:12345-0@lo:503: 00000100:00100000:0.0:1782216890.955488:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e196c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+18:6516:x1868789712989952:12345-0@lo:503: Request processed in 167us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216890.955502:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1782216890.955807:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712989952:0@lo:503: 00000100:00100000:1.0:1782216890.957008:0:10009:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10009:1868789712990080:0@lo:502: 00000100:00100000:1.0:1782216890.957065:0:10009:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216890.957142:0:10009:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e45c70540 going to sleep for 11 seconds 00000100:00100000:0.0:1782216890.957179:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712990080 00000100:00100000:0.0:1782216890.957186:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712990080 00000100:00100000:0.0:1782216890.960070:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1782216890.960089:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e197850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+18:10009:x1868789712990080:12345-0@lo:502: 00000100:00100000:0.0:1782216890.960248:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e197850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+18:10009:x1868789712990080:12345-0@lo:502: Request processed in 165us (3181us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216890.960255:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1782216890.960366:0:10009:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10009:1868789712990080:0@lo:502: 00000100:00100000:1.0:1782216890.960437:0:10009:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10009:1868789712990208:0@lo:502: 00000100:00100000:1.0:1782216890.960482:0:10009:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216890.965207:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712990208 00000100:00100000:3.0:1782216890.965229:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712990208 00000100:00100000:3.0:1782216890.965281:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1782216890.965290:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e194050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+18:10009:x1868789712990208:12345-0@lo:502: 00000100:00100000:3.0:1782216890.965445:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e194050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+18:10009:x1868789712990208:12345-0@lo:502: Request processed in 156us (4963us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216890.965453:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1782216890.965965:0:10009:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e7c793840 going to sleep for 11 seconds 00000100:00100000:1.0:1782216890.965990:0:10009:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10009:1868789712990208:0@lo:502: 00000040:00080000:1.0:1782216890.966155:0:10009:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1782216890.966493:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1782216890.966517:0:6516:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782216890.966527:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e413fc400/0x92b8e04cbf5f92aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f92b1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216890.966538:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e413fc400/0x92b8e04cbf5f92aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f92b1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782216890.966547:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1782216890.966550:0:6516:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff952e7b38d800 from 6 10000000:01000000:3.0:1782216890.966552:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1782216890.966656:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7b363200/0x92b8e04cbf5f92b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216890.966665:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e7b363200/0x92b8e04cbf5f92b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216890.966674:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e7b363200/0x92b8e04cbf5f92b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216890.966700:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4263fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712990336:0@lo:101: 00000100:00100000:3.0:1782216890.966827:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216890.966890:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d427aea80 going to sleep for 11 seconds 00000100:00100000:1.0:1782216890.966922:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712990336 00000100:00100000:1.0:1782216890.966928:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712990336 00000100:00100000:1.0:1782216890.966996:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1782216890.967005:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e194850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+18:6516:x1868789712990336:12345-0@lo:101: 00010000:00010000:1.0:1782216890.967016:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782216890.967039:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e41680c00/0x92b8e04cbf5f92bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f92b8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216890.967060:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e41680c00/0x92b8e04cbf5f92bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f92b8 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216890.967070:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e41680c00/0x92b8e04cbf5f92bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f92b8 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216890.967088:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e41680c00, rc 0) 00000100:00100000:1.0:1782216890.967128:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e194850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+19:6516:x1868789712990336:12345-0@lo:101: Request processed in 124us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216890.967135:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1782216890.967196:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4263fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712990336:0@lo:101: 00010000:00010000:3.0:1782216890.967209:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e7b363200/0x92b8e04cbf5f92b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f92bf expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216890.967541:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e7b363200/0x92b8e04cbf5f92b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f92bf expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216890.967610:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4263fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712990464:0@lo:256: 00000100:00100000:3.0:1782216890.967640:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216890.967654:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d427aea80 going to sleep for 11 seconds 00000100:00100000:3.0:1782216890.967667:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712990464 00000100:00100000:3.0:1782216890.967671:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712990464 00000100:00100000:3.0:1782216890.967691:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1782216890.967696:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e196450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+19:6516:x1868789712990464:12345-0@lo:256: 20000000:01000000:3.0:1782216890.967709:0:6511:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1782216890.967735:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1782216890.967738:0:6511:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1782216890.967811:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e196450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+19:6516:x1868789712990464:12345-0@lo:256: Request processed in 113us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216890.967830:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1782216890.967861:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4263fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712990464:0@lo:256: 10000000:01000000:3.0:1782216890.967899:0:6516:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1782216890.967905:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7b363200/0x92b8e04cbf5f92b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f92bf expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216890.967917:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e7b363200/0x92b8e04cbf5f92b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f92bf expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782216890.967924:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1782216890.967927:0:6516:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:3.0:1782216890.967929:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1782216890.967945:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7b363400/0x92b8e04cbf5f92c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216890.967953:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e7b363400/0x92b8e04cbf5f92c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216890.967961:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e7b363400/0x92b8e04cbf5f92c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216890.967972:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4263fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712990592:0@lo:101: 00000100:00100000:3.0:1782216890.967996:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216890.968010:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d427aea80 going to sleep for 11 seconds 00000100:00100000:3.0:1782216890.968034:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712990592 00000100:00100000:3.0:1782216890.968038:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712990592 00000100:00100000:3.0:1782216890.968055:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1782216890.968060:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e196850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+19:6516:x1868789712990592:12345-0@lo:101: 00010000:00010000:3.0:1782216890.968067:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782216890.968076:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e7b363a00/0x92b8e04cbf5f92cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f92c6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216890.968090:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e7b363a00/0x92b8e04cbf5f92cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f92c6 expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216890.968109:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e7b363a00/0x92b8e04cbf5f92cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f92c6 expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216890.968116:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b363a00, rc 0) 00000100:00100000:3.0:1782216890.968143:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e196850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+20:6516:x1868789712990592:12345-0@lo:101: Request processed in 82us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216890.968149:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1782216890.968174:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4263fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712990592:0@lo:101: 00010000:00010000:3.0:1782216890.968184:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e7b363400/0x92b8e04cbf5f92c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f92cd expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216890.968192:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e7b363400/0x92b8e04cbf5f92c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f92cd expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216890.968940:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4263fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712990720:0@lo:501: 00000100:00100000:3.0:1782216890.968976:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216890.968994:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d427aea80 going to sleep for 11 seconds 00000100:00100000:0.0:1782216890.969285:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712990720 00000100:00100000:0.0:1782216890.969292:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712990720 00000100:00100000:0.0:1782216890.969330:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1782216890.969338:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e195c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+20:6516:x1868789712990720:12345-0@lo:501: 00000100:00100000:0.0:1782216890.969452:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e195c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+20:6516:x1868789712990720:12345-0@lo:501: Request processed in 114us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216890.969459:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1782216890.969519:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4263fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712990720:0@lo:501: 00000100:00100000:3.0:1782216890.969548:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4263fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712990848:0@lo:503: 00000100:00100000:3.0:1782216890.969618:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216890.969638:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d427aea80 going to sleep for 11 seconds 00000100:00100000:3.0:1782216890.969650:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712990848 00000100:00100000:3.0:1782216890.969653:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712990848 00000100:00100000:3.0:1782216890.969670:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1782216890.969675:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e197050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+20:6516:x1868789712990848:12345-0@lo:503: 00000100:00100000:3.0:1782216890.969759:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e197050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+20:6516:x1868789712990848:12345-0@lo:503: Request processed in 83us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216890.969771:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1782216890.969808:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4263fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712990848:0@lo:503: 00000100:00100000:0.0:1782216890.972014:0:10012:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42612a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10012:1868789712990976:0@lo:502: 00000100:00100000:0.0:1782216890.972089:0:10012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216890.972120:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712990976 00000100:00100000:0.0:1782216890.972124:0:10012:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d425bee40 going to sleep for 11 seconds 00000100:00100000:3.0:1782216890.972127:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712990976 00000100:00100000:3.0:1782216890.972170:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1782216890.972178:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e196050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+20:10012:x1868789712990976:12345-0@lo:502: 00000100:00100000:3.0:1782216890.972375:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e196050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+20:10012:x1868789712990976:12345-0@lo:502: Request processed in 198us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216890.972383:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1782216890.972394:0:10012:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42612a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10012:1868789712990976:0@lo:502: 00000020:01000000:0.0:1782216890.972419:0:10012:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1782216890.972426:0:10012:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1782216890.972433:0:10012:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782216890.972435:0:10012:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1782216890.972439:0:10012:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1782216890.972444:0:10012:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:01000000:0.0:1782216890.972464:0:10012:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1782216890.972473:0:10012:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1782216890.972486:0:10012:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff952e74c819c0) 00000020:00000080:0.0:1782216890.972508:0:10012:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:0.0:1782216890.972514:0:10012:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1782216890.972606:0:10012:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1782216890.972613:0:10012:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:0.0:1782216890.972619:0:10012:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x92b8e04cbf5f92db 00010000:00080000:3.0:1782216890.972687:0:10012:0:(ldlm_lib.c:102:import_set_conn()) imp ffff952d435d5800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.130@tcp at head 00010000:00010000:3.0:1782216890.972988:0:10012:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:3.0:1782216890.973121:0:10012:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1782216890.973131:0:10012:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1782216890.973445:0:10012:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782216890.973882:0:10012:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782216890.974012:0:10012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1782216890.974116:0:10012:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1782216890.974985:0:10013:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782216890.974990:0:10013:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1782216890.976432:0:10012:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1782216890.976444:0:10012:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1782216890.976484:0:10012:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1782216890.976507:0:10012:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x92b8e04cbf5f92e2 00000100:00080000:0.0:1782216890.976517:0:10012:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782216890.976524:0:10012:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff952d435d5800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1782216890.976557:0:10012:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff952d42612a00 x1868789712991104/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782216890.976606:0:10012:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1782216890.976651:0:10012:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782216890.976655:0:10012:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782216890.976657:0:10012:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1782216890.976660:0:10012:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782216890.976664:0:10012:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782216890.976665:0:10012:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1782216890.976668:0:10012:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782216890.976670:0:10012:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1782216890.976697:0:10012:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42612300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10012:1868789712991232:0@lo:502: 00000100:00100000:3.0:1782216890.977213:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4263d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789712991744:0@lo:400: 00000100:00100000:2.0:1782216890.977237:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1868789712991104:0@lo:8: 00000100:00100000:3.0:1782216890.977390:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216890.977420:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4263e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1868789712992256:0@lo:400: 00000100:00100000:3.0:1782216890.977444:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216890.977464:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782216890.977470:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4263fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1868789712991360:0@lo:400: 00000100:00100000:3.0:1782216890.977489:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216890.977511:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4263f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1868789712991872:0@lo:400: 00000100:00100000:3.0:1782216890.977532:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216890.977554:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4263ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1868789712991616:0@lo:400: 00000100:00100000:3.0:1782216890.977576:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216890.977608:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4263d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1868789712992128:0@lo:400: 00000100:00100000:3.0:1782216890.977628:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216890.977639:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1782216890.977645:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4263f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789712991488:0@lo:400: 00000100:00100000:3.0:1782216890.977665:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216890.977681:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4263c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1868789712992000:0@lo:400: 00000100:00100000:3.0:1782216890.977698:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216890.977719:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712991744 00000100:00100000:3.0:1782216890.977724:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712991744 00000100:00100000:3.0:1782216890.977771:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712991488 00000100:00100000:3.0:1782216890.977774:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712991488 00000100:00100000:3.0:1782216890.977789:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1782216890.977796:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4263ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789712991744:12345-0@lo:400: 00000100:00100000:3.0:1782216890.977855:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4263ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789712991744:12345-0@lo:400: Request processed in 59us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216890.977862:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1782216890.977876:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1782216890.977882:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789712991488:12345-0@lo:400: 00000100:00100000:3.0:1782216890.977927:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789712991488:12345-0@lo:400: Request processed in 45us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216890.977932:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1782216890.977949:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712992256 00000100:00100000:3.0:1782216890.977953:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712992256 00000100:00100000:3.0:1782216890.977986:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712991360 00000100:00100000:3.0:1782216890.977989:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712991360 00000100:00100000:3.0:1782216890.977998:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712991872 00000100:00100000:3.0:1782216890.978000:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712991872 00000100:00100000:3.0:1782216890.978009:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712991616 00000100:00100000:3.0:1782216890.978011:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712991616 00000100:00100000:3.0:1782216890.978025:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712992128 00000100:00100000:3.0:1782216890.978027:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712992128 00000100:00100000:3.0:1782216890.978037:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712992000 00000100:00100000:3.0:1782216890.978039:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712992000 00000100:00100000:3.0:1782216890.978054:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1782216890.978058:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1868789712992256:12345-0@lo:400: 00000100:00100000:3.0:1782216890.978088:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1868789712992256:12345-0@lo:400: Request processed in 29us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216890.978093:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1782216890.978104:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1782216890.978109:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1868789712991360:12345-0@lo:400: 00000100:00100000:3.0:1782216890.978135:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1868789712991360:12345-0@lo:400: Request processed in 26us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216890.978142:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1782216890.978152:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1782216890.978158:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1868789712991872:12345-0@lo:400: 00000100:00100000:3.0:1782216890.978181:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1868789712991872:12345-0@lo:400: Request processed in 24us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216890.978186:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1782216890.978201:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1782216890.978206:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1868789712991616:12345-0@lo:400: 00000100:00100000:3.0:1782216890.978231:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1868789712991616:12345-0@lo:400: Request processed in 25us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216890.978243:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1782216890.978255:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1782216890.978261:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1868789712992128:12345-0@lo:400: 00000100:00100000:3.0:1782216890.978287:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1868789712992128:12345-0@lo:400: Request processed in 27us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216890.978293:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1782216890.978303:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1782216890.978309:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1868789712992000:12345-0@lo:400: 00000100:00100000:3.0:1782216890.978334:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1868789712992000:12345-0@lo:400: Request processed in 25us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216890.978339:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1782216890.978370:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782216890.978373:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782216890.978399:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4263f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789712991488:0@lo:400: 00010000:00080000:3.0:1782216890.978412:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4263c380 x1868789712992000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216890.978421:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4263c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1868789712992000:0@lo:400: 00010000:00080000:3.0:1782216890.978429:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4263ce00 x1868789712991616/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216890.978437:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4263ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1868789712991616:0@lo:400: 00010000:00080000:3.0:1782216890.978446:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4263d880 x1868789712992128/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216890.978454:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4263d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1868789712992128:0@lo:400: 00010000:00080000:3.0:1782216890.978487:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4263fb80 x1868789712991360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216890.978502:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4263fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1868789712991360:0@lo:400: 00010000:00080000:3.0:1782216890.978518:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4263f480 x1868789712991872/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216890.978526:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4263f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1868789712991872:0@lo:400: 00000100:00100000:3.0:1782216890.978534:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4263d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789712991744:0@lo:400: 00010000:00080000:3.0:1782216890.978542:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4263e300 x1868789712992256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216890.978549:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4263e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1868789712992256:0@lo:400: 00000100:00100000:2.0:1782216890.979504:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216890.979565:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712991104 00000100:00100000:2.0:1782216890.979572:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712991104 00000100:00100000:2.0:1782216890.979624:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782216890.979630:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1868789712991104:12345-0@lo:8: 00010000:00080000:2.0:1782216890.979658:0:8432:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 253 last 0 00000020:00000080:2.0:1782216890.979688:0:8432:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x92b8e04cbf5f92e9 00002000:00100000:2.0:1782216890.979702:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff952e7c6ca000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1782216890.979706:0:8432:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:2.0:1782216890.979710:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1782216890.979779:0:8432:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1782216890.980205:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1782216890.980231:0:8432:0:(import.c:65:import_set_state_nolock()) ffff952e7c6cd800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782216890.980290:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1868789712991104:12345-0@lo:8: Request processed in 659us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216890.980298:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1782216890.980340:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d42612a00 x1868789712991104/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782216900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216890.980350:0:3646:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782216890.980358:0:3646:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1782216890.980365:0:3646:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1782216890.980370:0:3646:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1782216890.980372:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952d435d5800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1782216890.980382:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1782216890.980386:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1868789712991104:0@lo:8: 00000004:00080000:3.0:1782216890.982048:0:10013:0:(osp_sync.c:1060:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1782216890.982185:0:10013:0:(osp_sync.c:1862:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 253965601183ns, next at 0ns, rc = 0 00080000:00080000:3.0:1782216890.982191:0:10013:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1782216890.982252:0:10014:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41bfad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10014:1868789712992384:0@lo:700: 00000100:00100000:3.0:1782216890.982317:0:10014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216890.982353:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712992384 00000100:00100000:3.0:1782216890.982360:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712992384 00000100:00100000:3.0:1782216890.982414:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782216890.982423:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:10014:x1868789712992384:12345-0@lo:700: 00000100:00100000:3.0:1782216890.982461:0:8442:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4263e300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8442:1868789712992512:0@lo:700: 00000100:00100000:3.0:1782216890.982487:0:8442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216890.982512:0:8442:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43721480 going to sleep for 11 seconds 00000100:00080000:3.0:1782216890.982524:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782216890.982530:0:10014:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43721540 going to sleep for 11 seconds 00000004:00080000:1.0:1782216890.984735:0:7451:0:(osp_sync.c:1827:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:0.0:1782216890.984870:0:10012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216890.985307:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712992512 00000100:00100000:0.0:1782216890.985316:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712992512 00000100:00100000:0.0:1782216890.985359:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782216890.985369:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4263d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8442:x1868789712992512:12345-0@lo:700: 00000100:00100000:0.0:1782216890.985492:0:10012:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d425be480 going to sleep for 11 seconds 00000100:00100000:1.0:1782216890.987654:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712991232 00000100:00100000:1.0:1782216890.987669:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712991232 00000100:00100000:0.0:1782216890.992343:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1782216890.992357:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e197450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+20:10012:x1868789712991232:12345-0@lo:502: 00000100:00100000:0.0:1782216890.992520:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e197450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+20:10012:x1868789712991232:12345-0@lo:502: Request processed in 165us (7651us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216890.992528:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1782216890.992611:0:10012:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42612300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10012:1868789712991232:0@lo:502: 00000020:01000000:0.0:1782216890.992643:0:10012:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782216890.992650:0:10012:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782216890.992651:0:10012:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:0.0:1782216890.992655:0:10012:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:1.0:1782216890.993981:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:1.0:1782216890.994009:0:6516:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1782216890.994020:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7b363400/0x92b8e04cbf5f92c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f92cd expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216890.994033:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e7b363400/0x92b8e04cbf5f92c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f92cd expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782216890.994043:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1782216890.994046:0:6516:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff952e70905800 from 39 10000000:01000000:1.0:1782216890.994049:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782216890.994080:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e41681600/0x92b8e04cbf5f92f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216890.994088:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e41681600/0x92b8e04cbf5f92f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216890.994098:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e41681600/0x92b8e04cbf5f92f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216890.994117:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712992640:0@lo:101: 00000100:00100000:1.0:1782216890.994165:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216890.994204:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d42676a80 going to sleep for 11 seconds 00000100:00100000:1.0:1782216890.994234:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712992640 00000100:00100000:1.0:1782216890.994240:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712992640 00000100:00100000:1.0:1782216890.994276:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1782216890.994284:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e195850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+20:6516:x1868789712992640:12345-0@lo:101: 00010000:00010000:1.0:1782216890.994295:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782216890.994328:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952d43073400/0x92b8e04cbf5f92f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f92f0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216890.994351:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952d43073400/0x92b8e04cbf5f92f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f92f0 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216890.994361:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952d43073400/0x92b8e04cbf5f92f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f92f0 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216890.994367:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43073400, rc 0) 00000100:00100000:1.0:1782216890.994400:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e195850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:6516:x1868789712992640:12345-0@lo:101: Request processed in 116us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216890.994407:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1782216890.994443:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712992640:0@lo:101: 00010000:00010000:1.0:1782216890.994457:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e41681600/0x92b8e04cbf5f92f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f92f7 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216890.994465:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e41681600/0x92b8e04cbf5f92f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f92f7 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216890.994512:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712992768:0@lo:501: 00000100:00100000:1.0:1782216890.994534:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216890.994547:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d42676a80 going to sleep for 11 seconds 00000100:00100000:1.0:1782216890.994564:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712992768 00000100:00100000:1.0:1782216890.994567:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712992768 00000100:00100000:1.0:1782216890.994605:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1782216890.994612:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e194450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:6516:x1868789712992768:12345-0@lo:501: 00000100:00100000:1.0:1782216890.994710:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e194450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:6516:x1868789712992768:12345-0@lo:501: Request processed in 99us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216890.994718:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1782216890.994746:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712992768:0@lo:501: 00000100:00100000:1.0:1782216890.994769:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712992896:0@lo:503: 00000100:00100000:1.0:1782216890.994801:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216890.994829:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d42676a80 going to sleep for 11 seconds 00000100:00100000:1.0:1782216890.994839:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712992896 00000100:00100000:1.0:1782216890.994842:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712992896 00000100:00100000:1.0:1782216890.994861:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1782216890.994866:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e194c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:6516:x1868789712992896:12345-0@lo:503: 00000100:00100000:1.0:1782216890.994936:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e194c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:6516:x1868789712992896:12345-0@lo:503: Request processed in 69us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216890.994942:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1782216890.994980:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712992896:0@lo:503: 40000000:02000000:1.0:1782216890.997645:0:6525:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:0.0:1782216890.999086:0:10017:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42612300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10017:1868789712993024:0@lo:502: 00000100:00100000:0.0:1782216890.999165:0:10017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216890.999328:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712993024 00000100:00100000:0.0:1782216890.999337:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712993024 00000100:00100000:0.0:1782216890.999378:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1782216890.999387:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e190c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:10017:x1868789712993024:12345-0@lo:502: 00000100:00100000:0.0:1782216890.999502:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e190c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:10017:x1868789712993024:12345-0@lo:502: Request processed in 115us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216890.999510:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1782216890.999558:0:10017:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d425be240 going to sleep for 11 seconds 00000100:00100000:0.0:1782216890.999578:0:10017:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42612300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10017:1868789712993024:0@lo:502: 00000100:00100000:0.0:1782216890.999639:0:10017:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42612300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10017:1868789712993152:0@lo:502: 00000100:00100000:0.0:1782216890.999671:0:10017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216890.999690:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712993152 00000100:00100000:0.0:1782216890.999699:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712993152 00000100:00100000:0.0:1782216890.999720:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1782216890.999726:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:10017:x1868789712993152:12345-0@lo:502: 00000100:00100000:0.0:1782216891.001308:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:10017:x1868789712993152:12345-0@lo:502: Request processed in 1576us (1631us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216891.001319:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1782216891.001371:0:10017:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43797240 going to sleep for 10 seconds 00000100:00100000:0.0:1782216891.001389:0:10017:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42612300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10017:1868789712993152:0@lo:502: 00000040:00080000:0.0:1782216891.001418:0:10017:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1782216891.001476:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1782216891.001495:0:6516:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782216891.001505:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e41681600/0x92b8e04cbf5f92f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f92f7 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216891.001516:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e41681600/0x92b8e04cbf5f92f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f92f7 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782216891.001524:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1782216891.001527:0:6516:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff952e70905800 from 6 10000000:01000000:0.0:1782216891.001530:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1782216891.001554:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7c449800/0x92b8e04cbf5f92fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216891.001561:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e7c449800/0x92b8e04cbf5f92fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216891.001568:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e7c449800/0x92b8e04cbf5f92fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216891.001602:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42612300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712993280:0@lo:101: 00000100:00100000:0.0:1782216891.001639:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216891.001658:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43797240 going to sleep for 11 seconds 00000100:00100000:0.0:1782216891.001672:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712993280 00000100:00100000:0.0:1782216891.001676:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712993280 00000100:00100000:0.0:1782216891.001705:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1782216891.001713:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e191050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:6516:x1868789712993280:12345-0@lo:101: 00010000:00010000:0.0:1782216891.001724:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782216891.001735:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e7c448600/0x92b8e04cbf5f9305 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f92fe expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216891.002110:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e7c448600/0x92b8e04cbf5f9305 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f92fe expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216891.002120:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e7c448600/0x92b8e04cbf5f9305 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f92fe expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216891.002127:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7c448600, rc 0) 00000100:00100000:0.0:1782216891.002159:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e191050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+22:6516:x1868789712993280:12345-0@lo:101: Request processed in 447us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216891.002165:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1782216891.002823:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42612300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712993280:0@lo:101: 00010000:00010000:0.0:1782216891.002839:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e7c449800/0x92b8e04cbf5f92fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f9305 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216891.002847:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e7c449800/0x92b8e04cbf5f92fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f9305 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216891.002892:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42612300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712993408:0@lo:256: 00000100:00100000:0.0:1782216891.004456:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216891.004492:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43797240 going to sleep for 11 seconds 00000100:00100000:0.0:1782216891.004512:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712993408 00000100:00100000:0.0:1782216891.004518:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712993408 00000100:00100000:0.0:1782216891.004559:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1782216891.004567:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e193c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+22:6516:x1868789712993408:12345-0@lo:256: 20000000:01000000:0.0:1782216891.004600:0:6511:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1782216891.004617:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1782216891.004620:0:6511:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1782216891.004698:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e193c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+22:6516:x1868789712993408:12345-0@lo:256: Request processed in 130us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216891.004706:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1782216891.005600:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42612300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712993408:0@lo:256: 10000000:01000000:0.0:1782216891.005651:0:6516:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1782216891.005660:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7c449800/0x92b8e04cbf5f92fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f9305 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216891.005669:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e7c449800/0x92b8e04cbf5f92fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f9305 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782216891.005677:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1782216891.005680:0:6516:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1782216891.005682:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1782216891.005708:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7c449400/0x92b8e04cbf5f930c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216891.005716:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e7c449400/0x92b8e04cbf5f930c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216891.005734:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e7c449400/0x92b8e04cbf5f930c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216891.005810:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42612300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712993536:0@lo:101: 00000100:00100000:0.0:1782216891.005864:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216891.005984:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43797240 going to sleep for 11 seconds 00000100:00100000:0.0:1782216891.006005:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712993536 00000100:00100000:0.0:1782216891.006010:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712993536 00000100:00100000:0.0:1782216891.006145:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1782216891.006153:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+22:6516:x1868789712993536:12345-0@lo:101: 00010000:00010000:0.0:1782216891.006163:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782216891.006175:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e7c448000/0x92b8e04cbf5f9313 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f930c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216891.006253:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e7c448000/0x92b8e04cbf5f9313 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f930c expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216891.006264:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e7c448000/0x92b8e04cbf5f9313 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f930c expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216891.006273:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7c448000, rc 0) 00000100:00100000:0.0:1782216891.006305:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:6516:x1868789712993536:12345-0@lo:101: Request processed in 152us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216891.006312:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1782216891.006347:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42612300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712993536:0@lo:101: 00010000:00010000:0.0:1782216891.006358:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e7c449400/0x92b8e04cbf5f930c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f9313 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216891.006376:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e7c449400/0x92b8e04cbf5f930c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f9313 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216891.006430:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42612300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712993664:0@lo:501: 00000100:00100000:0.0:1782216891.006455:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216891.006472:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43797240 going to sleep for 11 seconds 00000100:00100000:0.0:1782216891.006483:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712993664 00000100:00100000:0.0:1782216891.006486:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712993664 00000100:00100000:0.0:1782216891.006508:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1782216891.006513:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:6516:x1868789712993664:12345-0@lo:501: 00000100:00100000:0.0:1782216891.006632:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:6516:x1868789712993664:12345-0@lo:501: Request processed in 118us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216891.006638:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1782216891.006664:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42612300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712993664:0@lo:501: 00000100:00100000:0.0:1782216891.006688:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42612300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712993792:0@lo:503: 00000100:00100000:0.0:1782216891.006723:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216891.006735:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43797240 going to sleep for 11 seconds 00000100:00100000:0.0:1782216891.006806:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712993792 00000100:00100000:0.0:1782216891.006809:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712993792 00000100:00100000:0.0:1782216891.006839:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1782216891.006845:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:6516:x1868789712993792:12345-0@lo:503: 00000100:00100000:0.0:1782216891.007157:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:6516:x1868789712993792:12345-0@lo:503: Request processed in 310us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216891.007164:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1782216891.007274:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42612300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712993792:0@lo:503: 00000100:00100000:3.0:1782216891.008356:0:10019:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4263f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10019:1868789712993920:0@lo:502: 00000100:00100000:3.0:1782216891.008415:0:10019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216891.008448:0:10019:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d437213c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782216891.008490:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712993920 00000100:00100000:0.0:1782216891.008496:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712993920 00000100:00100000:0.0:1782216891.008529:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1782216891.008537:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e190850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:10019:x1868789712993920:12345-0@lo:502: 00000100:00100000:0.0:1782216891.008656:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e190850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:10019:x1868789712993920:12345-0@lo:502: Request processed in 120us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216891.008664:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1782216891.009147:0:10019:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4263f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10019:1868789712993920:0@lo:502: 00000020:01000000:3.0:1782216891.009173:0:10019:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1782216891.009179:0:10019:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1782216891.009185:0:10019:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782216891.009187:0:10019:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1782216891.009202:0:10019:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1782216891.009206:0:10019:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:01000000:3.0:1782216891.009226:0:10019:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1782216891.009229:0:10019:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782216891.009243:0:10019:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff952d43344d40) 00000020:00000080:3.0:1782216891.009266:0:10019:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:3.0:1782216891.009271:0:10019:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1782216891.009365:0:10019:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1782216891.009371:0:10019:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:3.0:1782216891.009378:0:10019:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x92b8e04cbf5f9321 00010000:00080000:3.0:1782216891.009403:0:10019:0:(ldlm_lib.c:102:import_set_conn()) imp ffff952d430f9800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.130@tcp at head 00010000:00010000:3.0:1782216891.009733:0:10019:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000100:00100000:1.0:1782216891.011084:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4263d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8442:x1868789712992512:12345-0@lo:700: Request processed in 25711us (28589us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216891.011095:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1782216891.011145:0:8442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4263e300 x1868789712992512/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1782216906 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216891.011158:0:8442:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4263e300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8442:1868789712992512:0@lo:700: 40000000:02000000:1.0:1782216891.011176:0:8442:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000040:01000000:3.0:1782216891.013126:0:10019:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1782216891.013145:0:10019:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1782216891.013464:0:10019:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782216891.014103:0:10019:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782216891.014429:0:10019:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1782216891.014540:0:10019:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1782216891.015080:0:10020:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782216891.015085:0:10020:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1782216891.023682:0:10019:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1782216891.023696:0:10019:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1782216891.023798:0:10019:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1782216891.023834:0:10019:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x92b8e04cbf5f9328 00000100:00080000:0.0:1782216891.023845:0:10019:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782216891.023851:0:10019:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff952d430f9800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1782216891.023883:0:10019:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff952d42612300 x1868789712994048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782216891.023937:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1868789712994048:0@lo:8: 00000100:00100000:2.0:1782216891.024008:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216891.024137:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712994048 00000100:00100000:0.0:1782216891.024144:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712994048 00000100:00100000:0.0:1782216891.024174:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782216891.024180:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1868789712994048:12345-0@lo:8: 00010000:00080000:0.0:1782216891.024226:0:8434:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 254 last 0 00000020:00000080:0.0:1782216891.024251:0:8434:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x92b8e04cbf5f932f 00002000:00100000:0.0:1782216891.024263:0:8434:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff952d435d3000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1782216891.024268:0:8434:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1782216891.024272:0:8434:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1782216891.024358:0:8434:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1782216891.024380:0:8434:0:(import.c:65:import_set_state_nolock()) ffff952d435d4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782216891.026037:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1868789712994048:12345-0@lo:8: Request processed in 1850us (2023us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216891.026050:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1782216891.026082:0:10019:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1782216891.026156:0:10019:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782216891.026162:0:10019:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782216891.026164:0:10019:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1782216891.026167:0:10019:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782216891.026171:0:10019:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782216891.026172:0:10019:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1782216891.026175:0:10019:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782216891.026176:0:10019:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1782216891.026219:0:10019:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42611880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10019:1868789712994176:0@lo:502: 00000100:00100000:0.0:1782216891.026279:0:10019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216891.026524:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712994176 00000100:00100000:0.0:1782216891.026532:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712994176 00000100:00100000:0.0:1782216891.026567:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1782216891.026576:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:10019:x1868789712994176:12345-0@lo:502: 00000100:00100000:0.0:1782216891.026693:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:10019:x1868789712994176:12345-0@lo:502: Request processed in 116us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216891.026700:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1782216891.026754:0:10019:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43797000 going to sleep for 11 seconds 00000100:00100000:0.0:1782216891.026772:0:10019:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42611880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10019:1868789712994176:0@lo:502: 00000020:01000000:0.0:1782216891.026791:0:10019:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782216891.026795:0:10019:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782216891.026797:0:10019:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:0.0:1782216891.026801:0:10019:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:0.0:1782216891.026859:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:0.0:1782216891.026878:0:6516:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1782216891.026903:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7c449400/0x92b8e04cbf5f930c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f9313 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216891.026914:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e7c449400/0x92b8e04cbf5f930c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f9313 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782216891.026923:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1782216891.026926:0:6516:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff952e5021b380 from 1 10000000:01000000:0.0:1782216891.026929:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1782216891.026950:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7c449c00/0x92b8e04cbf5f9336 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216891.026958:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e7c449c00/0x92b8e04cbf5f9336 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216891.026967:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e7c449c00/0x92b8e04cbf5f9336 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216891.026979:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42611880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712994304:0@lo:101: 00000100:00100000:0.0:1782216891.027006:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216891.027209:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43797000 going to sleep for 11 seconds 00000100:00100000:0.0:1782216891.027224:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712994304 00000100:00100000:0.0:1782216891.027228:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712994304 00000100:00100000:0.0:1782216891.027251:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1782216891.027258:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:6516:x1868789712994304:12345-0@lo:101: 00010000:00010000:0.0:1782216891.027266:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782216891.027277:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e7c448e00/0x92b8e04cbf5f933d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f9336 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216891.027296:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e7c448e00/0x92b8e04cbf5f933d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9336 expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216891.027478:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e7c448e00/0x92b8e04cbf5f933d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9336 expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216891.027487:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7c448e00, rc 0) 00000100:00100000:0.0:1782216891.027520:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:6516:x1868789712994304:12345-0@lo:101: Request processed in 262us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216891.027526:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1782216891.027558:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42611880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712994304:0@lo:101: 00010000:00010000:0.0:1782216891.027570:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e7c449c00/0x92b8e04cbf5f9336 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f933d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216891.027579:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e7c449c00/0x92b8e04cbf5f9336 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f933d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216891.027638:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42611880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712994432:0@lo:501: 00000100:00100000:0.0:1782216891.027662:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216891.027680:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43797000 going to sleep for 11 seconds 00000100:00100000:0.0:1782216891.027691:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712994432 00000100:00100000:0.0:1782216891.027694:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712994432 00000100:00100000:0.0:1782216891.027714:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1782216891.027720:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:6516:x1868789712994432:12345-0@lo:501: 00000100:00100000:0.0:1782216891.027796:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:6516:x1868789712994432:12345-0@lo:501: Request processed in 76us (133us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782216891.027803:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1782216891.027845:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42611880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789712994432:0@lo:501: 10000000:01000000:0.0:1782216891.027864:0:6516:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1782216891.027875:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7c449c00/0x92b8e04cbf5f9336 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f933d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216891.027883:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e7c449c00/0x92b8e04cbf5f9336 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f933d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216891.028128:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1868789712994560:0@lo:400: 00000100:00100000:1.0:1782216891.028163:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216891.028185:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4273ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1868789712995072:0@lo:400: 00000100:00100000:1.0:1782216891.028213:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216891.028229:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42738380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1868789712995584:0@lo:400: 00000100:00100000:1.0:1782216891.028250:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216891.028360:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1782216891.028367:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42739f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789712994944:0@lo:400: 00000100:00100000:1.0:1782216891.028390:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216891.028410:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42739880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789712995456:0@lo:400: 00010000:00080000:2.0:1782216891.028440:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d42612300 x1868789712994048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782216901 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216891.028451:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216891.028457:0:3646:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782216891.028466:0:3646:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1782216891.028474:0:3646:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1782216891.028480:0:3646:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1782216891.028484:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952d430f9800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1782216891.028496:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789712994688:0@lo:400: 00000100:00100000:0.0:1782216891.028532:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712995456 00000100:00100000:1.0:1782216891.028533:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216891.028539:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712995456 00000100:00100000:0.0:1782216891.028571:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782216891.028578:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42738000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789712995456:12345-0@lo:400: 00000100:00100000:0.0:1782216891.028643:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42738000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789712995456:12345-0@lo:400: Request processed in 65us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216891.028650:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782216891.028654:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4273aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1868789712995200:0@lo:400: 00000100:00100000:1.0:1782216891.028680:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1782216891.028694:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d42739880 x1868789712995456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216907 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216891.028700:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4273b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1868789712995712:0@lo:400: 00000100:00100000:0.0:1782216891.028712:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42739880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789712995456:0@lo:400: 00000100:00100000:1.0:1782216891.028732:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216891.028746:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1782216891.028751:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1868789712994816:0@lo:400: 00000100:00100000:1.0:1782216891.028768:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216891.028776:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4273a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789712995328:0@lo:400: 00000100:00100000:1.0:1782216891.028792:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216891.028828:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42738700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789712995840:0@lo:400: 00000100:00100000:0.0:1782216891.028838:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712995328 00000100:00100000:0.0:1782216891.028844:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712995328 00000100:00100000:1.0:1782216891.028865:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216891.028961:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712995840 00000100:00100000:0.0:1782216891.028965:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712995840 00000100:00100000:0.0:1782216891.028985:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782216891.028990:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42738e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789712995328:12345-0@lo:400: 00000004:00080000:2.0:1782216891.029104:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1782216891.029111:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1868789712994048:0@lo:8: 00000004:00080000:3.0:1782216891.029134:0:10020:0:(osp_sync.c:1060:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1782216891.029193:0:10020:0:(osp_sync.c:1862:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 254012609687ns, next at 0ns, rc = 0 00080000:00080000:3.0:1782216891.029200:0:10020:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1782216891.029337:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712994560 00000100:00100000:1.0:1782216891.029341:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712994560 00000100:00100000:1.0:1782216891.029362:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712995072 00000100:00100000:1.0:1782216891.029365:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712995072 00000100:00100000:1.0:1782216891.029376:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712995584 00000100:00100000:1.0:1782216891.029378:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712995584 00000100:00100000:1.0:1782216891.029391:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712995200 00000100:00100000:1.0:1782216891.029393:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712995200 00000100:00100000:1.0:1782216891.029406:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712995712 00000100:00100000:0.0:1782216891.029409:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42738e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789712995328:12345-0@lo:400: Request processed in 416us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216891.029410:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712995712 00000100:00100000:0.0:1782216891.029419:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782216891.029424:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712994816 00000100:00100000:1.0:1782216891.029429:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712994816 00000100:00100000:0.0:1782216891.029438:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782216891.029450:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1782216891.029451:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42739880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+7:3647:x1868789712995840:12345-0@lo:400: 00000100:00100000:1.0:1782216891.029461:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1868789712994560:12345-0@lo:400: 00000100:00100000:0.0:1782216891.029485:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42739880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+7:3647:x1868789712995840:12345-0@lo:400: Request processed in 39us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216891.029498:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782216891.029510:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1868789712994560:12345-0@lo:400: Request processed in 50us (1345us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216891.029518:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1782216891.029539:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4273a300 x1868789712995328/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216907 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216891.029549:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4273a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789712995328:0@lo:400: 00000100:00100000:1.0:1782216891.029550:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1782216891.029561:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1868789712995072:12345-0@lo:400: 00010000:00080000:0.0:1782216891.029566:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d42738700 x1868789712995840/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216907 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216891.029575:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42738700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789712995840:0@lo:400: 00000100:00100000:1.0:1782216891.029618:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1868789712995072:12345-0@lo:400: Request processed in 58us (1403us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216891.029625:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1782216891.029633:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d410b2d80 x1868789712994560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216907 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216891.029642:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1782216891.029644:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1868789712994560:0@lo:400: 00000100:00100000:1.0:1782216891.029652:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42738a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1868789712995584:12345-0@lo:400: 00010000:00080000:0.0:1782216891.029660:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4273ad80 x1868789712995072/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216907 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216891.029669:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4273ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1868789712995072:0@lo:400: 00000100:00100000:1.0:1782216891.029688:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42738a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1868789712995584:12345-0@lo:400: Request processed in 37us (1436us total) trans 0 rc 0/0 00010000:00080000:0.0:1782216891.029694:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d42738380 x1868789712995584/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216907 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216891.029697:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1782216891.029710:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42738380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1868789712995584:0@lo:400: 00000100:00100000:1.0:1782216891.029717:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1782216891.029733:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42739500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1868789712995200:12345-0@lo:400: 00000100:00100000:1.0:1782216891.029774:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42739500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1868789712995200:12345-0@lo:400: Request processed in 42us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216891.029780:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1782216891.029791:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1782216891.029797:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1868789712995712:12345-0@lo:400: 00010000:00080000:0.0:1782216891.029833:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4273aa00 x1868789712995200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216907 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216891.029840:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1868789712995712:12345-0@lo:400: Request processed in 41us (1106us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216891.029849:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4273aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1868789712995200:0@lo:400: 00000100:00100000:1.0:1782216891.029850:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1782216891.029866:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1782216891.029870:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4273b480 x1868789712995712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216907 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216891.029883:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4273b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1868789712995712:0@lo:400: 00000100:00100000:1.0:1782216891.029888:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1868789712994816:12345-0@lo:400: 00000100:00100000:1.0:1782216891.029928:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1868789712994816:12345-0@lo:400: Request processed in 49us (1153us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216891.029936:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1782216891.029937:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d410b2a00 x1868789712994816/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216907 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216891.029948:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1868789712994816:0@lo:400: 00000100:00100000:1.0:1782216891.029967:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712994944 00000100:00100000:1.0:1782216891.029973:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712994944 00000100:00100000:1.0:1782216891.029997:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712994688 00000100:00100000:1.0:1782216891.030000:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712994688 00000100:00100000:1.0:1782216891.030012:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1782216891.030017:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42739c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789712994944:12345-0@lo:400: 00000100:00100000:1.0:1782216891.030060:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42739c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789712994944:12345-0@lo:400: Request processed in 43us (1669us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216891.030066:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1782216891.030076:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1782216891.030083:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42739180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789712994688:12345-0@lo:400: 00000100:00100000:1.0:1782216891.030109:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42739180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789712994688:12345-0@lo:400: Request processed in 28us (1589us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216891.030123:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1782216891.030134:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42739f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789712994944:0@lo:400: 00000100:00100000:0.0:1782216891.030162:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789712994688:0@lo:400: 00000001:00100000:3.0:1782216891.033089:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1782216891.033101:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1782216891.033731:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:10014:x1868789712992384:12345-0@lo:700: Request processed in 51304us (51409us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216891.033757:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1782216891.033802:0:10014:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d41bfad80 x1868789712992384/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1782216906 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216891.033825:0:10014:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41bfad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10014:1868789712992384:0@lo:700: 00000004:00080000:1.0:1782216891.034692:0:6498:0:(osp_sync.c:1827:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1782216891.034869:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782216891.034885:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42611880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789712995968:0@lo:13: 00000100:00100000:0.0:1782216891.034990:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1782216891.035087:0:10021:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1782216891.035109:0:10021:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42613480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10021:1868789712996096:0@lo:7: 00000100:00100000:0.0:1782216891.035133:0:10021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216891.035156:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712996096 00000100:00100000:0.0:1782216891.035162:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712996096 00000100:00100000:0.0:1782216891.035275:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782216891.035284:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42610700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:10021:x1868789712996096:12345-0@lo:7: 00000100:00100000:3.0:1782216891.035640:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712995968 00000100:00100000:3.0:1782216891.035645:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712995968 00000100:00100000:3.0:1782216891.035672:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782216891.035679:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42610380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1868789712995968:12345-0@lo:13: 00002000:00000024:3.0:1782216891.035696:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923943424 avail 3692421120 00000100:00100000:3.0:1782216891.035811:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42610380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1868789712995968:12345-0@lo:13: Request processed in 132us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216891.035834:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1782216891.035872:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d42611880 x1868789712995968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216907 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216891.035888:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42611880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789712995968:0@lo:13: 00000100:00100000:2.0:1782216891.038194:0:10021:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43797000 going to sleep for 11 seconds 00000100:00080000:1.0:1782216891.040649:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1782216891.043912:0:10014:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1782216891.043943:0:10014:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4273b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10014:1868789712996352:0@lo:7: 00000100:00100000:1.0:1782216891.044005:0:10014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216891.044040:0:10014:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d42676b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782216891.044058:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42739f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789712996224:0@lo:13: 00000100:00100000:1.0:1782216891.044083:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216891.044131:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712996224 00000100:00100000:3.0:1782216891.044138:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712996224 00000100:00100000:3.0:1782216891.044185:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782216891.044194:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42738380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789712996224:12345-0@lo:13: 00002000:00000024:3.0:1782216891.044217:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923943424 avail 3692421120 00000100:00100000:3.0:1782216891.044269:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42738380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789712996224:12345-0@lo:13: Request processed in 74us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216891.044277:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1782216891.044381:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d42739f80 x1868789712996224/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216907 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216891.044401:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42739f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789712996224:0@lo:13: 00000100:00100000:3.0:1782216891.045030:0:8435:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1782216891.045039:0:8435:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1782216891.045416:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712996352 00000100:00100000:3.0:1782216891.045426:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712996352 00002000:00080000:0.0:1782216891.046895:0:8432:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1782216891.046901:0:8432:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1782216891.046977:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42610700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:10021:x1868789712996096:12345-0@lo:7: Request processed in 11692us (11839us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216891.046995:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782216891.047021:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782216891.047030:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:10014:x1868789712996352:12345-0@lo:7: 00010000:00080000:3.0:1782216891.047976:0:10021:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d42613480 x1868789712996096/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1782216907 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216891.047992:0:10021:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42613480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10021:1868789712996096:0@lo:7: 00000004:00080000:3.0:1782216891.048005:0:10021:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1782216891.048039:0:10021:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4263f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10021:1868789712996480:0@lo:5: 00000100:00100000:3.0:1782216891.048081:0:10021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216891.048104:0:10021:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43721600 going to sleep for 11 seconds 00000100:00100000:3.0:1782216891.048117:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712996480 00000100:00100000:3.0:1782216891.048122:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712996480 00000100:00100000:3.0:1782216891.048151:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782216891.048159:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4263fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:10021:x1868789712996480:12345-0@lo:5: 00002000:00080000:3.0:1782216891.048177:0:8435:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1782216891.048181:0:8435:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1782216891.052028:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4263fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:10021:x1868789712996480:12345-0@lo:5: Request processed in 3854us (3931us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1782216891.052041:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1782216891.052090:0:10021:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4263f480 x1868789712996480/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782216907 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216891.052106:0:10021:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4263f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10021:1868789712996480:0@lo:5: 00000004:00080000:3.0:1782216891.052119:0:10021:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1782216891.052154:0:10021:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4263d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10021:1868789712996608:0@lo:700: 00000100:00100000:3.0:1782216891.052189:0:10021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216891.052950:0:10021:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43721600 going to sleep for 11 seconds 00000100:00100000:3.0:1782216891.052973:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712996608 00000100:00100000:3.0:1782216891.052979:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712996608 00000100:00100000:3.0:1782216891.053148:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782216891.053158:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4263ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:10021:x1868789712996608:12345-0@lo:700: 00002000:00080000:0.0:1782216891.053475:0:8432:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1782216891.053481:0:8432:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1782216891.053534:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:10014:x1868789712996352:12345-0@lo:7: Request processed in 6504us (9528us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216891.053542:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1782216891.053675:0:10014:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4273b480 x1868789712996352/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1782216907 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216891.053687:0:10014:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4273b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10014:1868789712996352:0@lo:7: 00000004:00080000:1.0:1782216891.053698:0:10014:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1782216891.053728:0:10014:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4273b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10014:1868789712996736:0@lo:5: 00000100:00100000:1.0:1782216891.053755:0:10014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216891.053778:0:10014:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d42676b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782216891.053791:0:10025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712996736 00000100:00100000:1.0:1782216891.053794:0:10025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712996736 00000100:00100000:1.0:1782216891.053845:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782216891.053854:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:10014:x1868789712996736:12345-0@lo:5: 00002000:00080000:1.0:1782216891.053873:0:8434:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1782216891.053921:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:10014:x1868789712996736:12345-0@lo:5: Request processed in 69us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216891.053928:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1782216891.053954:0:10014:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4273b480 x1868789712996736/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782216907 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216891.053975:0:10014:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4273b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10014:1868789712996736:0@lo:5: 00000004:00080000:1.0:1782216891.053985:0:10014:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1782216891.054006:0:10014:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4273b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10014:1868789712996864:0@lo:5: 00000100:00100000:1.0:1782216891.054044:0:10014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216891.054063:0:10014:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d42676b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782216891.054075:0:10025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712996864 00000100:00100000:1.0:1782216891.054078:0:10025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712996864 00000100:00100000:1.0:1782216891.054102:0:10025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782216891.054108:0:10025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42738700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:10014:x1868789712996864:12345-0@lo:5: 00002000:00080000:1.0:1782216891.054131:0:10025:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000001:00080000:3.0:1782216891.062302:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:2.0:1782216891.063110:0:10025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42738700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:10014:x1868789712996864:12345-0@lo:5: Request processed in 8996us (9060us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1782216891.063122:0:10025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1782216891.063320:0:10014:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4273b480 x1868789712996864/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782216907 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216891.063338:0:10014:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4273b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10014:1868789712996864:0@lo:5: 00000004:00080000:3.0:1782216891.063352:0:10014:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1782216891.063394:0:10014:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4263c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10014:1868789712996992:0@lo:900: 00000100:00100000:3.0:1782216891.063431:0:10014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216891.063462:0:10014:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43721a80 going to sleep for 11 seconds 00000100:00100000:3.0:1782216891.063480:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712996992 00000100:00100000:3.0:1782216891.063486:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712996992 00000100:00100000:3.0:1782216891.063533:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782216891.063542:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4263f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:10014:x1868789712996992:12345-0@lo:900: 00000100:00100000:3.0:1782216891.063607:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4263f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:10014:x1868789712996992:12345-0@lo:900: Request processed in 65us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216891.063614:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1782216891.063639:0:10014:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4263c380 x1868789712996992/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1782216907 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216891.063647:0:10014:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4263c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10014:1868789712996992:0@lo:900: 00000100:00100000:1.0:1782216891.064417:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4263ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:10021:x1868789712996608:12345-0@lo:700: Request processed in 11258us (12224us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216891.064431:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1782216891.065116:0:10021:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4263d880 x1868789712996608/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1782216907 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216891.065128:0:10021:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1782216891.065140:0:10021:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4263d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10021:1868789712996608:0@lo:700: 00000004:02000040:3.0:1782216891.067718:0:10021:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:3.0:1782216891.075455:0:10021:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4263d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10021:1868789712997120:0@lo:5: 00000100:00100000:3.0:1782216891.075520:0:10021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216891.077883:0:10021:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43721600 going to sleep for 11 seconds 00000100:00100000:0.0:1782216891.078296:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712997120 00000100:00100000:0.0:1782216891.078305:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712997120 00000100:00100000:0.0:1782216891.078367:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782216891.078378:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4263f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:10021:x1868789712997120:12345-0@lo:5: 00002000:00080000:0.0:1782216891.086382:0:8434:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1782216891.086405:0:8434:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:0.0:1782216891.088756:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4263f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:10021:x1868789712997120:12345-0@lo:5: Request processed in 10372us (13228us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1782216891.088769:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1782216891.088852:0:10021:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4263d880 x1868789712997120/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782216907 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216891.088870:0:10021:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4263d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10021:1868789712997120:0@lo:5: 00000004:00080000:3.0:1782216891.088952:0:10021:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000020:00000004:1.0:1782216891.129173:0:10037:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782216891.129401:0:10037:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1782216891.463110:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4263c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789712997248:0@lo:41: 00000100:00100000:3.0:1782216891.463180:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216891.463493:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712997248 00000100:00100000:1.0:1782216891.463501:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712997248 00000100:00100000:1.0:1782216891.463623:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1782216891.463633:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4263e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789712997248:12345-0@lo:41: 00000004:00000024:1.0:1782216891.463664:0:7938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1782216891.463711:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4263e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789712997248:12345-0@lo:41: Request processed in 79us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216891.463718:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1782216891.468137:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4263c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789712997248:0@lo:41: 00010000:00010000:3.0:1782216891.896765:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1782216892.073554:0:10085:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1782216892.073565:0:10085:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:2.0:1782216892.475131:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4263c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789712997376:0@lo:41: 00000100:00100000:2.0:1782216892.475200:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216892.478814:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712997376 00000100:00100000:3.0:1782216892.478830:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712997376 00000100:00100000:3.0:1782216892.482204:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1782216892.482223:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789712997376:12345-0@lo:41: 00000004:00000024:3.0:1782216892.482262:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1782216892.482351:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789712997376:12345-0@lo:41: Request processed in 134us (7149us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216892.482359:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1782216892.482421:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4263c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789712997376:0@lo:41: 00010000:00010000:1.0:1782216892.921024:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782216893.502703:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216893.503038:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693022592 00000100:00100000:0.0:1782216893.503048:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693022592 00000100:00100000:0.0:1782216893.503094:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 180 00000100:00100000:0.0:1782216893.503102:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2401:x1868789693022592:12345-192.168.203.30@tcp:250: 00010000:00080000:0.0:1782216893.503127:0:6513:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 7db73f00-8957-4054-9c9f-ae6b01c2a40a@192.168.203.30@tcp t0 exp 0000000000000000 cur 256 last 0 00000020:00000080:0.0:1782216893.503155:0:6513:0:(genops.c:1406:class_connect()) connect: client 7db73f00-8957-4054-9c9f-ae6b01c2a40a, cookie 0x92b8e04cbf5f9344 00000100:00080000:0.0:1782216893.503268:0:6513:0:(import.c:65:import_set_state_nolock()) ffff952d435d1800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782216893.503366:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+5:2401:x1868789693022592:12345-192.168.203.30@tcp:250: Request processed in 263us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216893.503388:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 180 00000100:00100000:0.0:1782216893.512916:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216893.517619:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693022464 00000100:00100000:2.0:1782216893.517635:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693022464 00000100:00100000:2.0:1782216893.517831:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 181 00000100:00100000:2.0:1782216893.517845:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e192050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+5:6159:x1868789693022464:12345-192.168.203.30@tcp:101: 00010000:00010000:2.0:1782216893.517861:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782216893.517880:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e413fd200/0x92b8e04cbf5f934b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc65e7963be973238 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216893.517907:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e413fd200/0x92b8e04cbf5f934b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973238 expref: 6 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216893.517936:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e413fd200/0x92b8e04cbf5f934b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973238 expref: 6 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216893.518004:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e413fd200, rc 0) 00000100:00100000:2.0:1782216893.518071:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e192050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+6:6159:x1868789693022464:12345-192.168.203.30@tcp:101: Request processed in 230us (5164us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216893.518079:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 181 00000100:00100000:1.0:1782216893.521410:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216893.521521:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693022720 00000100:00100000:2.0:1782216893.521531:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693022720 00000100:00100000:2.0:1782216893.522303:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 182 00000100:00100000:2.0:1782216893.522316:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e190450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+6:6159:x1868789693022720:12345-192.168.203.30@tcp:501: 00000100:00100000:2.0:1782216893.522476:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e190450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+6:6159:x1868789693022720:12345-192.168.203.30@tcp:501: Request processed in 162us (1074us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782216893.522484:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 182 00000100:00100000:1.0:1782216893.527217:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216893.527285:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693022848 00000100:00100000:2.0:1782216893.527299:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693022848 00000100:00100000:2.0:1782216893.527350:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 183 00000100:00100000:2.0:1782216893.527359:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e193450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+6:6159:x1868789693022848:12345-192.168.203.30@tcp:101: 00010000:00010000:2.0:1782216893.527374:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782216893.527388:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e413fd600/0x92b8e04cbf5f9352 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc65e7963be97323f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216893.527414:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e413fd600/0x92b8e04cbf5f9352 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97323f expref: 7 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216893.527425:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e413fd600/0x92b8e04cbf5f9352 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97323f expref: 7 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216893.527445:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e413fd600, rc 0) 00000100:00100000:2.0:1782216893.527499:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e193450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+7:6159:x1868789693022848:12345-192.168.203.30@tcp:101: Request processed in 140us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216893.527506:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 183 00000100:00100000:1.0:1782216893.535687:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216893.539325:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693022976 00000100:00100000:0.0:1782216893.539472:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693022976 00000100:00100000:0.0:1782216893.539697:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 184 00000100:00100000:0.0:1782216893.539709:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e191850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+7:6159:x1868789693022976:12345-192.168.203.30@tcp:501: 00000100:00100000:0.0:1782216893.539889:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e191850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+8:6159:x1868789693022976:12345-192.168.203.30@tcp:501: Request processed in 181us (4220us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216893.539897:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 184 00000100:00100000:1.0:1782216893.545358:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216893.545491:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693023104 00000100:00100000:0.0:1782216893.545501:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693023104 00000100:00100000:0.0:1782216893.545552:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 185 00000100:00100000:0.0:1782216893.545563:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e58053450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+8:6159:x1868789693023104:12345-192.168.203.30@tcp:503: 00000100:00100000:0.0:1782216893.546041:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e58053450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+8:6159:x1868789693023104:12345-192.168.203.30@tcp:503: Request processed in 477us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216893.546050:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 185 00000100:00100000:1.0:1782216893.551829:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216893.552395:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693023232 00000100:00100000:0.0:1782216893.552405:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693023232 00000100:00100000:0.0:1782216893.552459:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 186 00000100:00100000:0.0:1782216893.552467:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e43998c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+8:6178:x1868789693023232:12345-192.168.203.30@tcp:502: 00000100:00100000:0.0:1782216893.552642:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e43998c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+8:6178:x1868789693023232:12345-192.168.203.30@tcp:502: Request processed in 175us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216893.552650:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 186 00000100:00100000:1.0:1782216893.620140:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216893.620243:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693023360 00000100:00100000:0.0:1782216893.620253:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693023360 00000100:00100000:0.0:1782216893.620327:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 187 00000100:00100000:0.0:1782216893.620336:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4399b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+8:6178:x1868789693023360:12345-192.168.203.30@tcp:502: 00000100:00100000:0.0:1782216893.620560:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4399b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+8:6178:x1868789693023360:12345-192.168.203.30@tcp:502: Request processed in 224us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216893.620569:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 187 00000100:00100000:1.0:1782216893.632044:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216893.638475:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693023488 00000100:00100000:2.0:1782216893.638490:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693023488 00000100:00100000:2.0:1782216893.638560:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 188 00000100:00100000:2.0:1782216893.638570:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e43999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+8:6159:x1868789693023488:12345-192.168.203.30@tcp:101: 00010000:00010000:2.0:1782216893.638599:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782216893.638616:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e413fc200/0x92b8e04cbf5f9359 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc65e7963be973270 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216893.638652:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e413fc200/0x92b8e04cbf5f9359 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973270 expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216893.638663:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e413fc200/0x92b8e04cbf5f9359 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973270 expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216893.638678:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e413fc200, rc 0) 00000100:00100000:2.0:1782216893.638918:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e43999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+9:6159:x1868789693023488:12345-192.168.203.30@tcp:101: Request processed in 348us (6882us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216893.638926:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 188 00000100:00100000:2.0:1782216893.642399:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216893.642479:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693023616 00000100:00100000:0.0:1782216893.642487:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693023616 00000100:00100000:0.0:1782216893.642575:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 189 00000100:00100000:0.0:1782216893.642612:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e43999c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+9:6159:x1868789693023616:12345-192.168.203.30@tcp:256: 20000000:01000000:0.0:1782216893.642647:0:6514:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1782216893.642671:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1782216893.642676:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1782216893.642679:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1782216893.642682:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1782216893.642684:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1782216893.645058:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e43999c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+9:6159:x1868789693023616:12345-192.168.203.30@tcp:256: Request processed in 2465us (2658us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216893.645072:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 189 00000100:00100000:3.0:1782216893.653055:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216893.653394:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693023744 00000100:00100000:2.0:1782216893.653403:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693023744 00000100:00100000:2.0:1782216893.653465:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 190 00000100:00100000:2.0:1782216893.653474:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e582c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+9:6159:x1868789693023744:12345-192.168.203.30@tcp:101: 00010000:00010000:2.0:1782216893.653504:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782216893.653520:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e413fda00/0x92b8e04cbf5f9360 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc65e7963be973277 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216893.653547:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e413fda00/0x92b8e04cbf5f9360 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973277 expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216893.653557:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e413fda00/0x92b8e04cbf5f9360 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973277 expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216893.653566:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e413fda00, rc 0) 00000100:00100000:2.0:1782216893.653655:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e582c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+10:6159:x1868789693023744:12345-192.168.203.30@tcp:101: Request processed in 181us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216893.653663:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 190 00000100:00100000:3.0:1782216893.659434:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216893.659739:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693023872 00000100:00100000:1.0:1782216893.659751:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693023872 00000100:00100000:1.0:1782216893.659866:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 191 00000100:00100000:1.0:1782216893.659885:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e582c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+10:6159:x1868789693023872:12345-192.168.203.30@tcp:501: 00000100:00100000:1.0:1782216893.660051:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e582c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+10:6159:x1868789693023872:12345-192.168.203.30@tcp:501: Request processed in 175us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216893.660059:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 191 00000100:00100000:3.0:1782216893.664249:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216893.666826:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693024000 00000100:00100000:0.0:1782216893.666842:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693024000 00000100:00100000:0.0:1782216893.666895:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 192 00000100:00100000:0.0:1782216893.666905:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+10:6159:x1868789693024000:12345-192.168.203.30@tcp:503: 00000100:00100000:0.0:1782216893.667875:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+10:6159:x1868789693024000:12345-192.168.203.30@tcp:503: Request processed in 966us (3630us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216893.667886:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 192 00000100:00100000:3.0:1782216893.675617:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216893.675811:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693024128 00000100:00100000:2.0:1782216893.675821:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693024128 00000100:00100000:2.0:1782216893.675883:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 193 00000100:00100000:2.0:1782216893.675894:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+10:6183:x1868789693024128:12345-192.168.203.30@tcp:502: 00000100:00100000:3.0:1782216893.676254:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+10:6183:x1868789693024128:12345-192.168.203.30@tcp:502: Request processed in 360us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216893.676273:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 193 00000100:00100000:1.0:1782216893.685806:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216893.686051:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693024256 00000100:00100000:0.0:1782216893.686061:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693024256 00000100:00100000:0.0:1782216893.686117:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 194 00000100:00100000:0.0:1782216893.686126:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+10:6183:x1868789693024256:12345-192.168.203.30@tcp:502: 00000100:00100000:0.0:1782216893.686266:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+10:6183:x1868789693024256:12345-192.168.203.30@tcp:502: Request processed in 140us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216893.686278:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 194 00000100:00100000:1.0:1782216893.690462:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216893.690536:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782216893.690752:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693024384 00000100:00100000:3.0:1782216893.690761:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693024384 00000100:00100000:0.0:1782216893.690866:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693024640 00000100:00100000:0.0:1782216893.690870:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693024640 00000100:00100000:0.0:1782216893.690900:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:0.0:1782216893.690908:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1868789693024384:12345-192.168.203.30@tcp:38: 00010000:00080000:0.0:1782216893.690943:0:6520:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 24a87249-c61f-41a1-85ec-9a313129e739@192.168.203.30@tcp t0 exp 0000000000000000 cur 256 last 0 00000020:00000080:0.0:1782216893.690999:0:6520:0:(genops.c:1406:class_connect()) connect: client 24a87249-c61f-41a1-85ec-9a313129e739, cookie 0x92b8e04cbf5f9367 00000004:00100000:0.0:1782216893.691020:0:6520:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1782216893.691249:0:6520:0:(import.c:65:import_set_state_nolock()) ffff952d435d7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782216893.691318:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+6:2401:x1868789693024384:12345-192.168.203.30@tcp:38: Request processed in 409us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216893.691325:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:0.0:1782216893.691343:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 8 00000100:00100000:0.0:1782216893.691348:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42739f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1868789693024640:12345-192.168.203.30@tcp:38: 00010000:00080000:0.0:1782216893.691362:0:6520:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 24a87249-c61f-41a1-85ec-9a313129e739@192.168.203.30@tcp t0 exp 0000000000000000 cur 256 last 0 00000020:00000080:0.0:1782216893.691398:0:6520:0:(genops.c:1406:class_connect()) connect: client 24a87249-c61f-41a1-85ec-9a313129e739, cookie 0x92b8e04cbf5f936e 00000004:00100000:0.0:1782216893.691410:0:6520:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1782216893.691515:0:6520:0:(import.c:65:import_set_state_nolock()) ffff952d436dd800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782216893.691538:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42739f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+6:2401:x1868789693024640:12345-192.168.203.30@tcp:38: Request processed in 189us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216893.691545:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 8 00010000:00010000:3.0:1782216893.944874:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782216894.701417:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782216894.701520:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216894.702814:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693024768 00000100:00100000:1.0:1782216894.702817:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693024512 00000100:00100000:1.0:1782216894.702827:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693024512 00000100:00100000:0.0:1782216894.702827:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693024768 00000100:00100000:3.0:1782216894.702874:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00080000:2.0:1782216894.702893:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782216894.702898:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782216894.702906:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693024896 00000100:00100000:1.0:1782216894.702910:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693024896 00000100:00100000:0.0:1782216894.702917:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:3.0:1782216894.702928:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00100000:0.0:1782216894.702936:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+7:0:x1868789693024512:12345-192.168.203.30@tcp:41: 00000100:00100000:3.0:1782216894.702944:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4263c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+6:0:x1868789693024768:12345-192.168.203.30@tcp:41: 00000004:00000024:3.0:1782216894.702984:0:6548:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000004:00000024:0.0:1782216894.702984:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1782216894.703053:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4263c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+6:0:x1868789693024768:12345-192.168.203.30@tcp:41: Request processed in 114us (1644us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216894.703061:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00100000:3.0:1782216894.703080:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 11 00000100:00100000:3.0:1782216894.703087:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+7:6159:x1868789693024896:12345-192.168.203.30@tcp:41: 00000004:00000024:3.0:1782216894.703099:0:6548:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1782216894.703859:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+7:0:x1868789693024512:12345-192.168.203.30@tcp:41: Request processed in 926us (2333us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216894.703875:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:3.0:1782216894.704041:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+6:6159:x1868789693024896:12345-192.168.203.30@tcp:41: Request processed in 954us (1182us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216894.704049:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 11 00000100:00100000:3.0:1782216894.718331:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216894.718474:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693025024 00000100:00100000:1.0:1782216894.718484:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693025024 00000100:00100000:1.0:1782216894.718547:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 12 00000100:00100000:1.0:1782216894.718559:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+6:6159:x1868789693025024:12345-192.168.203.30@tcp:40: 00000100:00100000:1.0:1782216894.718687:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+6:6159:x1868789693025024:12345-192.168.203.30@tcp:40: Request processed in 130us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216894.718694:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 12 00000100:00100000:1.0:1782216894.733830:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216894.733883:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216894.733911:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216894.733955:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216894.733970:0:10025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693025152 00000100:00100000:2.0:1782216894.733993:0:10025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693025152 00000100:00100000:2.0:1782216894.734035:0:10025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693025280 00000100:00100000:2.0:1782216894.734038:0:10025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693025280 00000100:00100000:2.0:1782216894.734058:0:10025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:2.0:1782216894.734066:0:10025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c66ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2401:x1868789693025152:12345-192.168.203.30@tcp:8: 00000100:00100000:0.0:1782216894.734082:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:0.0:1782216894.734088:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c66ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2401:x1868789693025280:12345-192.168.203.30@tcp:8: 00010000:00080000:2.0:1782216894.734107:0:10025:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 24a87249-c61f-41a1-85ec-9a313129e739@192.168.203.30@tcp t0 exp 0000000000000000 cur 257 last 0 00010000:00080000:0.0:1782216894.734107:0:8432:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 24a87249-c61f-41a1-85ec-9a313129e739@192.168.203.30@tcp t0 exp 0000000000000000 cur 257 last 0 00000020:00000080:2.0:1782216894.734133:0:10025:0:(genops.c:1406:class_connect()) connect: client 24a87249-c61f-41a1-85ec-9a313129e739, cookie 0x92b8e04cbf5f9375 00000020:00000080:0.0:1782216894.734133:0:8432:0:(genops.c:1406:class_connect()) connect: client 24a87249-c61f-41a1-85ec-9a313129e739, cookie 0x92b8e04cbf5f937c 00002000:00100000:2.0:1782216894.734144:0:10025:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 24a87249-c61f-41a1-85ec-9a313129e739/ffff952d42299000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782216894.734144:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 24a87249-c61f-41a1-85ec-9a313129e739/ffff952d436da000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1782216894.734159:0:10025:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00100000:0.0:1782216894.734164:0:8432:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1782216894.734308:0:10025:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00002000:00080000:0.0:1782216894.734329:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1782216894.734338:0:10025:0:(import.c:65:import_set_state_nolock()) ffff952e7c6c8000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1782216894.734341:0:8432:0:(import.c:65:import_set_state_nolock()) ffff952d436dc000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782216894.734425:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693025408 00000100:00100000:3.0:1782216894.734430:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693025408 00000100:00100000:3.0:1782216894.734463:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 4 00000100:00100000:3.0:1782216894.734470:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c66df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:24a87249-c61f-41a1-85ec-9a313129e739+6:6159:x1868789693025408:12345-192.168.203.30@tcp:900: 00000100:00100000:0.0:1782216894.734524:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c66ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24a87249-c61f-41a1-85ec-9a313129e739+6:2401:x1868789693025280:12345-192.168.203.30@tcp:8: Request processed in 434us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216894.734532:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:1.0:1782216894.734680:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693025536 00000100:00100000:1.0:1782216894.734685:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693025536 00000100:00100000:1.0:1782216894.734713:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 195 00000100:00100000:1.0:1782216894.734720:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+10:2403:x1868789693025536:12345-192.168.203.30@tcp:400: 00000100:00100000:2.0:1782216894.738349:0:10025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c66ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:24a87249-c61f-41a1-85ec-9a313129e739+6:2401:x1868789693025152:12345-192.168.203.30@tcp:8: Request processed in 4270us (4453us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216894.738405:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c66df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:24a87249-c61f-41a1-85ec-9a313129e739+6:6159:x1868789693025408:12345-192.168.203.30@tcp:900: Request processed in 3933us (4581us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216894.738432:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 4 00000100:00100000:2.0:1782216894.738432:0:10025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:1.0:1782216894.738506:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+10:2403:x1868789693025536:12345-192.168.203.30@tcp:400: Request processed in 3784us (4548us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216894.738514:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 195 00000100:00100000:3.0:1782216894.740981:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216894.741091:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693025664 00000100:00100000:2.0:1782216894.741101:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693025664 00000100:00100000:2.0:1782216894.741188:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:2.0:1782216894.741199:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c794380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+6:6159:x1868789693025664:12345-192.168.203.30@tcp:33: 00000004:00080000:2.0:1782216894.759524:0:6521:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 18210us 00000004:00200000:2.0:1782216894.773053:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1782216894.773170:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c794380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+6:6159:x1868789693025664:12345-192.168.203.30@tcp:33: Request processed in 31968us (32191us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216894.773180:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 0 00010000:00010000:1.0:1782216894.968814:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782216895.031987:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216895.033756:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693025792 00000100:00100000:0.0:1782216895.033768:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693025792 00000100:00100000:0.0:1782216895.033840:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 13 00000100:00100000:0.0:1782216895.033850:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+6:6202:x1868789693025792:12345-192.168.203.30@tcp:101: 00010000:00010000:0.0:1782216895.033878:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782216895.033943:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7c448400/0x92b8e04cbf5f9383 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9732a8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216895.034004:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7c448800/0x92b8e04cbf5f938a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216895.034034:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7c448800/0x92b8e04cbf5f938a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216895.034047:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7c448800/0x92b8e04cbf5f938a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782216895.034091:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1782216895.034095:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782216895.034110:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e7c448800/0x92b8e04cbf5f938a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216895.034135:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7c448400/0x92b8e04cbf5f9383 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9732a8 expref: 8 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216895.034154:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7c448800/0x92b8e04cbf5f938a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9732a8 expref: 7 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216895.034162:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952e46d75300) 00010000:00010000:0.0:1782216895.034164:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782216895.034168:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7c448800, rc 0) 00000100:00100000:0.0:1782216895.034239:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+7:6202:x1868789693025792:12345-192.168.203.30@tcp:101: Request processed in 390us (2261us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216895.034246:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 13 00010000:00010000:3.0:1782216895.992859:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782216896.056876:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782216896.056913:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789712997632:0@lo:13: 00000100:00100000:3.0:1782216896.057004:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216896.057071:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c794700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789712997504:0@lo:13: 00000100:00100000:3.0:1782216896.057095:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216896.057135:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712997632 00000100:00100000:3.0:1782216896.057145:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712997632 00000100:00100000:3.0:1782216896.057201:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712997504 00000100:00100000:3.0:1782216896.057205:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712997504 00000100:00100000:3.0:1782216896.057230:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782216896.057240:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c796680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789712997632:12345-0@lo:13: 00002000:00000024:3.0:1782216896.057305:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782216896.057367:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c796680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789712997632:12345-0@lo:13: Request processed in 129us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216896.057375:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782216896.057394:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782216896.057400:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3650:x1868789712997504:12345-0@lo:13: 00002000:00000024:3.0:1782216896.057416:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782216896.057450:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3650:x1868789712997504:12345-0@lo:13: Request processed in 50us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216896.057457:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1782216896.057500:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d42612680 x1868789712997632/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216912 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216896.057530:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789712997632:0@lo:13: 00010000:00080000:3.0:1782216896.057544:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7c794700 x1868789712997504/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216912 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216896.057556:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c794700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789712997504:0@lo:13: 00000100:00100000:3.0:1782216896.057640:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789712997760:0@lo:400: 00000100:00100000:3.0:1782216896.057681:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216896.057719:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42611180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789712998272:0@lo:400: 00000100:00100000:3.0:1782216896.057746:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216896.057764:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42611880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1868789712998784:0@lo:400: 00000100:00100000:3.0:1782216896.057806:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216896.057824:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1782216896.057831:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42610a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1868789712997888:0@lo:400: 00000100:00100000:3.0:1782216896.057858:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216896.057873:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1868789712998400:0@lo:400: 00000100:00100000:3.0:1782216896.057899:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216896.057917:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1868789712998912:0@lo:400: 00000100:00100000:3.0:1782216896.057940:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216896.057973:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712998784 00000100:00100000:3.0:1782216896.057977:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712998784 00000100:00100000:3.0:1782216896.058004:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712997888 00000100:00100000:3.0:1782216896.058007:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712997888 00000100:00100000:3.0:1782216896.058019:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712998400 00000100:00100000:3.0:1782216896.058022:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712998400 00000100:00100000:3.0:1782216896.058034:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712998912 00000100:00100000:3.0:1782216896.058037:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712998912 00000100:00100000:1.0:1782216896.058040:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789712998016:0@lo:400: 00000100:00100000:3.0:1782216896.058068:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1782216896.058076:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c794a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1868789712998784:12345-0@lo:400: 00000100:00100000:1.0:1782216896.058086:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216896.058112:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1868789712998528:0@lo:400: 00000100:00100000:3.0:1782216896.058126:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c794a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1868789712998784:12345-0@lo:400: Request processed in 50us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216896.058134:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1782216896.058139:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216896.058153:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712998528 00000100:00100000:1.0:1782216896.058154:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789712999040:0@lo:400: 00000100:00100000:3.0:1782216896.058159:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712998528 00000100:00100000:1.0:1782216896.058185:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216896.058188:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1782216896.058198:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c795c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1868789712997888:12345-0@lo:400: 00000100:00100000:1.0:1782216896.058207:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1782216896.058214:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42610000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1868789712998144:0@lo:400: 00000100:00100000:1.0:1782216896.058242:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216896.058244:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c795c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1868789712997888:12345-0@lo:400: Request processed in 45us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216896.058252:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1782216896.058259:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42613480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789712998656:0@lo:400: 00000100:00100000:3.0:1782216896.058264:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712998144 00000100:00100000:3.0:1782216896.058268:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712998144 00000100:00100000:3.0:1782216896.058286:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1782216896.058294:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1868789712998400:12345-0@lo:400: 00000100:00100000:1.0:1782216896.058305:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1782216896.058435:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782216896.058440:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782216896.058443:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782216896.058446:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782216896.058456:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712997760 00000100:00100000:2.0:1782216896.058459:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712997760 00000100:00100000:2.0:1782216896.058486:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1782216896.058492:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3647:x1868789712997760:12345-0@lo:400: 00000100:00100000:3.0:1782216896.058531:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1868789712998400:12345-0@lo:400: Request processed in 239us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216896.058537:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1782216896.058547:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1782216896.058552:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c795180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1868789712998912:12345-0@lo:400: 00000100:00100000:3.0:1782216896.058575:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c795180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1868789712998912:12345-0@lo:400: Request processed in 23us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216896.058598:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1782216896.058607:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1782216896.058612:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c66d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1868789712998528:12345-0@lo:400: 00000100:00100000:3.0:1782216896.058634:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c66d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1868789712998528:12345-0@lo:400: Request processed in 22us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216896.058644:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1782216896.058654:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1782216896.058659:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c66f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1868789712998144:12345-0@lo:400: 00000100:00100000:3.0:1782216896.058681:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c66f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1868789712998144:12345-0@lo:400: Request processed in 23us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216896.058687:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1782216896.058713:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42610a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1868789712997888:0@lo:400: 00000100:00100000:3.0:1782216896.058723:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1868789712998400:0@lo:400: 00010000:00080000:3.0:1782216896.058733:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d42612300 x1868789712998912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216896.058742:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1868789712998912:0@lo:400: 00000100:00100000:3.0:1782216896.058751:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42611880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1868789712998784:0@lo:400: 00000100:00100000:3.0:1782216896.058775:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789712999168:0@lo:13: 00000100:00100000:3.0:1782216896.058809:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216896.058833:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712999168 00000100:00100000:3.0:1782216896.058837:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712999168 00000100:00100000:3.0:1782216896.058861:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782216896.058866:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c795500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1868789712999168:12345-0@lo:13: 00002000:00000024:3.0:1782216896.058879:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782216896.058906:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c795500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1868789712999168:12345-0@lo:13: Request processed in 39us (95us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216896.058913:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1782216896.058937:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d41be5f80 x1868789712999168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216912 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1782216896.058947:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d42612680 x1868789712998528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216896.058979:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1868789712998528:0@lo:400: 00000100:00100000:3.0:1782216896.058985:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789712999168:0@lo:13: 00000100:00100000:1.0:1782216896.059005:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42610000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1868789712998144:0@lo:400: 00000100:00100000:1.0:1782216896.059034:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712998272 00000100:00100000:1.0:1782216896.059039:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712998272 00000100:00100000:3.0:1782216896.059073:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c797b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789712999296:0@lo:13: 00000100:00100000:1.0:1782216896.059076:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712998016 00000100:00100000:1.0:1782216896.059081:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712998016 00000100:00100000:1.0:1782216896.059101:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1782216896.059106:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216896.059111:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c794700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789712998272:12345-0@lo:400: 00000100:00100000:3.0:1782216896.059135:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712999296 00000100:00100000:3.0:1782216896.059140:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712999296 00000100:00100000:1.0:1782216896.059166:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c794700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789712998272:12345-0@lo:400: Request processed in 57us (1418us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216896.059167:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1782216896.059180:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1782216896.059181:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c797100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789712999296:12345-0@lo:13: 00002000:00000024:3.0:1782216896.059195:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782216896.059199:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1782216896.059208:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c66e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789712998016:12345-0@lo:400: 00000100:00100000:3.0:1782216896.059240:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c797100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789712999296:12345-0@lo:13: Request processed in 62us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216896.059247:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1782216896.059265:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c66e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789712998016:12345-0@lo:400: Request processed in 57us (1179us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216896.059273:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1782216896.059297:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782216896.059301:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782216896.059313:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712999040 00000100:00100000:1.0:1782216896.059317:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712999040 00010000:00080000:3.0:1782216896.059345:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7c797b80 x1868789712999296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216912 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216896.059347:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712998656 00000100:00100000:1.0:1782216896.059352:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712998656 00000100:00100000:0.0:1782216896.059356:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782216896.059369:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c797b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789712999296:0@lo:13: 00000100:00100000:1.0:1782216896.059381:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782216896.059385:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42611180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789712998272:0@lo:400: 00000100:00100000:1.0:1782216896.059391:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c66c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789712998656:12345-0@lo:400: 00000100:00100000:1.0:1782216896.059430:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c66c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789712998656:12345-0@lo:400: Request processed in 41us (1124us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216896.059680:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c66c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1868789712999040:12345-0@lo:400: 00000100:00100000:1.0:1782216896.059706:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782216896.059733:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c66c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1868789712999040:12345-0@lo:400: Request processed in 364us (1546us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216896.059744:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1782216896.059745:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d42613480 x1868789712998656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216896.059761:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42613480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789712998656:0@lo:400: 00000100:00100000:1.0:1782216896.059773:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789712998016:0@lo:400: 00010000:00080000:1.0:1782216896.059797:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d42612a00 x1868789712999040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216896.059806:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789712999040:0@lo:400: 00000100:00100000:2.0:1782216896.061654:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3647:x1868789712997760:12345-0@lo:400: Request processed in 3149us (3960us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216896.061670:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1782216896.061817:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789712997760:0@lo:400: 00000100:00100000:1.0:1782216896.568903:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782216896.568936:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c797b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789712999424:0@lo:41: 00000100:00100000:1.0:1782216896.569020:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216896.569279:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712999424 00000100:00100000:2.0:1782216896.569289:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712999424 00000100:00100000:2.0:1782216896.569348:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1782216896.569358:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c66e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789712999424:12345-0@lo:41: 00000004:00000024:2.0:1782216896.569399:0:7938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1782216896.569614:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c66e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789712999424:12345-0@lo:41: Request processed in 256us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216896.569624:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1782216896.569835:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c797b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789712999424:0@lo:41: 00010000:00010000:1.0:1782216897.016877:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1782216897.090694:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 24a87249-c61f-41a1-85ec-9a313129e739 00000001:00080000:2.0:1782216897.090718:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:2.0:1782216897.090731:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:3.0:1782216897.243695:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216897.246383:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693025920 00000100:00100000:0.0:1782216897.246401:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693025920 00000100:00100000:0.0:1782216897.246947:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 14 00000100:00100000:0.0:1782216897.246963:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c797b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+7:6254:x1868789693025920:12345-192.168.203.30@tcp:41: 00000004:00000024:0.0:1782216897.247407:0:6548:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1782216897.247832:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c797b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+7:6254:x1868789693025920:12345-192.168.203.30@tcp:41: Request processed in 870us (4148us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216897.247842:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 14 00000100:00080000:3.0:1782216897.247972:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782216897.256072:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216897.256363:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693026048 00000100:00100000:0.0:1782216897.256375:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693026048 00000100:00100000:0.0:1782216897.256509:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 15 00000100:00100000:0.0:1782216897.256521:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c66f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+6:6254:x1868789693026048:12345-192.168.203.30@tcp:41: 00000004:00000024:0.0:1782216897.256571:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1782216897.256716:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c66f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+6:6254:x1868789693026048:12345-192.168.203.30@tcp:41: Request processed in 196us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216897.256726:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 15 00000100:00080000:3.0:1782216897.257737:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782216897.267146:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782216897.269175:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693026176 00000100:00100000:3.0:1782216897.269196:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693026176 00000100:00100000:3.0:1782216897.269348:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00100000:3.0:1782216897.269361:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c66ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:24a87249-c61f-41a1-85ec-9a313129e739+6:6254:x1868789693026176:12345-192.168.203.30@tcp:13: 00000100:00080000:2.0:1782216897.269370:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1782216897.269399:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782216897.269502:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c66ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:24a87249-c61f-41a1-85ec-9a313129e739+6:6254:x1868789693026176:12345-192.168.203.30@tcp:13: Request processed in 143us (2370us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216897.270148:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00100000:2.0:1782216897.273538:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216897.273723:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693026304 00000100:00100000:0.0:1782216897.273737:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693026304 00000100:00100000:0.0:1782216897.273889:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:0.0:1782216897.273901:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:24a87249-c61f-41a1-85ec-9a313129e739+5:6254:x1868789693026304:12345-192.168.203.30@tcp:13: 00002000:00000024:0.0:1782216897.273936:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782216897.274026:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:24a87249-c61f-41a1-85ec-9a313129e739+5:6254:x1868789693026304:12345-192.168.203.30@tcp:13: Request processed in 127us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216897.274035:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00080000:2.0:1782216897.274131:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782216897.593623:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782216897.595744:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789712999552:0@lo:41: 00000100:00100000:2.0:1782216897.595978:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216897.599112:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712999552 00000100:00100000:0.0:1782216897.599132:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712999552 00000100:00100000:0.0:1782216897.599220:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1782216897.599260:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789712999552:12345-0@lo:41: 00000004:00000024:0.0:1782216897.599304:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1782216897.599428:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789712999552:12345-0@lo:41: Request processed in 171us (3451us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216897.599437:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1782216897.599692:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789712999552:0@lo:41: 00010000:00010000:3.0:1782216898.041456:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216899.070151:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1782216899.131126:0:7451:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 24a87249-c61f-41a1-85ec-9a313129e739 00000001:00100000:2.0:1782216899.139124:0:6498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 24a87249-c61f-41a1-85ec-9a313129e739 00000001:02000400:0.0:1782216899.995765:0:10183:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1782216900.033344:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216900.033384:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216900.033411:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216900.033431:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216900.033455:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216900.033481:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693026688 00000100:00100000:1.0:1782216900.033490:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693026688 00000100:00100000:1.0:1782216900.033545:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693026560 00000100:00100000:1.0:1782216900.033549:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693026560 00000100:00100000:1.0:1782216900.033572:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 59 00000100:00100000:1.0:1782216900.033620:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c66dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+5:2405:x1868789693026688:12345-192.168.203.30@tcp:400: 00000100:00100000:1.0:1782216900.033708:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c66dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+5:2405:x1868789693026688:12345-192.168.203.30@tcp:400: Request processed in 90us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216900.033715:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 59 00000100:00100000:1.0:1782216900.033732:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 60 00000100:00100000:1.0:1782216900.033739:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c66d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+6:2405:x1868789693026560:12345-192.168.203.30@tcp:400: 00000100:00100000:1.0:1782216900.033772:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c66d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+6:2405:x1868789693026560:12345-192.168.203.30@tcp:400: Request processed in 34us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216900.033778:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 60 00000100:00100000:1.0:1782216900.033795:0:10025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693026944 00000100:00100000:1.0:1782216900.033798:0:10025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693026944 00000100:00100000:1.0:1782216900.033821:0:10025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693026816 00000100:00100000:1.0:1782216900.033823:0:10025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693026816 00000100:00100000:1.0:1782216900.033855:0:10025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:1.0:1782216900.033861:0:10025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c66c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:24a87249-c61f-41a1-85ec-9a313129e739+5:2405:x1868789693026944:12345-192.168.203.30@tcp:400: 00000100:00100000:1.0:1782216900.033885:0:10025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c66c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:24a87249-c61f-41a1-85ec-9a313129e739+5:2405:x1868789693026944:12345-192.168.203.30@tcp:400: Request processed in 25us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216900.033891:0:10025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:1.0:1782216900.033902:0:10025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:1.0:1782216900.033908:0:10025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c66d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:24a87249-c61f-41a1-85ec-9a313129e739+6:2405:x1868789693026816:12345-192.168.203.30@tcp:400: 00000100:00100000:1.0:1782216900.033930:0:10025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c66d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:24a87249-c61f-41a1-85ec-9a313129e739+6:2405:x1868789693026816:12345-192.168.203.30@tcp:400: Request processed in 21us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216900.033936:0:10025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00080000:1.0:1782216900.033958:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782216900.033961:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782216900.033971:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782216900.033973:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782216900.034379:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693026432 00000100:00100000:3.0:1782216900.034385:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693026432 00000100:00100000:3.0:1782216900.034431:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 197 00000100:00100000:3.0:1782216900.034438:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+10:2405:x1868789693026432:12345-192.168.203.30@tcp:400: 00000100:00100000:3.0:1782216900.034473:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+10:2405:x1868789693026432:12345-192.168.203.30@tcp:400: Request processed in 35us (1138us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216900.034479:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 197 00010000:00010000:1.0:1782216900.088800:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782216901.114248:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782216901.176914:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789712999680:0@lo:13: 00000100:00100000:3.0:1782216901.177010:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216901.177097:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c796d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789712999808:0@lo:13: 00000100:00100000:3.0:1782216901.177123:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216901.177155:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782216901.177162:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c796a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789712999936:0@lo:13: 00000100:00100000:3.0:1782216901.177466:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216901.177497:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712999680 00000100:00100000:3.0:1782216901.177505:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712999680 00000100:00100000:1.0:1782216901.177762:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713000064:0@lo:13: 00000100:00100000:1.0:1782216901.177792:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216901.177804:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1868789713000576:0@lo:400: 00000100:00100000:1.0:1782216901.177825:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216901.177840:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43606d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1868789713001088:0@lo:400: 00000100:00100000:1.0:1782216901.177857:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216901.177873:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1782216901.177878:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c66fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789713000192:0@lo:400: 00000100:00100000:1.0:1782216901.177903:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216901.177923:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43607100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713000704:0@lo:400: 00000100:00100000:1.0:1782216901.177944:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216901.177960:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43606a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1868789713001216:0@lo:400: 00000100:00100000:1.0:1782216901.177976:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216901.178013:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c66ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713000448:0@lo:400: 00000100:00100000:1.0:1782216901.178035:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216901.178051:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1868789713000960:0@lo:400: 00000100:00100000:1.0:1782216901.178070:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216901.178083:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1782216901.178087:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c66f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1868789713000320:0@lo:400: 00000100:00100000:1.0:1782216901.178105:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216901.178128:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43604e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1868789713000832:0@lo:400: 00000100:00100000:1.0:1782216901.178155:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216901.178165:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43606300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713001344:0@lo:400: 00000100:00100000:1.0:1782216901.178193:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216901.178327:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712999808 00000100:00100000:3.0:1782216901.178332:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712999808 00000100:00100000:1.0:1782216901.178364:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713000576 00000100:00100000:1.0:1782216901.178368:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713000576 00000100:00100000:1.0:1782216901.178390:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713001088 00000100:00100000:1.0:1782216901.178392:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713001088 00000100:00080000:0.0:1782216901.181884:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782216901.181898:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782216901.181902:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782216901.182065:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713000704 00000100:00100000:0.0:1782216901.182079:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713000704 00000100:00100000:0.0:1782216901.182146:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713000448 00000100:00100000:0.0:1782216901.182151:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713000448 00000100:00100000:0.0:1782216901.182177:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1782216901.182190:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43604700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713000704:12345-0@lo:400: 00000100:00100000:3.0:1782216901.182456:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789712999936 00000100:00100000:3.0:1782216901.182461:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789712999936 00000100:00100000:3.0:1782216901.182490:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713000064 00000100:00100000:3.0:1782216901.182493:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713000064 00000100:00100000:3.0:1782216901.182509:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782216901.182517:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c796300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789712999680:12345-0@lo:13: 00002000:00000024:3.0:1782216901.182556:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782216901.182676:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c796300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789712999680:12345-0@lo:13: Request processed in 159us (5667us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216901.182687:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782216901.182706:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782216901.182713:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c794e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789712999808:12345-0@lo:13: 00002000:00000024:3.0:1782216901.182732:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782216901.182777:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c794e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789712999808:12345-0@lo:13: Request processed in 65us (5653us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216901.182784:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782216901.182795:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1782216901.182800:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4268e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789712999936:12345-0@lo:13: 00002000:00000024:3.0:1782216901.182810:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782216901.182829:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4268e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789712999936:12345-0@lo:13: Request processed in 30us (5364us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216901.182834:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1782216901.182842:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782216901.182847:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43605880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713000064:12345-0@lo:13: 00002000:00000024:3.0:1782216901.182856:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782216901.182881:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43605880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713000064:12345-0@lo:13: Request processed in 34us (5088us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216901.182886:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1782216901.182959:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7c795f80 x1868789712999680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216917 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216901.182990:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789712999680:0@lo:13: 00010000:00080000:3.0:1782216901.183038:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d42613800 x1868789713000064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216917 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216901.183047:0:3649:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1782216901.183059:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713000064:0@lo:13: 00000100:00080000:3.0:1782216901.183175:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782216901.183179:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782216901.183281:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1782216901.183289:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713000448:12345-0@lo:400: 00000100:00100000:3.0:1782216901.183334:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713000448:12345-0@lo:400: Request processed in 46us (5298us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216901.183341:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1782216901.183372:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713001216 00000100:00100000:3.0:1782216901.183378:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713001216 00000100:00100000:1.0:1782216901.183411:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713000960 00000100:00100000:1.0:1782216901.183417:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713000960 00000100:00100000:3.0:1782216901.183424:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713000320 00000100:00100000:3.0:1782216901.183427:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713000320 00000100:00100000:3.0:1782216901.183437:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713000832 00000100:00100000:3.0:1782216901.183440:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713000832 00000100:00100000:1.0:1782216901.183442:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1782216901.183449:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1868789713000576:12345-0@lo:400: 00000100:00100000:3.0:1782216901.183453:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1782216901.183458:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43606680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1868789713001216:12345-0@lo:400: 00000100:00100000:1.0:1782216901.183491:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1868789713000576:12345-0@lo:400: Request processed in 42us (5665us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216901.183497:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1782216901.183512:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1782216901.183518:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43604a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1868789713000960:12345-0@lo:400: 00000100:00100000:1.0:1782216901.183542:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43604a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1868789713000960:12345-0@lo:400: Request processed in 25us (5472us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216901.183548:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1782216901.183559:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1782216901.183564:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1868789713000320:12345-0@lo:400: 00000100:00100000:3.0:1782216901.183568:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43606680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1868789713001216:12345-0@lo:400: Request processed in 109us (5590us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216901.183574:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1782216901.183605:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1782216901.183607:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1868789713000320:12345-0@lo:400: Request processed in 44us (5502us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216901.183611:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43604000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1868789713000832:12345-0@lo:400: 00000100:00100000:1.0:1782216901.183613:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1782216901.183641:0:10025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713001344 00000100:00100000:1.0:1782216901.183645:0:10025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713001344 00000100:00100000:3.0:1782216901.183657:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43604000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1868789713000832:12345-0@lo:400: Request processed in 46us (5501us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216901.183668:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1782216901.183671:0:10025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782216901.183677:0:10025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43605180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713001344:12345-0@lo:400: 00000100:00100000:3.0:1782216901.183687:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713000192 00000100:00100000:3.0:1782216901.183691:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713000192 00000100:00100000:1.0:1782216901.183706:0:10025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43605180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713001344:12345-0@lo:400: Request processed in 30us (5513us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216901.183717:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1782216901.183723:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3649:x1868789713000192:12345-0@lo:400: 00000100:00100000:1.0:1782216901.183733:0:10025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782216901.183768:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3649:x1868789713000192:12345-0@lo:400: Request processed in 45us (5863us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216901.183774:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1782216901.183844:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c66f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1868789713000320:0@lo:400: 00000100:00100000:3.0:1782216901.183857:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43604e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1868789713000832:0@lo:400: 00010000:00080000:3.0:1782216901.183869:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43606300 x1868789713001344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216901.183877:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43606300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713001344:0@lo:400: 00000100:00100000:3.0:1782216901.183887:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c66ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713000448:0@lo:400: 00010000:00080000:3.0:1782216901.183898:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43605f80 x1868789713000960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216901.183905:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1868789713000960:0@lo:400: 00000100:00100000:3.0:1782216901.183941:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c66fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789713000192:0@lo:400: 00000100:00100000:1.0:1782216901.183999:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1782216901.184006:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1868789713001088:12345-0@lo:400: 00000100:00100000:1.0:1782216901.184040:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1868789713001088:12345-0@lo:400: Request processed in 35us (6182us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216901.184047:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1782216901.184242:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43604700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713000704:12345-0@lo:400: Request processed in 2053us (6294us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216901.184250:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1782216901.184368:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43607100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713000704:0@lo:400: 00010000:00080000:3.0:1782216901.184381:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43606a00 x1868789713001216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216901.184391:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43606a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1868789713001216:0@lo:400: 00000100:00100000:3.0:1782216901.184412:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1868789713000576:0@lo:400: 00000100:00100000:3.0:1782216901.184424:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43606d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1868789713001088:0@lo:400: 00010000:00080000:3.0:1782216901.184464:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7c796a00 x1868789712999936/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216917 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216901.184480:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c796a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789712999936:0@lo:13: 00010000:00080000:3.0:1782216901.188835:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7c796d80 x1868789712999808/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216917 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216901.188857:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1782216901.188895:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c796d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789712999808:0@lo:13: 00000100:00080000:3.0:1782216901.188937:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782216901.188944:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:3.0:1782216901.196409:0:8428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 24a87249-c61f-41a1-85ec-9a313129e739 00000100:00100000:2.0:1782216901.690904:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782216901.690948:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713001472:0@lo:41: 00000100:00100000:2.0:1782216901.691049:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216901.693944:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713001472 00000100:00100000:3.0:1782216901.693965:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713001472 00000100:00100000:3.0:1782216901.694058:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1782216901.694072:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713001472:12345-0@lo:41: 00000004:00000024:3.0:1782216901.694125:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1782216901.694261:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713001472:12345-0@lo:41: Request processed in 192us (3212us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216901.694270:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1782216901.694770:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713001472:0@lo:41: 00010000:00010000:3.0:1782216902.137126:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782216902.720084:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713001600:0@lo:41: 00000100:00100000:0.0:1782216902.720160:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216902.720814:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713001600 00000100:00100000:2.0:1782216902.720823:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713001600 00000100:00100000:3.0:1782216902.721571:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1782216902.721696:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42612a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713001600:12345-0@lo:41: 00000004:00000024:3.0:1782216902.721744:0:7938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1782216902.721820:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42612a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713001600:12345-0@lo:41: Request processed in 239us (1659us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216902.721840:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1782216902.722083:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713001600:0@lo:41: 00010000:00010000:0.0:1782216903.161703:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782216903.714846:0:10330:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe2d25e7b0 20000000:00000080:0.0:1782216903.714870:0:10330:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff952e7c79e000 uarg=0000000000000000 20000000:01000000:0.0:1782216903.714933:0:10330:0:(mgs_llog.c:2004:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1782216903.714937:0:10330:0:(mgs_llog.c:6054:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1782216903.714941:0:10330:0:(mgs_llog.c:6085:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1782216903.714947:0:10330:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1782216903.714958:0:10330:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1782216903.715036:0:10330:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1782216903.715039:0:10330:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1782216903.715886:0:10331:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:3.0:1782216903.716179:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:3.0:1782216903.716211:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:3.0:1782216903.716225:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:3.0:1782216903.716234:0:10330:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1782216903.716237:0:10330:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1782216903.716520:0:10332:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:0.0:1782216903.716697:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:0.0:1782216903.716718:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:0.0:1782216903.716743:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:0.0:1782216903.716751:0:10330:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1782216903.716753:0:10330:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1782216903.717112:0:10333:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:0.0:1782216903.717684:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:0.0:1782216903.717714:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:0.0:1782216903.717742:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:0.0:1782216903.717756:0:10330:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1782216903.717758:0:10330:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1782216903.724230:0:10334:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:3.0:1782216903.728070:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:3.0:1782216903.728116:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:3.0:1782216903.728134:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:3.0:1782216903.728147:0:10330:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1782216903.728150:0:10330:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1782216903.730570:0:10335:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:0.0:1782216903.730941:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:0.0:1782216903.730981:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:0.0:1782216903.730997:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 10000000:01000000:0.0:1782216903.731015:0:10330:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1782216903.731096:0:10330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff952e7c449000/0x92b8e04cbf5f9391 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216903.731119:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952e7b363c00/0x92b8e04cbf5f922c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9225 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216903.731207:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952e7b362800/0x92b8e04cbf5f9256 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f924f expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216903.731216:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952e7b362200/0x92b8e04cbf5f9295 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f928e expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216903.731223:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952e7c449200/0x92b8e04cbf5f92a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f929c expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216903.731253:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952e7b362e00/0x92b8e04cbf5f92b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f92aa expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216903.731261:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952e7b363a00/0x92b8e04cbf5f92cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f92c6 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216903.731270:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952d43073400/0x92b8e04cbf5f92f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f92f0 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216903.731277:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952e7c448000/0x92b8e04cbf5f9313 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f930c expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216903.731285:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952e7c448e00/0x92b8e04cbf5f933d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9336 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216903.731297:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952e413fd200/0x92b8e04cbf5f934b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973238 expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216903.731306:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952e413fd600/0x92b8e04cbf5f9352 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97323f expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216903.731316:0:10330:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff952e7c449000/0x92b8e04cbf5f9391 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216903.731368:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952e413fd600/0x92b8e04cbf5f9352 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97323f expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216903.731388:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff952e413fd600/0x92b8e04cbf5f9352 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97323f expref: 9 pid: 6511 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216903.731419:0:10330:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42611c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1868789713001728:192.168.203.30@tcp:104: 00010000:00010000:0.0:1782216903.731555:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952e413fd200/0x92b8e04cbf5f934b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973238 expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216903.731564:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff952e413fd200/0x92b8e04cbf5f934b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973238 expref: 9 pid: 6511 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216903.731573:0:10330:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42613480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1868789713001856:192.168.203.30@tcp:104: 00010000:00010000:0.0:1782216903.731641:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952e7c448e00/0x92b8e04cbf5f933d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5f9336 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216903.731649:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff952e7c448e00/0x92b8e04cbf5f933d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9336 expref: 23 pid: 6511 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216903.731659:0:10330:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42611180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1868789713001984:0@lo:104: 00000100:00100000:0.0:1782216903.731704:0:10330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782216903.731756:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952e7c448000/0x92b8e04cbf5f9313 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5f930c expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216903.731764:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff952e7c448000/0x92b8e04cbf5f9313 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5f930c expref: 23 pid: 6514 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216903.731773:0:10330:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42612680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1868789713002112:0@lo:104: 00000100:00100000:0.0:1782216903.731793:0:10330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782216903.731812:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952d43073400/0x92b8e04cbf5f92f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5f92f0 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216903.731820:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff952d43073400/0x92b8e04cbf5f92f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5f92f0 expref: 23 pid: 6513 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216903.731834:0:10330:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42612300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1868789713002240:0@lo:104: 00000100:00100000:0.0:1782216903.731852:0:10330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782216903.731864:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952e7b363a00/0x92b8e04cbf5f92cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5f92c6 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216903.731871:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff952e7b363a00/0x92b8e04cbf5f92cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5f92c6 expref: 23 pid: 6511 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216903.731878:0:10330:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42610a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1868789713002368:0@lo:104: 00000100:00100000:0.0:1782216903.731895:0:10330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782216903.731906:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952e7b362e00/0x92b8e04cbf5f92b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5f92aa expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216903.731913:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff952e7b362e00/0x92b8e04cbf5f92b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5f92aa expref: 23 pid: 6514 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216903.731919:0:10330:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42613800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1868789713002496:0@lo:104: 00010000:00010000:0.0:1782216903.731936:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952e7c449200/0x92b8e04cbf5f92a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5f929c expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216903.731942:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff952e7c449200/0x92b8e04cbf5f92a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5f929c expref: 23 pid: 6513 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216903.731948:0:10330:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41bfad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1868789713002624:0@lo:104: 00010000:00010000:0.0:1782216903.731964:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952e7b362200/0x92b8e04cbf5f9295 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5f928e expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216903.731970:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff952e7b362200/0x92b8e04cbf5f9295 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5f928e expref: 23 pid: 6514 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216903.731983:0:10330:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1868789713002752:0@lo:104: 00010000:00010000:0.0:1782216903.732001:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952e7b362800/0x92b8e04cbf5f9256 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5f924f expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216903.732008:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff952e7b362800/0x92b8e04cbf5f9256 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5f924f expref: 23 pid: 6514 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216903.732014:0:10330:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1868789713002880:0@lo:104: 00010000:00010000:0.0:1782216903.732033:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952e7b363c00/0x92b8e04cbf5f922c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5f9225 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216903.732038:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff952e7b363c00/0x92b8e04cbf5f922c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9225 expref: 23 pid: 6513 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216903.732045:0:10330:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1868789713003008:0@lo:104: 00000100:00100000:0.0:1782216903.732063:0:10330:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d42676840 going to sleep for 11 seconds 00000100:00100000:3.0:1782216903.732287:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1782216903.732309:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216903.732320:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216903.732327:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216903.732336:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216903.732343:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216903.732352:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713001984 00000100:00100000:3.0:1782216903.732360:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713001984 00000100:00100000:3.0:1782216903.732402:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713002112 00000100:00100000:3.0:1782216903.732406:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713002112 00000100:00100000:3.0:1782216903.732417:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713002240 00000100:00100000:3.0:1782216903.732419:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713002240 00000100:00100000:3.0:1782216903.732427:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713002368 00000100:00100000:3.0:1782216903.732429:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713002368 00000100:00100000:3.0:1782216903.732438:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713002496 00000100:00100000:3.0:1782216903.732440:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713002496 00000100:00100000:3.0:1782216903.732449:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713002624 00000100:00100000:3.0:1782216903.732450:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713002624 00000100:00100000:3.0:1782216903.732458:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713002752 00000100:00100000:3.0:1782216903.732468:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713002752 00000100:00100000:3.0:1782216903.732479:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713002880 00000100:00100000:3.0:1782216903.732480:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713002880 00000100:00100000:3.0:1782216903.732489:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713003008 00000100:00100000:3.0:1782216903.732491:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713003008 00000100:00100000:3.0:1782216903.732505:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1782216903.732514:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42610000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+11:10330:x1868789713001984:12345-0@lo:104: 00010000:00010000:3.0:1782216903.732531:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff952e7c449c00/0x92b8e04cbf5f9336 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f933d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216903.732621:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782216903.732628:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42610000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+11:10330:x1868789713001984:12345-0@lo:104: Request processed in 115us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216903.732636:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1782216903.732656:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782216903.732663:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42611880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+10:10330:x1868789713002112:12345-0@lo:104: 00010000:00010000:3.0:1782216903.732671:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff952e7c449400/0x92b8e04cbf5f930c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f9313 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216903.732705:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1782216903.732711:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42611880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+10:10330:x1868789713002112:12345-0@lo:104: Request processed in 49us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216903.732717:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782216903.732740:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782216903.732747:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42611500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+9:10330:x1868789713002240:12345-0@lo:104: 00010000:00010000:3.0:1782216903.732755:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff952e41681600/0x92b8e04cbf5f92f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f92f7 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216903.732781:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1782216903.732943:0:10330:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42611180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1868789713001984:0@lo:104: 00000100:00100000:0.0:1782216903.732955:0:10330:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42612680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1868789713002112:0@lo:104: 00000100:00100000:0.0:1782216903.732962:0:10330:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42612300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1868789713002240:0@lo:104: 00000100:00100000:3.0:1782216903.733000:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42611500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+9:10330:x1868789713002240:12345-0@lo:104: Request processed in 253us (1146us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216903.733007:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782216903.733021:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782216903.733028:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41b8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+8:10330:x1868789713002368:12345-0@lo:104: 00010000:00010000:3.0:1782216903.733036:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff952e7b363400/0x92b8e04cbf5f92c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f92cd expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216903.733073:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1782216903.733079:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41b8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+8:10330:x1868789713002368:12345-0@lo:104: Request processed in 52us (1182us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216903.733084:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782216903.733118:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782216903.733125:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4268dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+7:10330:x1868789713002496:12345-0@lo:104: 00010000:00010000:3.0:1782216903.733133:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff952e413fc400/0x92b8e04cbf5f92aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f92b1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216903.733173:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1782216903.733178:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4268dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+7:10330:x1868789713002496:12345-0@lo:104: Request processed in 55us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216903.733184:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782216903.733196:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1782216903.733202:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4268c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+6:10330:x1868789713002624:12345-0@lo:104: 00010000:00010000:3.0:1782216903.733209:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff952e7b362000/0x92b8e04cbf5f929c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f92a3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216903.733235:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1782216903.733244:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4268c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+6:10330:x1868789713002624:12345-0@lo:104: Request processed in 43us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216903.733250:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1782216903.733261:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1782216903.733267:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4268d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+5:10330:x1868789713002752:12345-0@lo:104: 00010000:00010000:3.0:1782216903.733274:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff952e41680e00/0x92b8e04cbf5f928e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f9295 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216903.733299:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1782216903.733303:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4268d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+5:10330:x1868789713002752:12345-0@lo:104: Request processed in 37us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216903.733308:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1782216903.733317:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782216903.733323:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4268d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+4:10330:x1868789713002880:12345-0@lo:104: 00010000:00010000:3.0:1782216903.733331:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff952e41681000/0x92b8e04cbf5f924f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f9256 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216903.733354:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:3.0:1782216903.733359:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4268d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+4:10330:x1868789713002880:12345-0@lo:104: Request processed in 36us (1022us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216903.733364:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782216903.733373:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1782216903.733378:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4268fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+3:10330:x1868789713003008:12345-0@lo:104: 00010000:00010000:3.0:1782216903.733385:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff952e7b363600/0x92b8e04cbf5f9225 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f922c expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216903.733408:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:3.0:1782216903.733417:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4268fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+3:10330:x1868789713003008:12345-0@lo:104: Request processed in 39us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216903.733423:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1782216903.733447:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1782216903.733454:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e7c449c00/0x92b8e04cbf5f9336 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f933d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216903.733461:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7c449c00 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:3.0:1782216903.733466:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e7c449c00/0x92b8e04cbf5f9336 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5f933d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216903.733475:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e7c449c00/0x92b8e04cbf5f9336 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5f933d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782216903.733483:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e7c449c00/0x92b8e04cbf5f9336 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5f933d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782216903.733489:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782216903.733535:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e7c449c00/0x92b8e04cbf5f9336 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f933d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216903.733542:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782216903.733564:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e7c449c00/0x92b8e04cbf5f9336 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f933d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216903.733572:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e7c449c00/0x92b8e04cbf5f9336 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f933d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216903.733616:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1782216903.733620:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e7c449400/0x92b8e04cbf5f930c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f9313 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216903.733637:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7c449400 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:3.0:1782216903.733640:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e7c449400/0x92b8e04cbf5f930c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5f9313 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216903.733647:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e7c449400/0x92b8e04cbf5f930c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5f9313 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782216903.733653:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e7c449400/0x92b8e04cbf5f930c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5f9313 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782216903.733658:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782216903.733672:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e7c449400/0x92b8e04cbf5f930c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f9313 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216903.733678:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782216903.733693:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e7c449400/0x92b8e04cbf5f930c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f9313 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216903.733700:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e7c449400/0x92b8e04cbf5f930c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f9313 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216903.733710:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1782216903.733713:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e41681600/0x92b8e04cbf5f92f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f92f7 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216903.733719:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e41681600 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:3.0:1782216903.733733:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e41681600/0x92b8e04cbf5f92f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5f92f7 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216903.733750:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e41681600/0x92b8e04cbf5f92f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5f92f7 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782216903.733757:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e41681600/0x92b8e04cbf5f92f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5f92f7 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782216903.733763:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782216903.733777:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e41681600/0x92b8e04cbf5f92f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f92f7 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216903.733782:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1782216903.735159:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789713003264:0@lo:103: 00000100:00100000:2.0:1782216903.735244:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216903.735298:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782216903.735305:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789713003392:0@lo:103: 00000100:00100000:2.0:1782216903.735331:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216903.735366:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713003264 00000100:00100000:2.0:1782216903.735374:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713003264 00010000:00010000:2.0:1782216903.735410:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952e7c448000/0x92b8e04cbf5f9313 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f930c expref: 24 pid: 6514 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216903.735443:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713003392 00000100:00100000:2.0:1782216903.735446:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713003392 00010000:00010000:2.0:1782216903.735458:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952d43073400/0x92b8e04cbf5f92f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f92f0 expref: 25 pid: 6513 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216903.735477:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782216903.735485:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e6f92f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17bce19a-7a0f-4c9d-b31c-4e0155298487+25:3647:x1868789713003264:12345-0@lo:103: 00010000:00010000:2.0:1782216903.735500:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782216903.735506:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952e7c448000/0x92b8e04cbf5f9313 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f930c expref: 25 pid: 6514 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216903.735515:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952e7c448000/0x92b8e04cbf5f9313 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5f930c expref: 25 pid: 6514 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216903.735534:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e7c448000/0x92b8e04cbf5f9313 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5f930c expref: 25 pid: 6514 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216903.735550:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782216903.735604:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e6f92f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3647:x1868789713003264:12345-0@lo:103: Request processed in 98us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216903.735612:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782216903.735666:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782216903.735672:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:3647:x1868789713003392:12345-0@lo:103: 00010000:00010000:2.0:1782216903.735679:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782216903.735684:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952d43073400/0x92b8e04cbf5f92f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f92f0 expref: 23 pid: 6513 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216903.735692:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952d43073400/0x92b8e04cbf5f92f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5f92f0 expref: 23 pid: 6513 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216903.735703:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952d43073400/0x92b8e04cbf5f92f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5f92f0 expref: 23 pid: 6513 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216903.735712:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782216903.735746:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17bce19a-7a0f-4c9d-b31c-4e0155298487+22:3647:x1868789713003392:12345-0@lo:103: Request processed in 74us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216903.735752:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1782216903.736088:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e41681600/0x92b8e04cbf5f92f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f92f7 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216903.736102:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e41681600/0x92b8e04cbf5f92f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f92f7 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216903.736116:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00000100:00100000:2.0:1782216903.736283:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789713003392:0@lo:103: 00000100:00100000:2.0:1782216903.736299:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789713003264:0@lo:103: 00000100:00100000:0.0:1782216903.736445:0:10330:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42610a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1868789713002368:0@lo:104: 00000100:00100000:0.0:1782216903.736457:0:10330:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42613800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1868789713002496:0@lo:104: 00000100:00100000:0.0:1782216903.736467:0:10330:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41bfad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1868789713002624:0@lo:104: 00000100:00100000:0.0:1782216903.736475:0:10330:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1868789713002752:0@lo:104: 00000100:00100000:0.0:1782216903.736484:0:10330:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1868789713002880:0@lo:104: 00000100:00100000:0.0:1782216903.736493:0:10330:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1868789713003008:0@lo:104: 00010000:00010000:3.0:1782216903.736538:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e7b363400/0x92b8e04cbf5f92c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f92cd expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216903.736546:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b363400 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:3.0:1782216903.736550:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e7b363400/0x92b8e04cbf5f92c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5f92cd expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216903.736560:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e7b363400/0x92b8e04cbf5f92c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5f92cd expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782216903.736568:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e7b363400/0x92b8e04cbf5f92c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5f92cd expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216903.736644:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17bce19a-7a0f-4c9d-b31c-4e0155298487:3650:1868789713003136:0@lo:103: 00000100:00100000:0.0:1782216903.736688:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216903.736953:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713003136 00000100:00100000:2.0:1782216903.736960:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713003136 00010000:00010000:2.0:1782216903.736987:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952e7c448e00/0x92b8e04cbf5f933d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9336 expref: 22 pid: 6511 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216903.737012:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782216903.737019:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d410b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17bce19a-7a0f-4c9d-b31c-4e0155298487+22:3650:x1868789713003136:12345-0@lo:103: 00010000:00010000:2.0:1782216903.737031:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782216903.737037:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952e7c448e00/0x92b8e04cbf5f933d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9336 expref: 22 pid: 6511 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216903.737057:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952e7c448e00/0x92b8e04cbf5f933d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9336 expref: 22 pid: 6511 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216903.737073:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e7c448e00/0x92b8e04cbf5f933d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5f9336 expref: 22 pid: 6511 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216903.737085:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782216903.737117:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d410b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:3650:x1868789713003136:12345-0@lo:103: Request processed in 98us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216903.737125:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782216903.737155:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17bce19a-7a0f-4c9d-b31c-4e0155298487:3650:1868789713003136:0@lo:103: 10000000:01000000:3.0:1782216903.737377:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782216903.737454:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e7b363400/0x92b8e04cbf5f92c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f92cd expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216903.737462:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782216903.737482:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e7b363400/0x92b8e04cbf5f92c6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f92cd expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216903.737490:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e7b363400/0x92b8e04cbf5f92c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f92cd expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216903.737502:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1782216903.737506:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e413fc400/0x92b8e04cbf5f92aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f92b1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216903.737512:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e413fc400 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:3.0:1782216903.737515:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e413fc400/0x92b8e04cbf5f92aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5f92b1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216903.737523:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e413fc400/0x92b8e04cbf5f92aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5f92b1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782216903.737530:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e413fc400/0x92b8e04cbf5f92aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5f92b1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782216903.737535:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1782216903.739047:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782216903.739081:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17bce19a-7a0f-4c9d-b31c-4e0155298487:3650:1868789713003520:0@lo:103: 00000100:00100000:2.0:1782216903.739164:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216903.739406:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713003520 00000100:00100000:1.0:1782216903.739416:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713003520 00010000:00010000:1.0:1782216903.739460:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952e7b363a00/0x92b8e04cbf5f92cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f92c6 expref: 21 pid: 6511 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216903.739557:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782216903.739567:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:3650:x1868789713003520:12345-0@lo:103: 00010000:00010000:1.0:1782216903.739609:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782216903.739616:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952e7b363a00/0x92b8e04cbf5f92cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f92c6 expref: 21 pid: 6511 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216903.739628:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952e7b363a00/0x92b8e04cbf5f92cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5f92c6 expref: 21 pid: 6511 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216903.739647:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e7b363a00/0x92b8e04cbf5f92cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5f92c6 expref: 21 pid: 6511 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216903.739663:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782216903.739844:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+20:3650:x1868789713003520:12345-0@lo:103: Request processed in 278us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216903.739852:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782216903.739895:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17bce19a-7a0f-4c9d-b31c-4e0155298487:3650:1868789713003520:0@lo:103: 00010000:00010000:0.0:1782216903.744431:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1782216903.744991:0:10336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1782216903.745111:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e7b362000/0x92b8e04cbf5f929c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f92a3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216903.745126:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362000 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:1.0:1782216903.745131:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e7b362000/0x92b8e04cbf5f929c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5f92a3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216903.745143:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e7b362000/0x92b8e04cbf5f929c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5f92a3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782216903.745151:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e7b362000/0x92b8e04cbf5f929c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5f92a3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782216903.745157:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782216903.745219:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e7b362000/0x92b8e04cbf5f929c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f92a3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216903.745226:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782216903.745246:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e7b362000/0x92b8e04cbf5f929c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f92a3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216903.745254:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e7b362000/0x92b8e04cbf5f929c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f92a3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216903.745292:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782216903.745312:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e41681000/0x92b8e04cbf5f924f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f9256 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216903.745319:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e41681000 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:1.0:1782216903.745322:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e41681000/0x92b8e04cbf5f924f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5f9256 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216903.745346:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e41681000/0x92b8e04cbf5f924f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5f9256 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782216903.745353:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e41681000/0x92b8e04cbf5f924f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5f9256 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782216903.745359:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782216903.745376:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e41681000/0x92b8e04cbf5f924f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f9256 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216903.745382:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782216903.745399:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e41681000/0x92b8e04cbf5f924f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f9256 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216903.745407:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e41681000/0x92b8e04cbf5f924f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f9256 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216903.745439:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782216903.745443:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e7b363600/0x92b8e04cbf5f9225 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f922c expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216903.745463:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b363600 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:1.0:1782216903.745466:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e7b363600/0x92b8e04cbf5f9225 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5f922c expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216903.745480:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e7b363600/0x92b8e04cbf5f9225 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5f922c expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782216903.745486:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e7b363600/0x92b8e04cbf5f9225 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5f922c expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782216903.745498:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782216903.745515:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e7b363600/0x92b8e04cbf5f9225 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f922c expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216903.745522:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782216903.745528:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e7b363600/0x92b8e04cbf5f9225 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f922c expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216903.745535:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e7b363600/0x92b8e04cbf5f9225 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f922c expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216903.745548:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216903.745549:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216903.745552:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782216903.745561:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782216903.745609:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43605500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789713003648:0@lo:103: 00000100:00100000:1.0:1782216903.745692:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216903.745760:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17bce19a-7a0f-4c9d-b31c-4e0155298487:3648:1868789713003904:0@lo:103: 00000100:00100000:1.0:1782216903.745787:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782216903.746065:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782216903.746073:0:10336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e41680e00/0x92b8e04cbf5f928e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f9295 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216903.746080:0:10336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e41680e00 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:0.0:1782216903.746084:0:10336:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e41680e00/0x92b8e04cbf5f928e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5f9295 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216903.746092:0:10336:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e41680e00/0x92b8e04cbf5f928e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5f9295 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782216903.746099:0:10336:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e41680e00/0x92b8e04cbf5f928e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5f9295 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782216903.746105:0:10336:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782216903.746127:0:10336:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e41680e00/0x92b8e04cbf5f928e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f9295 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216903.746134:0:10336:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782216903.746143:0:10336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e41680e00/0x92b8e04cbf5f928e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f9295 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216903.746150:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e41680e00/0x92b8e04cbf5f928e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f9295 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216903.746163:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782216903.746171:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782216903.746173:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782216903.746178:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782216903.746180:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782216903.746218:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782216903.746225:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43606d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17bce19a-7a0f-4c9d-b31c-4e0155298487:3648:1868789713003776:0@lo:103: 00000100:00100000:1.0:1782216903.746262:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782216903.746562:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e413fc400/0x92b8e04cbf5f92aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f92b1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216903.746570:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782216903.746602:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e413fc400/0x92b8e04cbf5f92aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f92b1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216903.746609:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e413fc400/0x92b8e04cbf5f92aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f92b1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216903.746625:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216903.746627:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216903.746629:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782216903.746960:0:10330:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42611c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1868789713001728:192.168.203.30@tcp:104: 00000100:00100000:3.0:1782216903.746971:0:10330:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42613480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1868789713001856:192.168.203.30@tcp:104: 00010000:00010000:3.0:1782216903.747030:0:10330:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff952e7c449000/0x92b8e04cbf5f9391 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216903.749712:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17bce19a-7a0f-4c9d-b31c-4e0155298487:3650:1868789713004160:0@lo:103: 00000100:00100000:0.0:1782216903.749836:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216903.756125:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789713004032:0@lo:103: 00000100:00100000:2.0:1782216903.756682:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713003648 00000100:00100000:2.0:1782216903.756694:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713003648 00000100:00100000:2.0:1782216903.756748:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713003904 00000100:00100000:2.0:1782216903.756753:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713003904 00000100:00100000:0.0:1782216903.757982:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216903.758126:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:2.0:1782216903.758955:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952e7b363c00/0x92b8e04cbf5f922c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9225 expref: 21 pid: 6513 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216903.759010:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713003776 00000100:00100000:2.0:1782216903.759019:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713003776 00010000:00010000:2.0:1782216903.759054:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952e7b362800/0x92b8e04cbf5f9256 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f924f expref: 22 pid: 6514 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216903.759065:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713004160 00000100:00100000:2.0:1782216903.759068:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713004160 00010000:00010000:2.0:1782216903.759079:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952e7b362e00/0x92b8e04cbf5f92b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f92aa expref: 23 pid: 6514 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216903.759108:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693027200 00000100:00100000:2.0:1782216903.759111:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693027200 00010000:00010000:2.0:1782216903.759125:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952e413fd200/0x92b8e04cbf5f934b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973238 expref: 10 pid: 6511 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216903.759135:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693027072 00000100:00100000:2.0:1782216903.759138:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693027072 00010000:00010000:2.0:1782216903.759149:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952e413fd600/0x92b8e04cbf5f9352 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97323f expref: 11 pid: 6511 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216903.759162:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1782216903.759172:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43607100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:3648:x1868789713003904:12345-0@lo:103: 00010000:00010000:2.0:1782216903.759190:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782216903.759196:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952e7b363c00/0x92b8e04cbf5f922c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9225 expref: 23 pid: 6513 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216903.759208:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952e7b363c00/0x92b8e04cbf5f922c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9225 expref: 23 pid: 6513 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216903.759228:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e7b363c00/0x92b8e04cbf5f922c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5f9225 expref: 23 pid: 6513 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216903.759249:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782216903.759389:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43607100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17bce19a-7a0f-4c9d-b31c-4e0155298487+22:3648:x1868789713003904:12345-0@lo:103: Request processed in 217us (13600us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216903.759400:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1782216903.759419:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1782216903.759426:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43605f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:3648:x1868789713003776:12345-0@lo:103: 00010000:00010000:2.0:1782216903.759442:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782216903.759447:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952e7b362800/0x92b8e04cbf5f9256 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f924f expref: 21 pid: 6514 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216903.759455:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952e7b362800/0x92b8e04cbf5f9256 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5f924f expref: 21 pid: 6514 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216903.759466:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e7b362800/0x92b8e04cbf5f9256 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5f924f expref: 21 pid: 6514 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216903.759476:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782216903.759498:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43605f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17bce19a-7a0f-4c9d-b31c-4e0155298487+20:3648:x1868789713003776:12345-0@lo:103: Request processed in 73us (13236us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216903.759505:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1782216903.759517:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782216903.759523:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d410b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17bce19a-7a0f-4c9d-b31c-4e0155298487+19:3650:x1868789713004160:12345-0@lo:103: 00010000:00010000:2.0:1782216903.759530:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782216903.759534:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952e7b362e00/0x92b8e04cbf5f92b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f92aa expref: 19 pid: 6514 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216903.759543:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952e7b362e00/0x92b8e04cbf5f92b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5f92aa expref: 19 pid: 6514 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216903.759553:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e7b362e00/0x92b8e04cbf5f92b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5f92aa expref: 19 pid: 6514 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216903.759561:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782216903.759609:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d410b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17bce19a-7a0f-4c9d-b31c-4e0155298487+18:3650:x1868789713004160:12345-0@lo:103: Request processed in 87us (9775us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216903.759624:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782216903.759637:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 31 00000100:00100000:2.0:1782216903.759642:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e6f92c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+11:2403:x1868789693027200:12345-192.168.203.30@tcp:103: 00010000:00010000:2.0:1782216903.759652:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782216903.759657:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952e413fd200/0x92b8e04cbf5f934b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973238 expref: 11 pid: 6511 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216903.759666:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952e413fd200/0x92b8e04cbf5f934b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973238 expref: 11 pid: 6511 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216903.759677:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e413fd200/0x92b8e04cbf5f934b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973238 expref: 11 pid: 6511 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216903.759688:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782216903.759742:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e6f92c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+10:2403:x1868789693027200:12345-192.168.203.30@tcp:103: Request processed in 99us (1771us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216903.759749:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 31 00000100:00100000:2.0:1782216903.759761:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 32 00000100:00100000:2.0:1782216903.759767:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d410b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+9:2403:x1868789693027072:12345-192.168.203.30@tcp:103: 00010000:00010000:2.0:1782216903.759775:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782216903.759780:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952e413fd600/0x92b8e04cbf5f9352 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97323f expref: 9 pid: 6511 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216903.760970:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952e413fd600/0x92b8e04cbf5f9352 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97323f expref: 9 pid: 6511 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216903.760994:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e413fd600/0x92b8e04cbf5f9352 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97323f expref: 9 pid: 6511 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216903.761027:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782216903.761073:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d410b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+8:2403:x1868789693027072:12345-192.168.203.30@tcp:103: Request processed in 1304us (2945us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216903.761082:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 32 00000100:00100000:2.0:1782216903.761301:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17bce19a-7a0f-4c9d-b31c-4e0155298487:3650:1868789713004160:0@lo:103: 00010000:00010000:3.0:1782216903.763070:0:8449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952e7c449200/0x92b8e04cbf5f92a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f929c expref: 17 pid: 6513 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216903.763120:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1782216903.763132:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43606a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:3649:x1868789713003648:12345-0@lo:103: 00010000:00010000:3.0:1782216903.763151:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782216903.763158:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952e7c449200/0x92b8e04cbf5f92a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f929c expref: 17 pid: 6513 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216903.763170:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952e7c449200/0x92b8e04cbf5f92a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5f929c expref: 17 pid: 6513 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216903.763190:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e7c449200/0x92b8e04cbf5f92a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5f929c expref: 17 pid: 6513 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216903.763203:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782216903.763295:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43606a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:3649:x1868789713003648:12345-0@lo:103: Request processed in 166us (17603us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216903.763303:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1782216903.763884:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17bce19a-7a0f-4c9d-b31c-4e0155298487:3648:1868789713003904:0@lo:103: 00000100:00100000:0.0:1782216903.763919:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43606d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17bce19a-7a0f-4c9d-b31c-4e0155298487:3648:1868789713003776:0@lo:103: 00000100:00100000:0.0:1782216903.764717:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216903.764868:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43605500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789713003648:0@lo:103: 00000100:00100000:3.0:1782216903.764955:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713004032 00000100:00100000:3.0:1782216903.764964:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713004032 00010000:00010000:3.0:1782216903.764999:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952e7b362200/0x92b8e04cbf5f9295 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f928e expref: 16 pid: 6514 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216903.765039:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1782216903.765048:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d410b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:3649:x1868789713004032:12345-0@lo:103: 00010000:00010000:3.0:1782216903.765063:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782216903.765069:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952e7b362200/0x92b8e04cbf5f9295 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f928e expref: 16 pid: 6514 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216903.765081:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952e7b362200/0x92b8e04cbf5f9295 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5f928e expref: 16 pid: 6514 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216903.765099:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e7b362200/0x92b8e04cbf5f9295 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5f928e expref: 16 pid: 6514 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216903.765117:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff952e7c449000/0x92b8e04cbf5f9391 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216903.765127:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e7c449000/0x92b8e04cbf5f9391 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216903.765146:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff952e7c449000/0x92b8e04cbf5f9391 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216903.765154:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff952e7c449000/0x92b8e04cbf5f9391 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216903.765180:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff952e7c449000/0x92b8e04cbf5f9391 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216903.765188:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff952e7c449000/0x92b8e04cbf5f9391 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216903.765195:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7c449000 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:3.0:1782216903.765200:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff952e7c449000/0x92b8e04cbf5f9391 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216903.765208:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff952e7c449000/0x92b8e04cbf5f9391 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216903.771032:0:10330:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff952e7c449000/0x92b8e04cbf5f9391 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216903.771059:0:10330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff952e7c449000/0x92b8e04cbf5f9391 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216903.773490:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff952e7c449000/0x92b8e04cbf5f9391 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216903.773519:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e7c449000/0x92b8e04cbf5f9391 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216903.773548:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782216903.773773:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d410b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:3649:x1868789713004032:12345-0@lo:103: Request processed in 8721us (9053us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216903.773784:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782216903.776847:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789713004032:0@lo:103: 00010000:00010000:1.0:1782216904.184823:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216905.148816:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216905.148860:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216905.148898:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216905.148929:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216905.148951:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782216905.149046:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693027584 00000100:00100000:3.0:1782216905.149055:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693027584 00000100:00100000:3.0:1782216905.149114:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693027456 00000100:00100000:3.0:1782216905.149117:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693027456 00000100:00100000:3.0:1782216905.149139:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 67 00000100:00100000:3.0:1782216905.149148:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+5:2402:x1868789693027584:12345-192.168.203.30@tcp:400: 00000100:00100000:3.0:1782216905.149531:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+5:2402:x1868789693027584:12345-192.168.203.30@tcp:400: Request processed in 383us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216905.149540:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 67 00000100:00100000:3.0:1782216905.149558:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 68 00000100:00100000:3.0:1782216905.149564:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b09d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+6:2402:x1868789693027456:12345-192.168.203.30@tcp:400: 00000100:00100000:3.0:1782216905.149618:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b09d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+6:2402:x1868789693027456:12345-192.168.203.30@tcp:400: Request processed in 54us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216905.149635:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 68 00000100:00080000:2.0:1782216905.149766:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782216905.149770:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782216905.149825:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693027840 00000100:00100000:0.0:1782216905.149829:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693027840 00000100:00100000:0.0:1782216905.149873:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693027712 00000100:00100000:0.0:1782216905.149876:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693027712 00000100:00100000:0.0:1782216905.149895:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:0.0:1782216905.149901:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24a87249-c61f-41a1-85ec-9a313129e739+5:2402:x1868789693027840:12345-192.168.203.30@tcp:400: 00000100:00100000:0.0:1782216905.149927:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24a87249-c61f-41a1-85ec-9a313129e739+5:2402:x1868789693027840:12345-192.168.203.30@tcp:400: Request processed in 27us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216905.149933:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:0.0:1782216905.149943:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00100000:0.0:1782216905.149948:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b09e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24a87249-c61f-41a1-85ec-9a313129e739+5:2402:x1868789693027712:12345-192.168.203.30@tcp:400: 00000100:00100000:0.0:1782216905.149966:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b09e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24a87249-c61f-41a1-85ec-9a313129e739+5:2402:x1868789693027712:12345-192.168.203.30@tcp:400: Request processed in 18us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216905.149971:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00100000:1.0:1782216905.150274:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693027328 00000100:00100000:1.0:1782216905.150284:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693027328 00000100:00100000:1.0:1782216905.150320:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 199 00000100:00100000:1.0:1782216905.150328:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+8:2402:x1868789693027328:12345-192.168.203.30@tcp:400: 00000100:00100000:1.0:1782216905.150357:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+8:2402:x1868789693027328:12345-192.168.203.30@tcp:400: Request processed in 31us (1552us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216905.150363:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 199 00000100:00080000:2.0:1782216905.150498:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782216905.150501:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 10000000:01000000:3.0:1782216905.208825:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1782216905.208832:0:6516:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff952e7dbbd800 from 48 10000000:01000000:3.0:1782216905.208838:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782216905.208885:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7b363400/0x92b8e04cbf5f9398 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216905.208897:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e7b363400/0x92b8e04cbf5f9398 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216905.208908:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e7b363400/0x92b8e04cbf5f9398 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216905.208930:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713004288:0@lo:101: 00000100:00100000:3.0:1782216905.208994:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216905.209061:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d42661a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782216905.210116:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713004288 00000100:00100000:0.0:1782216905.210126:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713004288 00000100:00100000:0.0:1782216905.210261:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1782216905.210273:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+15:6516:x1868789713004288:12345-0@lo:101: 00010000:00010000:0.0:1782216905.210287:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782216905.210303:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e7c448200/0x92b8e04cbf5f939f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f9398 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216905.210326:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e7c448200/0x92b8e04cbf5f939f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9398 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216905.210335:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e7c448200/0x92b8e04cbf5f939f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9398 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216905.210344:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7c448200, rc 0) 00000100:00100000:0.0:1782216905.210410:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:6516:x1868789713004288:12345-0@lo:101: Request processed in 140us (1416us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216905.210416:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00010000:00010000:0.0:1782216905.210479:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782216905.210772:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713004288:0@lo:101: 00010000:00010000:3.0:1782216905.210789:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e7b363400/0x92b8e04cbf5f9398 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f939f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216905.210816:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e7b363400/0x92b8e04cbf5f9398 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f939f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216905.210880:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713004416:0@lo:501: 00000100:00100000:3.0:1782216905.210912:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216905.210944:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d42661a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782216905.211020:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713004416 00000100:00100000:0.0:1782216905.211033:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713004416 00000100:00100000:0.0:1782216905.211062:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1782216905.211069:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:6516:x1868789713004416:12345-0@lo:501: 00000100:00100000:0.0:1782216905.211182:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:6516:x1868789713004416:12345-0@lo:501: Request processed in 113us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216905.211298:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713004416:0@lo:501: 00000100:00100000:2.0:1782216905.211325:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b09c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713004544:0@lo:503: 00000100:00100000:2.0:1782216905.211363:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216905.211372:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43721000 going to sleep for 11 seconds 00000100:00100000:0.0:1782216905.211465:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1782216905.211484:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713004544 00000100:00100000:0.0:1782216905.211487:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713004544 00000100:00100000:0.0:1782216905.211500:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1782216905.211512:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52589850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:6516:x1868789713004544:12345-0@lo:503: 00000100:00100000:0.0:1782216905.211622:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52589850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:6516:x1868789713004544:12345-0@lo:503: Request processed in 109us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216905.211731:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b09c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713004544:0@lo:503: 00000100:00100000:2.0:1782216905.211904:0:10349:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b09c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10349:1868789713004672:0@lo:502: 00000100:00100000:2.0:1782216905.211942:0:10349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216905.211957:0:10349:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43721d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782216905.212001:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1782216905.212027:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713004672 00000100:00100000:0.0:1782216905.212031:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713004672 00000100:00100000:0.0:1782216905.212046:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1782216905.212052:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52588c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:10349:x1868789713004672:12345-0@lo:502: 00000100:00100000:0.0:1782216905.212135:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52588c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:10349:x1868789713004672:12345-0@lo:502: Request processed in 82us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216905.212142:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1782216905.212704:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782216905.213001:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693027968 00000100:00100000:3.0:1782216905.213008:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693027968 00000100:00100000:3.0:1782216905.213059:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 204 00000100:00100000:3.0:1782216905.213067:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52589450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+8:6173:x1868789693027968:12345-192.168.203.30@tcp:101: 00010000:00010000:3.0:1782216905.213078:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782216905.213094:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e7b362200/0x92b8e04cbf5f93a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc65e7963be9732af expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216905.213119:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e7b362200/0x92b8e04cbf5f93a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9732af expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216905.213130:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e7b362200/0x92b8e04cbf5f93a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9732af expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216905.213140:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b362200, rc 0) 00000100:00100000:3.0:1782216905.213330:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52589450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+9:6173:x1868789693027968:12345-192.168.203.30@tcp:101: Request processed in 262us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216905.213336:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 204 00000100:00100000:2.0:1782216905.213604:0:10349:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b09c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10349:1868789713004672:0@lo:502: 00000100:00100000:2.0:1782216905.213669:0:10349:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b09c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10349:1868789713004800:0@lo:502: 00000100:00100000:2.0:1782216905.213723:0:10349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216905.213748:0:10349:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43721d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782216905.213916:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713004800 00000100:00100000:3.0:1782216905.213921:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713004800 00000100:00100000:3.0:1782216905.213944:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1782216905.213958:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52589050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:10349:x1868789713004800:12345-0@lo:502: 00000100:00100000:3.0:1782216905.214073:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52589050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:10349:x1868789713004800:12345-0@lo:502: Request processed in 116us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216905.214080:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1782216905.214743:0:10349:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b09c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10349:1868789713004800:0@lo:502: 00000040:00080000:2.0:1782216905.214769:0:10349:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1782216905.215118:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1782216905.215140:0:6516:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782216905.215150:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7b363400/0x92b8e04cbf5f9398 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f939f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216905.215160:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e7b363400/0x92b8e04cbf5f9398 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f939f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782216905.215178:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1782216905.215180:0:6516:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1782216905.215183:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1782216905.215295:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7b363800/0x92b8e04cbf5f93ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216905.215303:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e7b363800/0x92b8e04cbf5f93ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216905.215311:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e7b363800/0x92b8e04cbf5f93ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216905.215325:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713004928:0@lo:101: 00000100:00100000:3.0:1782216905.215366:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216905.215402:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d426616c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782216905.215525:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713004928 00000100:00100000:0.0:1782216905.215531:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713004928 00000100:00100000:0.0:1782216905.215577:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1782216905.215616:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+16:6516:x1868789713004928:12345-0@lo:101: 00010000:00010000:0.0:1782216905.215635:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782216905.215648:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e7c448400/0x92b8e04cbf5f93b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f93ad expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216905.215669:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e7c448400/0x92b8e04cbf5f93b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f93ad expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216905.215678:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e7c448400/0x92b8e04cbf5f93b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f93ad expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216905.215687:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7c448400, rc 0) 00000100:00100000:0.0:1782216905.215735:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:6516:x1868789713004928:12345-0@lo:101: Request processed in 121us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216905.215751:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1782216905.215954:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713004928:0@lo:101: 00010000:00010000:2.0:1782216905.215967:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e7b363800/0x92b8e04cbf5f93ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f93b4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216905.215976:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e7b363800/0x92b8e04cbf5f93ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f93b4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216905.216034:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b09c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713005056:0@lo:501: 00000100:00100000:2.0:1782216905.216061:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216905.216088:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43721d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782216905.216182:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713005056 00000100:00100000:1.0:1782216905.216187:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713005056 00000100:00100000:1.0:1782216905.216224:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1782216905.216231:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:6516:x1868789713005056:12345-0@lo:501: 00000100:00100000:1.0:1782216905.216349:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:6516:x1868789713005056:12345-0@lo:501: Request processed in 118us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216905.216355:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1782216905.216459:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b09c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713005056:0@lo:501: 00000100:00100000:2.0:1782216905.216485:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b09c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713005184:0@lo:503: 00000100:00100000:2.0:1782216905.216523:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216905.216543:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43721d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782216905.216604:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713005184 00000100:00100000:3.0:1782216905.216609:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713005184 00000100:00100000:3.0:1782216905.216643:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1782216905.216648:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:6516:x1868789713005184:12345-0@lo:503: 00000100:00100000:3.0:1782216905.216734:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:6516:x1868789713005184:12345-0@lo:503: Request processed in 84us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216905.216739:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1782216905.216924:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b09c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713005184:0@lo:503: 00000100:00100000:2.0:1782216905.217237:0:10350:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b09c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10350:1868789713005312:0@lo:502: 00000100:00100000:2.0:1782216905.217278:0:10350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216905.217306:0:10350:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43721780 going to sleep for 11 seconds 00000100:00100000:3.0:1782216905.217367:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713005312 00000100:00100000:3.0:1782216905.217372:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713005312 00000100:00100000:3.0:1782216905.217438:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1782216905.217445:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52588050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:10350:x1868789713005312:12345-0@lo:502: 00000100:00100000:3.0:1782216905.217529:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52588050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:10350:x1868789713005312:12345-0@lo:502: Request processed in 83us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216905.217535:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1782216905.217617:0:10350:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b09c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10350:1868789713005312:0@lo:502: 00000020:01000000:2.0:1782216905.217638:0:10350:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782216905.217646:0:10350:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782216905.217648:0:10350:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1782216905.217653:0:10350:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1782216905.217671:0:10350:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b09c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10350:1868789713005440:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782216905.217701:0:10350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216905.227553:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216905.227645:0:10350:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43721780 going to sleep for 11 seconds 00000100:00100000:0.0:1782216905.238506:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713005440 00000100:00100000:0.0:1782216905.238521:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713005440 00000100:00100000:0.0:1782216905.238604:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1782216905.238614:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52588850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:10350:x1868789713005440:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782216905.238810:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52588850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:10350:x1868789713005440:12345-0@lo:502:llog_process_th.0 Request processed in 197us (21107us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216905.238819:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1782216905.240230:0:10350:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b09c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10350:1868789713005440:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782216905.240271:0:10350:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782216905.240280:0:10350:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782216905.240282:0:10350:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1782216905.240286:0:10350:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:3.0:1782216905.246698:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1782216905.246743:0:6516:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1782216905.246757:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7b363800/0x92b8e04cbf5f93ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f93b4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216905.246769:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e7b363800/0x92b8e04cbf5f93ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f93b4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782216905.246780:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1782216905.246783:0:6516:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff952e74b5e800 from 48 10000000:01000000:3.0:1782216905.246786:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782216905.246823:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7b362600/0x92b8e04cbf5f93bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216905.246832:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e7b362600/0x92b8e04cbf5f93bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216905.246859:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e7b362600/0x92b8e04cbf5f93bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216905.246886:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713005568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782216905.246951:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216905.246994:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d42661d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782216905.247065:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713005568 00000100:00100000:0.0:1782216905.247072:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713005568 00000100:00100000:0.0:1782216905.247119:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1782216905.247128:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+17:6516:x1868789713005568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782216905.247141:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782216905.247154:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e7c449000/0x92b8e04cbf5f93c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f93bb expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216905.247177:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e7c449000/0x92b8e04cbf5f93c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f93bb expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216905.247187:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e7c449000/0x92b8e04cbf5f93c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f93bb expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216905.247206:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7c449000, rc 0) 00000100:00100000:0.0:1782216905.247251:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+18:6516:x1868789713005568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216905.247257:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1782216905.247301:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713005568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782216905.247315:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e7b362600/0x92b8e04cbf5f93bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f93c2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216905.247323:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e7b362600/0x92b8e04cbf5f93bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f93c2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216905.247378:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713005696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782216905.247403:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216905.247417:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e52b6ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1782216905.247428:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713005696 00000100:00100000:0.0:1782216905.247431:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713005696 00000100:00100000:0.0:1782216905.247448:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1782216905.247452:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52589c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+18:6516:x1868789713005696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782216905.247551:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52589c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+18:6516:x1868789713005696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 98us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216905.247558:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1782216905.247600:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713005696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782216905.247628:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713005824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782216905.247666:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216905.247686:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e52b6ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1782216905.247697:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713005824 00000100:00100000:0.0:1782216905.247701:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713005824 00000100:00100000:0.0:1782216905.247730:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1782216905.247736:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+18:6516:x1868789713005824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782216905.247807:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+18:6516:x1868789713005824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216905.247815:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1782216905.247851:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713005824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782216905.248020:0:10351:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10351:1868789713005952:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782216905.248052:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216905.248070:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713005952 00000100:00100000:0.0:1782216905.248074:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713005952 00000100:00100000:0.0:1782216905.248089:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1782216905.248094:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+18:10351:x1868789713005952:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782216905.248161:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+18:10351:x1868789713005952:12345-0@lo:502:llog_process_th.0 Request processed in 66us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216905.248168:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1782216905.248195:0:10351:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e52b6e900 going to sleep for 11 seconds 00000100:00100000:0.0:1782216905.248207:0:10351:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10351:1868789713005952:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782216905.248240:0:10351:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10351:1868789713006080:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782216905.248271:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216905.248288:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713006080 00000100:00100000:0.0:1782216905.248291:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713006080 00000100:00100000:0.0:1782216905.248306:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1782216905.248311:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52588450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+18:10351:x1868789713006080:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782216905.248369:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52588450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+18:10351:x1868789713006080:12345-0@lo:502:llog_process_th.0 Request processed in 57us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216905.248376:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1782216905.248402:0:10351:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d427fbcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782216905.248414:0:10351:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10351:1868789713006080:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1782216905.248431:0:10351:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1782216905.248471:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1782216905.248485:0:6516:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782216905.248490:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7b362600/0x92b8e04cbf5f93bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f93c2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216905.248499:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e7b362600/0x92b8e04cbf5f93bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f93c2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782216905.248506:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1782216905.248508:0:6516:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1782216905.248511:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1782216905.248527:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7c449200/0x92b8e04cbf5f93c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216905.248535:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e7c449200/0x92b8e04cbf5f93c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216905.248543:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e7c449200/0x92b8e04cbf5f93c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216905.248555:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713006208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782216905.248579:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216905.248621:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e460e8600 going to sleep for 11 seconds 00000100:00100000:0.0:1782216905.248633:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713006208 00000100:00100000:0.0:1782216905.248637:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713006208 00000100:00100000:0.0:1782216905.248653:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1782216905.248658:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e195450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+18:6516:x1868789713006208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782216905.248665:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782216905.248674:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e7c448e00/0x92b8e04cbf5f93d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f93c9 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216905.248688:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e7c448e00/0x92b8e04cbf5f93d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f93c9 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216905.248696:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e7c448e00/0x92b8e04cbf5f93d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f93c9 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216905.248704:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7c448e00, rc 0) 00000100:00100000:0.0:1782216905.248740:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e195450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+19:6516:x1868789713006208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216905.248746:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1782216905.248773:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713006208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782216905.248784:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e7c449200/0x92b8e04cbf5f93c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f93d0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216905.248793:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e7c449200/0x92b8e04cbf5f93c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f93d0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216905.248828:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713006336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782216905.248850:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216905.248871:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e460e8600 going to sleep for 11 seconds 00000100:00100000:0.0:1782216905.248882:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713006336 00000100:00100000:0.0:1782216905.248886:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713006336 00000100:00100000:0.0:1782216905.248902:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1782216905.248908:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e195050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+19:6516:x1868789713006336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782216905.248977:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e195050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+19:6516:x1868789713006336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 68us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216905.248984:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1782216905.249010:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713006336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782216905.249031:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713006464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782216905.249061:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216905.249075:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e460e8600 going to sleep for 11 seconds 00000100:00100000:0.0:1782216905.249086:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713006464 00000100:00100000:0.0:1782216905.249090:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713006464 00000100:00100000:0.0:1782216905.249106:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1782216905.249112:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e197c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+19:6516:x1868789713006464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782216905.249176:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e197c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+19:6516:x1868789713006464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 63us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216905.249182:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1782216905.249216:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713006464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782216905.253569:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693028096 00000100:00100000:0.0:1782216905.253608:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693028096 00000100:00100000:0.0:1782216905.253658:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 219 00000100:00100000:0.0:1782216905.253668:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+9:6173:x1868789693028096:12345-192.168.203.30@tcp:501: 00000100:00100000:0.0:1782216905.253821:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+9:6173:x1868789693028096:12345-192.168.203.30@tcp:501: Request processed in 154us (26278us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216905.253842:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 219 00000100:00100000:1.0:1782216905.254262:0:10352:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43606300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10352:1868789713006592:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782216905.254321:0:10352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216905.254775:0:10352:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e5a084d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782216905.255856:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713006592 00000100:00100000:2.0:1782216905.255865:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713006592 00000100:00100000:0.0:1782216905.257088:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1782216905.257188:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e196c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+19:10352:x1868789713006592:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782216905.257354:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e196c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+19:10352:x1868789713006592:12345-0@lo:502:llog_process_th.0 Request processed in 255us (3032us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216905.257362:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1782216905.257541:0:10352:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43606300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10352:1868789713006592:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782216905.257608:0:10352:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782216905.257617:0:10352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782216905.257619:0:10352:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1782216905.257625:0:10352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1782216905.257656:0:10352:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10352:1868789713006720:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782216905.257699:0:10352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216905.257746:0:10352:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e460e8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782216905.257804:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713006720 00000100:00100000:3.0:1782216905.257810:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713006720 00000100:00100000:3.0:1782216905.257849:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1782216905.257857:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e197850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+19:10352:x1868789713006720:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782216905.257933:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e197850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+19:10352:x1868789713006720:12345-0@lo:502:llog_process_th.0 Request processed in 76us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216905.257940:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1782216905.258080:0:10352:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10352:1868789713006720:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782216905.258100:0:10352:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782216905.258104:0:10352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782216905.258106:0:10352:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1782216905.258109:0:10352:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:3.0:1782216905.258256:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1782216905.258277:0:6516:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1782216905.258287:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7c449200/0x92b8e04cbf5f93c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f93d0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216905.258297:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e7c449200/0x92b8e04cbf5f93c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f93d0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782216905.258307:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1782216905.258310:0:6516:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff952e7b38d800 from 48 10000000:01000000:3.0:1782216905.258312:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782216905.258336:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7b363000/0x92b8e04cbf5f93d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216905.258345:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e7b363000/0x92b8e04cbf5f93d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216905.258362:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e7b363000/0x92b8e04cbf5f93d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216905.258376:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713006848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782216905.258404:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216905.258433:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d42661b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782216905.258519:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713006848 00000100:00100000:0.0:1782216905.258524:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713006848 00000100:00100000:3.0:1782216905.258786:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216905.271673:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693028224 00000100:00100000:0.0:1782216905.271687:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693028224 00000100:00100000:0.0:1782216905.271769:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1782216905.271778:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e194050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+19:6516:x1868789713006848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782216905.271795:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782216905.271810:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e7c449400/0x92b8e04cbf5f93de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f93d7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216905.271836:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e7c449400/0x92b8e04cbf5f93de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f93d7 expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216905.271864:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e7c449400/0x92b8e04cbf5f93de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f93d7 expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216905.271873:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7c449400, rc 0) 00000100:00100000:0.0:1782216905.271950:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e194050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+20:6516:x1868789713006848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (13545us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216905.271957:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1782216905.271985:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 223 00000100:00100000:0.0:1782216905.271991:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e194850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+9:6173:x1868789693028224:12345-192.168.203.30@tcp:503: 00000100:00100000:0.0:1782216905.272091:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e194850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+9:6173:x1868789693028224:12345-192.168.203.30@tcp:503: Request processed in 99us (13307us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216905.272098:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 223 00000100:00100000:3.0:1782216905.272242:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713006848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782216905.272262:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e7b363000/0x92b8e04cbf5f93d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f93de expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216905.272271:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e7b363000/0x92b8e04cbf5f93d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f93de expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216905.272339:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713006976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782216905.272370:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216905.272404:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d42661b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782216905.272466:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713006976 00000100:00100000:2.0:1782216905.272471:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713006976 00000100:00100000:2.0:1782216905.272499:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1782216905.272506:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e196450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+20:6516:x1868789713006976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782216905.272757:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e196450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+20:6516:x1868789713006976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 251us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216905.272764:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1782216905.272970:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713006976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782216905.272998:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713007104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782216905.273033:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216905.273059:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d42661b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782216905.273079:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713007104 00000100:00100000:1.0:1782216905.273084:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713007104 00000100:00100000:1.0:1782216905.273117:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1782216905.273124:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e196850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+20:6516:x1868789713007104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782216905.273406:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e196850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+20:6516:x1868789713007104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 282us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216905.273421:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1782216905.275260:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713007104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782216905.275510:0:10354:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10354:1868789713007232:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782216905.275604:0:10354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216905.275646:0:10354:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d42661780 going to sleep for 11 seconds 00000100:00100000:1.0:1782216905.275652:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713007232 00000100:00100000:1.0:1782216905.275658:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713007232 00000100:00100000:1.0:1782216905.275703:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1782216905.275720:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e195c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+20:10354:x1868789713007232:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782216905.275761:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216905.275841:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e195c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+20:10354:x1868789713007232:12345-0@lo:502:llog_process_th.0 Request processed in 130us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216905.275848:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1782216905.275876:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693028352 00000100:00100000:1.0:1782216905.275880:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693028352 00000100:00100000:1.0:1782216905.275897:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 227 00000100:00100000:1.0:1782216905.275902:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e197050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+9:6654:x1868789693028352:12345-192.168.203.30@tcp:502: 00000100:00100000:1.0:1782216905.275967:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e197050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+9:6654:x1868789693028352:12345-192.168.203.30@tcp:502: Request processed in 64us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216905.275973:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 227 00000100:00100000:2.0:1782216905.279856:0:10354:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10354:1868789713007232:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782216905.279939:0:10354:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b09c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10354:1868789713007360:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782216905.280006:0:10354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216905.280040:0:10354:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43721780 going to sleep for 11 seconds 00000100:00100000:1.0:1782216905.280056:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713007360 00000100:00100000:1.0:1782216905.280063:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713007360 00000100:00100000:1.0:1782216905.280120:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1782216905.280130:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e196050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+20:10354:x1868789713007360:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782216905.280427:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e196050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+20:10354:x1868789713007360:12345-0@lo:502:llog_process_th.0 Request processed in 298us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216905.280436:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1782216905.280507:0:10354:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b09c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10354:1868789713007360:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1782216905.280527:0:10354:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1782216905.280783:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1782216905.280803:0:6516:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1782216905.280812:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7b363000/0x92b8e04cbf5f93d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f93de expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216905.280828:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e7b363000/0x92b8e04cbf5f93d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f93de expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782216905.280838:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1782216905.280840:0:6516:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:1.0:1782216905.280843:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1782216905.280866:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952d43072c00/0x92b8e04cbf5f93e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216905.280874:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952d43072c00/0x92b8e04cbf5f93e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216905.280883:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952d43072c00/0x92b8e04cbf5f93e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216905.280896:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43604e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713007488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782216905.280924:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216905.280950:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d427ae3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782216905.280988:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713007488 00000100:00100000:2.0:1782216905.280994:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713007488 00000100:00100000:2.0:1782216905.281027:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1782216905.281033:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e197450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+20:6516:x1868789713007488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782216905.281042:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782216905.281052:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e413fc800/0x92b8e04cbf5f93ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f93e5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216905.281070:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e413fc800/0x92b8e04cbf5f93ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f93e5 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216905.281079:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e413fc800/0x92b8e04cbf5f93ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f93e5 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216905.281087:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e413fc800, rc 0) 00000100:00100000:2.0:1782216905.281113:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e197450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:6516:x1868789713007488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216905.281119:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1782216905.281301:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43604e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713007488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782216905.281313:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952d43072c00/0x92b8e04cbf5f93e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f93ec expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216905.281321:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952d43072c00/0x92b8e04cbf5f93e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f93ec expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216905.281362:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43604e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713007616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782216905.281385:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216905.281412:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d427ae3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782216905.281423:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713007616 00000100:00100000:1.0:1782216905.281426:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713007616 00000100:00100000:1.0:1782216905.281442:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1782216905.281448:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e195850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:6516:x1868789713007616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782216905.281545:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e195850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:6516:x1868789713007616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216905.281552:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1782216905.281579:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43604e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713007616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782216905.281809:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43604e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713007744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782216905.281846:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216905.281874:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d427ae3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782216905.281914:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216905.281967:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713007744 00000100:00100000:2.0:1782216905.281972:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713007744 00000100:00100000:2.0:1782216905.282001:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693028480 00000100:00100000:2.0:1782216905.282004:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693028480 00000100:00100000:2.0:1782216905.282018:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1782216905.282024:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e194450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:6516:x1868789713007744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782216905.282103:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e194450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:6516:x1868789713007744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216905.282110:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1782216905.282137:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 232 00000100:00100000:2.0:1782216905.282144:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e194c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+9:6654:x1868789693028480:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782216905.282335:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43604e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713007744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782216905.282461:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e194c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+9:6654:x1868789693028480:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 316us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216905.282468:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 232 00000100:00100000:1.0:1782216905.283113:0:10355:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43604e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10355:1868789713007872:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782216905.283156:0:10355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216905.283188:0:10355:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d427ae540 going to sleep for 11 seconds 00000100:00100000:2.0:1782216905.283423:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713007872 00000100:00100000:2.0:1782216905.283430:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713007872 00000100:00100000:2.0:1782216905.283468:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1782216905.283475:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e190c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:10355:x1868789713007872:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782216905.283567:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e190c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:10355:x1868789713007872:12345-0@lo:502:llog_process_th.0 Request processed in 91us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216905.283574:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1782216905.283658:0:10355:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43604e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10355:1868789713007872:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782216905.283683:0:10355:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782216905.283692:0:10355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782216905.283695:0:10355:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1782216905.283700:0:10355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1782216905.283732:0:10355:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10355:1868789713008000:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782216905.283853:0:10355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216905.283876:0:10355:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d42661000 going to sleep for 11 seconds 00000100:00100000:0.0:1782216905.283963:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713008000 00000100:00100000:0.0:1782216905.283968:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713008000 00000100:00100000:0.0:1782216905.283998:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1782216905.284005:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:10355:x1868789713008000:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782216905.284081:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:10355:x1868789713008000:12345-0@lo:502:llog_process_th.0 Request processed in 77us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216905.284088:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1782216905.284149:0:10355:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10355:1868789713008000:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782216905.284166:0:10355:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782216905.284171:0:10355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782216905.284173:0:10355:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1782216905.284176:0:10355:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:2.0:1782216905.284270:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:2.0:1782216905.284288:0:6516:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1782216905.284297:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952d43072c00/0x92b8e04cbf5f93e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f93ec expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216905.284308:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952d43072c00/0x92b8e04cbf5f93e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f93ec expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782216905.284317:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1782216905.284320:0:6516:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff952e70905800 from 48 10000000:01000000:2.0:1782216905.284323:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782216905.284345:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e413fd200/0x92b8e04cbf5f93f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216905.284353:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e413fd200/0x92b8e04cbf5f93f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216905.284362:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e413fd200/0x92b8e04cbf5f93f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216905.284383:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b09c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713008128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782216905.284409:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216905.284430:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d437219c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782216905.284441:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713008128 00000100:00100000:1.0:1782216905.284445:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713008128 00000100:00100000:1.0:1782216905.284477:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1782216905.284483:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e191050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:6516:x1868789713008128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782216905.284491:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782216905.284501:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952d43073200/0x92b8e04cbf5f93fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f93f3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216905.284520:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952d43073200/0x92b8e04cbf5f93fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f93f3 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216905.284539:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952d43073200/0x92b8e04cbf5f93fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f93f3 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216905.284547:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43073200, rc 0) 00000100:00100000:1.0:1782216905.284619:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e191050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+22:6516:x1868789713008128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216905.284625:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1782216905.284734:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b09c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713008128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782216905.284746:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e413fd200/0x92b8e04cbf5f93f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f93fa expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216905.284754:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e413fd200/0x92b8e04cbf5f93f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f93fa expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216905.284854:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713008256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782216905.284880:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216905.284908:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d42661000 going to sleep for 11 seconds 00000100:00100000:2.0:1782216905.284939:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713008256 00000100:00100000:2.0:1782216905.284944:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713008256 00000100:00100000:2.0:1782216905.284982:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1782216905.284988:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e193c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+22:6516:x1868789713008256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782216905.285077:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e193c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+22:6516:x1868789713008256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 89us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216905.285083:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1782216905.285147:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713008256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782216905.285182:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713008384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782216905.285343:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216905.285363:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d42661000 going to sleep for 11 seconds 00000100:00100000:2.0:1782216905.285403:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713008384 00000100:00100000:2.0:1782216905.285408:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713008384 00000100:00100000:2.0:1782216905.285431:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1782216905.285437:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+22:6516:x1868789713008384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782216905.285445:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216905.285511:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+22:6516:x1868789713008384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216905.285517:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1782216905.285536:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693028608 00000100:00100000:0.0:1782216905.285541:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693028608 00000100:00100000:0.0:1782216905.285677:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 238 00000100:00100000:0.0:1782216905.285685:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+9:6173:x1868789693028608:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782216905.285694:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782216905.285706:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e7c449c00/0x92b8e04cbf5f9401 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc65e7963be9732b6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216905.285740:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e7c449c00/0x92b8e04cbf5f9401 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9732b6 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216905.285750:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e7c449c00/0x92b8e04cbf5f9401 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9732b6 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216905.285757:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7c449c00, rc 0) 00000100:00100000:0.0:1782216905.285856:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+10:6173:x1868789693028608:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 171us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216905.285863:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 238 00000100:00100000:1.0:1782216905.285943:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713008384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782216905.287429:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216905.287489:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693028736 00000100:00100000:2.0:1782216905.287504:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693028736 00000100:00100000:2.0:1782216905.287544:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 239 00000100:00100000:2.0:1782216905.287552:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+10:6173:x1868789693028736:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782216905.287815:0:10356:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43604e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10356:1868789713008512:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782216905.287866:0:10356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216905.287901:0:10356:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d427ae540 going to sleep for 11 seconds 00000100:00100000:0.0:1782216905.287967:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+10:6173:x1868789693028736:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 415us (542us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782216905.287976:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 239 00000100:00100000:0.0:1782216905.287997:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713008512 00000100:00100000:0.0:1782216905.288000:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713008512 00000100:00100000:0.0:1782216905.288018:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1782216905.288023:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e190850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+22:10356:x1868789713008512:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782216905.288122:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e190850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+22:10356:x1868789713008512:12345-0@lo:502:llog_process_th.0 Request processed in 97us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216905.288129:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1782216905.288157:0:10356:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43604e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10356:1868789713008512:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782216905.288291:0:10356:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10356:1868789713008640:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782216905.288324:0:10356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216905.288350:0:10356:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d42661300 going to sleep for 11 seconds 00000100:00100000:0.0:1782216905.288450:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713008640 00000100:00100000:0.0:1782216905.288454:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713008640 00000100:00100000:0.0:1782216905.288485:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1782216905.288491:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+22:10356:x1868789713008640:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782216905.288674:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+22:10356:x1868789713008640:12345-0@lo:502:llog_process_th.0 Request processed in 68us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216905.288688:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1782216905.288771:0:10356:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10356:1868789713008640:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1782216905.288791:0:10356:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1782216905.288928:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1782216905.288949:0:6516:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782216905.288957:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e413fd200/0x92b8e04cbf5f93f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f93fa expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216905.288968:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e413fd200/0x92b8e04cbf5f93f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f93fa expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782216905.288976:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1782216905.288979:0:6516:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:2.0:1782216905.288981:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1782216905.289004:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e413fc000/0x92b8e04cbf5f9408 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216905.289012:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e413fc000/0x92b8e04cbf5f9408 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216905.289021:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e413fc000/0x92b8e04cbf5f9408 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216905.289033:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b09c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713008768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782216905.289061:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216905.289090:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43721b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782216905.289126:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713008768 00000100:00100000:0.0:1782216905.289131:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713008768 00000100:00100000:0.0:1782216905.289160:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1782216905.289166:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+22:6516:x1868789713008768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782216905.289175:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782216905.289186:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e7c449600/0x92b8e04cbf5f940f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f9408 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216905.289205:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e7c449600/0x92b8e04cbf5f940f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9408 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216905.289214:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e7c449600/0x92b8e04cbf5f940f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9408 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216905.289221:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7c449600, rc 0) 00000100:00100000:0.0:1782216905.289256:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:6516:x1868789713008768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216905.289262:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1782216905.289315:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b09c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713008768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782216905.289327:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e413fc000/0x92b8e04cbf5f9408 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f940f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216905.289346:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e413fc000/0x92b8e04cbf5f9408 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f940f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216905.289393:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b09c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713008896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782216905.289418:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216905.289435:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43721b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782216905.289668:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713008896 00000100:00100000:0.0:1782216905.289673:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713008896 00000100:00100000:0.0:1782216905.289703:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1782216905.289718:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:6516:x1868789713008896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782216905.289850:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:6516:x1868789713008896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 140us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216905.289858:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1782216905.297959:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b09c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713008896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782216905.298309:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713009024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782216905.298384:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216905.298427:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d42661540 going to sleep for 11 seconds 00000100:00100000:0.0:1782216905.298487:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713009024 00000100:00100000:0.0:1782216905.298500:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713009024 00000100:00100000:0.0:1782216905.298550:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1782216905.298559:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:6516:x1868789713009024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782216905.298722:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:6516:x1868789713009024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 163us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216905.298730:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1782216905.298978:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713009024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782216905.299272:0:10357:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43606300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10357:1868789713009152:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782216905.299314:0:10357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216905.299337:0:10357:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d427ae6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782216905.299405:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713009152 00000100:00100000:0.0:1782216905.299410:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713009152 00000100:00100000:0.0:1782216905.299445:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1782216905.299452:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e192050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:10357:x1868789713009152:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782216905.299540:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e192050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:10357:x1868789713009152:12345-0@lo:502:llog_process_th.0 Request processed in 88us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216905.299548:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1782216905.299574:0:10357:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43606300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10357:1868789713009152:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782216905.299649:0:10357:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782216905.299657:0:10357:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782216905.299660:0:10357:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1782216905.299665:0:10357:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1782216905.299685:0:10357:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43606300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10357:1868789713009280:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782216905.299732:0:10357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216905.299753:0:10357:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d427ae6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782216905.299814:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713009280 00000100:00100000:3.0:1782216905.299819:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713009280 00000100:00100000:3.0:1782216905.299849:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1782216905.299856:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e190450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:10357:x1868789713009280:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782216905.299930:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e190450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:10357:x1868789713009280:12345-0@lo:502:llog_process_th.0 Request processed in 73us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216905.299936:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1782216905.300042:0:10357:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43606300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10357:1868789713009280:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782216905.300060:0:10357:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782216905.300065:0:10357:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782216905.300066:0:10357:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1782216905.300070:0:10357:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1782216905.300202:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:3.0:1782216905.300223:0:6516:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1782216905.300233:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e413fc000/0x92b8e04cbf5f9408 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f940f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216905.300244:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e413fc000/0x92b8e04cbf5f9408 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f940f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782216905.300254:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1782216905.300256:0:6516:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff952e5021b380 from 1 10000000:01000000:3.0:1782216905.300259:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1782216905.300284:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7b363600/0x92b8e04cbf5f9416 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216905.300293:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e7b363600/0x92b8e04cbf5f9416 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216905.300301:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e7b363600/0x92b8e04cbf5f9416 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216905.300323:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713009408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782216905.300352:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216905.300374:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d42661b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782216905.300395:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713009408 00000100:00100000:0.0:1782216905.300400:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713009408 00000100:00100000:0.0:1782216905.300430:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1782216905.300437:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e193450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:6516:x1868789713009408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782216905.300445:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782216905.300456:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e7c449e00/0x92b8e04cbf5f941d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f9416 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216905.300476:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e7c449e00/0x92b8e04cbf5f941d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9416 expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216905.300487:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e7c449e00/0x92b8e04cbf5f941d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9416 expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216905.300497:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7c449e00, rc 0) 00000100:00100000:0.0:1782216905.300542:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e193450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:6516:x1868789713009408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216905.300548:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1782216905.300618:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713009408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782216905.300630:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e7b363600/0x92b8e04cbf5f9416 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f941d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216905.300638:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e7b363600/0x92b8e04cbf5f9416 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f941d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216905.300680:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713009536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782216905.300703:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216905.300738:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d42661b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782216905.300743:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713009536 00000100:00100000:0.0:1782216905.300747:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713009536 00000100:00100000:0.0:1782216905.300770:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1782216905.300776:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e191850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:6516:x1868789713009536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782216905.300836:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e191850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:6516:x1868789713009536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 59us (131us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782216905.300842:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1782216905.300849:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713009536:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1782216905.300870:0:6516:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1782216905.300875:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7b363600/0x92b8e04cbf5f9416 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f941d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216905.300882:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e7b363600/0x92b8e04cbf5f9416 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f941d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216906.248041:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782216906.297028:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713009920:0@lo:400:kworker.0 00000100:00100000:1.0:1782216906.297118:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216906.297185:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43606300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1868789713010432:0@lo:400:kworker.0 00000100:00100000:1.0:1782216906.297231:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216906.297252:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4273ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1868789713010944:0@lo:400:kworker.0 00000100:00100000:1.0:1782216906.297274:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216906.297303:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1782216906.297310:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43607100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1868789713010048:0@lo:400:kworker.0 00000100:00100000:1.0:1782216906.297332:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216906.297349:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43604e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713010560:0@lo:400:kworker.0 00000100:00100000:1.0:1782216906.297388:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216906.297420:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4273e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713011072:0@lo:400:kworker.0 00000100:00100000:1.0:1782216906.297440:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216906.297477:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713009920 00000100:00100000:1.0:1782216906.297486:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713009920 00000100:00100000:1.0:1782216906.297541:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1782216906.297550:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713009920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216906.297640:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713009920:12345-0@lo:400:kworker.0 Request processed in 90us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216906.297647:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1782216906.297671:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713010432 00000100:00100000:1.0:1782216906.297675:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713010432 00000100:00100000:1.0:1782216906.297721:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713010944 00000100:00100000:1.0:1782216906.297734:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713010944 00000100:00100000:1.0:1782216906.297753:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713010048 00000100:00100000:1.0:1782216906.297756:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713010048 00000100:00100000:1.0:1782216906.297769:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1782216906.297775:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1868789713010432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216906.297808:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1868789713010432:12345-0@lo:400:kworker.0 Request processed in 33us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216906.297814:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1782216906.297826:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1782216906.297832:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1868789713010944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216906.297858:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1868789713010944:12345-0@lo:400:kworker.0 Request processed in 26us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216906.297863:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1782216906.297880:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1782216906.297886:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1868789713010048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216906.297912:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1868789713010048:12345-0@lo:400:kworker.0 Request processed in 27us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216906.297917:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1782216906.297944:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713010560 00000100:00100000:1.0:1782216906.297947:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713010560 00000100:00100000:1.0:1782216906.297975:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713011072 00000100:00100000:1.0:1782216906.297978:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713011072 00000100:00100000:1.0:1782216906.297996:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782216906.298003:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713010560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216906.298035:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713010560:12345-0@lo:400:kworker.0 Request processed in 33us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216906.298041:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782216906.298059:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782216906.298065:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713011072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216906.298094:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713011072:12345-0@lo:400:kworker.0 Request processed in 29us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216906.298100:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1782216906.298120:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782216906.298125:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782216906.298128:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782216906.298174:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43607100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1868789713010048:0@lo:400:kworker.0 00010000:00080000:1.0:1782216906.298189:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43604e00 x1868789713010560/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216906.298199:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43604e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713010560:0@lo:400:kworker.0 00010000:00080000:1.0:1782216906.298209:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4273e300 x1868789713011072/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216906.298218:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4273e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713011072:0@lo:400:kworker.0 00000100:00100000:1.0:1782216906.298229:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713009920:0@lo:400:kworker.0 00010000:00080000:1.0:1782216906.298238:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43606300 x1868789713010432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216906.298245:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43606300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1868789713010432:0@lo:400:kworker.0 00010000:00080000:1.0:1782216906.298253:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4273ea00 x1868789713010944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216906.298260:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4273ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1868789713010944:0@lo:400:kworker.0 00000100:00100000:0.0:1782216906.298402:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43605500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789713009664:0@lo:400:kworker.0 00000100:00100000:0.0:1782216906.298442:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216906.298475:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713010176:0@lo:400:kworker.0 00000100:00100000:2.0:1782216906.298482:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713009664 00000100:00100000:2.0:1782216906.298488:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713009664 00000100:00100000:0.0:1782216906.298505:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216906.298527:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4273df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713010688:0@lo:400:kworker.0 00000100:00100000:2.0:1782216906.298543:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1782216906.298554:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e58053450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3647:x1868789713009664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216906.298555:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216906.298575:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4273d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713011200:0@lo:400:kworker.0 00000100:00100000:0.0:1782216906.298624:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216906.298645:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1782216906.298651:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43606d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1868789713009792:0@lo:400:kworker.0 00000100:00100000:0.0:1782216906.298674:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216906.298688:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43606a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1868789713010304:0@lo:400:kworker.0 00000100:00100000:0.0:1782216906.298721:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216906.298739:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4273ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1868789713010816:0@lo:400:kworker.0 00000100:00100000:0.0:1782216906.298759:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216906.298803:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713010688 00000100:00100000:0.0:1782216906.298808:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713010688 00000100:00100000:2.0:1782216906.298825:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e58053450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3647:x1868789713009664:12345-0@lo:400:kworker.0 Request processed in 273us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216906.298833:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1782216906.298845:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713011200 00000100:00100000:0.0:1782216906.298850:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713011200 00000100:00100000:0.0:1782216906.298872:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782216906.298879:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d410b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713010688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216906.298911:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d410b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713010688:12345-0@lo:400:kworker.0 Request processed in 33us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216906.298918:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782216906.298930:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782216906.298935:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72e8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713011200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216906.298960:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72e8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713011200:12345-0@lo:400:kworker.0 Request processed in 24us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216906.298965:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782216906.298983:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713010176 00000100:00100000:0.0:1782216906.298987:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713010176 00000100:00100000:0.0:1782216906.299013:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1782216906.299020:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d410b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713010176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216906.299057:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d410b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713010176:12345-0@lo:400:kworker.0 Request processed in 36us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216906.299063:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1782216906.299084:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713009792 00000100:00100000:0.0:1782216906.299087:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713009792 00000100:00100000:0.0:1782216906.299115:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713010304 00000100:00100000:0.0:1782216906.299118:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713010304 00000100:00100000:0.0:1782216906.299131:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713010816 00000100:00100000:0.0:1782216906.299133:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713010816 00000100:00100000:0.0:1782216906.299147:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1782216906.299152:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72e8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1868789713009792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216906.299190:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72e8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1868789713009792:12345-0@lo:400:kworker.0 Request processed in 38us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216906.299197:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1782216906.299209:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1782216906.299214:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72e8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1868789713010304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216906.299239:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72e8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1868789713010304:12345-0@lo:400:kworker.0 Request processed in 25us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216906.299244:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1782216906.299254:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1782216906.299260:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72e8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1868789713010816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216906.299284:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72e8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1868789713010816:12345-0@lo:400:kworker.0 Request processed in 25us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216906.299290:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1782216906.299315:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782216906.299319:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782216906.299321:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782216906.299350:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43606d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1868789713009792:0@lo:400:kworker.0 00000100:00100000:0.0:1782216906.299361:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43606a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1868789713010304:0@lo:400:kworker.0 00000100:00100000:0.0:1782216906.299370:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4273ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1868789713010816:0@lo:400:kworker.0 00000100:00100000:0.0:1782216906.299379:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43605500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789713009664:0@lo:400:kworker.0 00000100:00100000:0.0:1782216906.299388:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713010176:0@lo:400:kworker.0 00010000:00080000:0.0:1782216906.299398:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4273df80 x1868789713010688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216906.299421:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4273df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713010688:0@lo:400:kworker.0 00010000:00080000:0.0:1782216906.299434:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4273d880 x1868789713011200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216906.299442:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4273d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713011200:0@lo:400:kworker.0 00000100:00100000:1.0:1782216906.303646:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4273ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713011328:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782216906.303762:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216906.303839:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713011328 00000100:00100000:1.0:1782216906.303849:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713011328 00000100:00100000:1.0:1782216906.303917:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782216906.303926:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713011328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782216906.303962:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782216906.304007:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713011328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216906.304014:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1782216906.304062:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4273ea00 x1868789713011328/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216922 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216906.304082:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4273ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713011328:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782216906.308784:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4273ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713011584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782216906.308879:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216906.311171:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782216906.311198:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713011456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782216906.312631:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216906.312726:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713011584 00000100:00100000:1.0:1782216906.312736:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713011584 00000100:00100000:1.0:1782216906.312790:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713011456 00000100:00100000:1.0:1782216906.312793:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713011456 00000100:00100000:1.0:1782216906.312811:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782216906.312821:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713011584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782216906.312854:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782216906.314621:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713011584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1790us (5731us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216906.314657:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782216906.314697:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1782216906.314725:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713011456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782216906.314759:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00080000:0.0:1782216906.316339:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4273ea00 x1868789713011584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216922 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216906.316376:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4273ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713011584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782216906.318573:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713011456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3855us (5936us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216906.318604:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1782216906.323299:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4268c380 x1868789713011456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216922 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216906.323336:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713011456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782216906.327115:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b09c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713011712:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782216906.332145:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216906.342032:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713011712 00000100:00100000:1.0:1782216906.342054:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713011712 00000100:00100000:1.0:1782216906.343375:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1782216906.343397:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4330ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713011712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782216906.343434:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782216906.343555:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4330ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713011712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 166us (11416us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216906.343563:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1782216906.343663:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7b09c000 x1868789713011712/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216922 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216906.343688:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b09c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713011712:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782216906.818203:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782216906.818232:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4330e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713011840:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782216906.818318:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216906.818451:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713011840 00000100:00100000:1.0:1782216906.818462:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713011840 00000100:00100000:1.0:1782216906.818521:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1782216906.818532:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4330d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713011840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782216906.818577:0:7938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1782216906.818648:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4330d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713011840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216906.818656:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1782216906.828153:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4330e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713011840:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1782216907.258633:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782216907.340049:0:10394:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdefa60c60 20000000:00000080:2.0:1782216907.340071:0:10394:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff952d42650800 uarg=0000000000000000 20000000:01000000:2.0:1782216907.340125:0:10394:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1782216907.340132:0:10394:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1782216907.340137:0:10394:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1782216907.340808:0:10395:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1782216907.340981:0:10394:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1782216907.347091:0:10394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1782216907.347130:0:10394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1782216907.347144:0:10394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1782216907.347164:0:10394:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1782216907.347187:0:10394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff952e413fd600/0x92b8e04cbf5f9424 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216907.347208:0:10394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952e7b362400/0x92b8e04cbf5f906c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9065 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216907.347217:0:10394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952e7b363e00/0x92b8e04cbf5f90c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f90b9 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216907.347225:0:10394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952e41681e00/0x92b8e04cbf5f9122 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f911b expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216907.347387:0:10394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952e7b362c00/0x92b8e04cbf5f9248 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9241 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216907.347398:0:10394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952e413fda00/0x92b8e04cbf5f9360 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973277 expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216907.347407:0:10394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff952e413fd600/0x92b8e04cbf5f9424 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216907.347471:0:10394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952e413fda00/0x92b8e04cbf5f9360 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973277 expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216907.347487:0:10394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff952e413fda00/0x92b8e04cbf5f9360 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973277 expref: 9 pid: 6511 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216907.347505:0:10394:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4330e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10394:1868789713011968:192.168.203.30@tcp:104: 00010000:00010000:2.0:1782216907.347793:0:10394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952e7b362c00/0x92b8e04cbf5f9248 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5f9241 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216907.347803:0:10394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff952e7b362c00/0x92b8e04cbf5f9248 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9241 expref: 23 pid: 6513 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216907.347813:0:10394:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4330c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10394:1868789713012096:0@lo:104: 00000100:00100000:2.0:1782216907.347877:0:10394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782216907.347915:0:10394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952e41681e00/0x92b8e04cbf5f9122 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5f911b expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216907.347924:0:10394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff952e41681e00/0x92b8e04cbf5f9122 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5f911b expref: 23 pid: 6511 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216907.347933:0:10394:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4330c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10394:1868789713012224:0@lo:104: 00000100:00100000:2.0:1782216907.347953:0:10394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782216907.347974:0:10394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952e7b363e00/0x92b8e04cbf5f90c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5f90b9 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216907.347982:0:10394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff952e7b363e00/0x92b8e04cbf5f90c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5f90b9 expref: 23 pid: 6513 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216907.348001:0:10394:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4330e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10394:1868789713012352:0@lo:104: 00010000:00010000:2.0:1782216907.348023:0:10394:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952e7b362400/0x92b8e04cbf5f906c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5f9065 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216907.348031:0:10394:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff952e7b362400/0x92b8e04cbf5f906c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9065 expref: 23 pid: 6514 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216907.348039:0:10394:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4330f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10394:1868789713012480:0@lo:104: 00000100:00100000:2.0:1782216907.348053:0:10394:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e58a3f540 going to sleep for 11 seconds 00000100:00100000:3.0:1782216907.348508:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1782216907.348529:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216907.348541:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216907.348550:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713012096 00000100:00100000:3.0:1782216907.348564:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713012096 00000100:00100000:3.0:1782216907.348644:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713012224 00000100:00100000:3.0:1782216907.348647:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713012224 00000100:00100000:3.0:1782216907.348657:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713012352 00000100:00100000:3.0:1782216907.348658:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713012352 00000100:00100000:3.0:1782216907.348667:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713012480 00000100:00100000:3.0:1782216907.348669:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713012480 00000100:00100000:3.0:1782216907.348682:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1782216907.348691:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4330f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+6:10394:x1868789713012096:12345-0@lo:104: 00010000:00010000:3.0:1782216907.348719:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff952e7b362a00/0x92b8e04cbf5f9241 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f9248 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216907.348808:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782216907.348815:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4330f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+6:10394:x1868789713012096:12345-0@lo:104: Request processed in 125us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216907.348823:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1782216907.348842:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1782216907.348848:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42730c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+5:10394:x1868789713012224:12345-0@lo:104: 00010000:00010000:3.0:1782216907.348855:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff952e413fc600/0x92b8e04cbf5f911b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f9122 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216907.348884:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1782216907.348889:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42730c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+5:10394:x1868789713012224:12345-0@lo:104: Request processed in 42us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216907.348896:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1782216907.348923:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1782216907.348928:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4268d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+4:10394:x1868789713012352:12345-0@lo:104: 00010000:00010000:3.0:1782216907.348935:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff952e413fde00/0x92b8e04cbf5f90b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f90c0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216907.348980:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1782216907.348986:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4268d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+4:10394:x1868789713012352:12345-0@lo:104: Request processed in 57us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216907.348993:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1782216907.349007:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782216907.349012:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4268e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+3:10394:x1868789713012480:12345-0@lo:104: 00010000:00010000:3.0:1782216907.349020:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff952e413fd800/0x92b8e04cbf5f9065 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f906c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216907.349049:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1782216907.349053:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4268e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+3:10394:x1868789713012480:12345-0@lo:104: Request processed in 42us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216907.349059:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:3.0:1782216907.349080:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1782216907.349087:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e7b362a00/0x92b8e04cbf5f9241 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f9248 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216907.349096:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362a00 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:3.0:1782216907.349100:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e7b362a00/0x92b8e04cbf5f9241 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5f9248 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216907.349109:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e7b362a00/0x92b8e04cbf5f9241 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5f9248 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782216907.349117:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e7b362a00/0x92b8e04cbf5f9241 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5f9248 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782216907.349123:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1782216907.349163:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e7b362a00/0x92b8e04cbf5f9241 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f9248 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216907.349170:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782216907.349192:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e7b362a00/0x92b8e04cbf5f9241 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f9248 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216907.349199:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e7b362a00/0x92b8e04cbf5f9241 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f9248 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216907.349216:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1782216907.349220:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e413fc600/0x92b8e04cbf5f911b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f9122 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216907.349227:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e413fc600 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:3.0:1782216907.349690:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e413fc600/0x92b8e04cbf5f911b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5f9122 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216907.349709:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e413fc600/0x92b8e04cbf5f911b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5f9122 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782216907.349716:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e413fc600/0x92b8e04cbf5f911b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5f9122 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782216907.349722:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1782216907.349739:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e413fc600/0x92b8e04cbf5f911b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f9122 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216907.349746:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782216907.349753:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e413fc600/0x92b8e04cbf5f911b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f9122 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216907.349771:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e413fc600/0x92b8e04cbf5f911b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f9122 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216907.349835:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782216907.349838:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e413fde00/0x92b8e04cbf5f90b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f90c0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216907.349844:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e413fde00 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:3.0:1782216907.349848:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e413fde00/0x92b8e04cbf5f90b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5f90c0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216907.349856:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e413fde00/0x92b8e04cbf5f90b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5f90c0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782216907.349863:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e413fde00/0x92b8e04cbf5f90b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5f90c0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782216907.349868:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1782216907.349882:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e413fde00/0x92b8e04cbf5f90b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f90c0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216907.349887:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1782216907.349929:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789713012864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782216907.349972:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782216907.350029:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e413fde00/0x92b8e04cbf5f90b9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f90c0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216907.350038:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e413fde00/0x92b8e04cbf5f90b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f90c0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216907.350048:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782216907.350056:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e413fd800/0x92b8e04cbf5f9065 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f906c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216907.350063:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e413fd800 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:3.0:1782216907.350066:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e413fd800/0x92b8e04cbf5f9065 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5f906c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216907.350074:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e413fd800/0x92b8e04cbf5f9065 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5f906c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782216907.350080:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e413fd800/0x92b8e04cbf5f9065 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5f906c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782216907.350085:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1782216907.350098:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e413fd800/0x92b8e04cbf5f9065 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f906c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216907.350104:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1782216907.350164:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713012864 00000100:00100000:1.0:1782216907.350171:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713012864 00010000:00010000:1.0:1782216907.350197:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952e7b363e00/0x92b8e04cbf5f90c0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f90b9 expref: 24 pid: 6513 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216907.350242:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1782216907.350250:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72e8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3647:x1868789713012864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782216907.350263:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782216907.350268:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952e7b363e00/0x92b8e04cbf5f90c0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f90b9 expref: 24 pid: 6513 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216907.350278:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952e7b363e00/0x92b8e04cbf5f90c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5f90b9 expref: 24 pid: 6513 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216907.350296:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782216907.350443:0:10394:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4330c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10394:1868789713012096:0@lo:104: 00000100:00100000:2.0:1782216907.350453:0:10394:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4330c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10394:1868789713012224:0@lo:104: 00010000:00010000:2.0:1782216907.350463:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e7b363e00/0x92b8e04cbf5f90c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5f90b9 expref: 24 pid: 6513 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216907.350474:0:10394:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4330e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10394:1868789713012352:0@lo:104: 00000100:00100000:2.0:1782216907.350482:0:10394:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4330f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10394:1868789713012480:0@lo:104: 00010000:00010000:3.0:1782216907.350532:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e413fd800/0x92b8e04cbf5f9065 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f906c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216907.350540:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e413fd800/0x92b8e04cbf5f9065 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f906c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216907.350555:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216907.350557:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216907.350559:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216907.350567:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216907.350573:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216907.350603:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782216907.350623:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789713012608:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782216907.350660:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216907.350693:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782216907.350711:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789713012736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782216907.350733:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216907.350761:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17bce19a-7a0f-4c9d-b31c-4e0155298487:3648:1868789713012992:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782216907.350795:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216907.350815:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713012608 00000100:00100000:3.0:1782216907.350819:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713012608 00010000:00010000:3.0:1782216907.350860:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952e7b362c00/0x92b8e04cbf5f9248 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9241 expref: 24 pid: 6513 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216907.350879:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713012736 00000100:00100000:3.0:1782216907.350882:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713012736 00010000:00010000:3.0:1782216907.350892:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952e41681e00/0x92b8e04cbf5f9122 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f911b expref: 25 pid: 6511 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216907.350901:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713012992 00000100:00100000:3.0:1782216907.350903:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713012992 00010000:00010000:3.0:1782216907.350911:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952e7b362400/0x92b8e04cbf5f906c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9065 expref: 26 pid: 6514 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216907.350922:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782216907.350928:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4268fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+26:3649:x1868789713012608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782216907.350936:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782216907.350941:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952e7b362c00/0x92b8e04cbf5f9248 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9241 expref: 26 pid: 6513 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216907.350950:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952e7b362c00/0x92b8e04cbf5f9248 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9241 expref: 26 pid: 6513 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216907.350972:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e7b362c00/0x92b8e04cbf5f9248 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5f9241 expref: 26 pid: 6513 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216907.350981:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782216907.351007:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4268fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+25:3649:x1868789713012608:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216907.351014:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782216907.351042:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1782216907.351047:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4268ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3649:x1868789713012736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782216907.351055:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782216907.351059:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952e41681e00/0x92b8e04cbf5f9122 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f911b expref: 24 pid: 6511 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216907.351067:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952e41681e00/0x92b8e04cbf5f9122 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5f911b expref: 24 pid: 6511 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216907.351077:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e41681e00/0x92b8e04cbf5f9122 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5f911b expref: 24 pid: 6511 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216907.351086:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782216907.351103:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4268ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:3649:x1868789713012736:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216907.351109:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1782216907.351118:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1782216907.351123:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e6f92c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+22:3648:x1868789713012992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782216907.351130:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782216907.351133:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952e7b362400/0x92b8e04cbf5f906c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9065 expref: 22 pid: 6514 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216907.351147:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952e7b362400/0x92b8e04cbf5f906c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9065 expref: 22 pid: 6514 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216907.351156:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e7b362400/0x92b8e04cbf5f906c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5f9065 expref: 22 pid: 6514 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216907.351164:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782216907.351185:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e6f92c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:3648:x1868789713012992:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216907.351190:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1782216907.351212:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17bce19a-7a0f-4c9d-b31c-4e0155298487:3648:1868789713012992:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782216907.351359:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789713012736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782216907.351367:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789713012608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782216907.351768:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72e8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17bce19a-7a0f-4c9d-b31c-4e0155298487+20:3647:x1868789713012864:12345-0@lo:103:ldlm_bl.0 Request processed in 1517us (1793us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216907.351777:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1782216907.352037:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789713012864:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782216907.354004:0:10394:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4330e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10394:1868789713011968:192.168.203.30@tcp:104: 00010000:00010000:2.0:1782216907.354049:0:10394:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff952e413fd600/0x92b8e04cbf5f9424 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216907.354876:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782216907.354946:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693028864 00000100:00100000:3.0:1782216907.354955:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693028864 00010000:00010000:3.0:1782216907.354995:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952e413fda00/0x92b8e04cbf5f9360 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973277 expref: 10 pid: 6511 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216907.355038:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 39 00000100:00100000:3.0:1782216907.355054:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+10:2402:x1868789693028864:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782216907.355112:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782216907.355119:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952e413fda00/0x92b8e04cbf5f9360 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973277 expref: 10 pid: 6511 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216907.355131:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952e413fda00/0x92b8e04cbf5f9360 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973277 expref: 10 pid: 6511 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216907.355174:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e413fda00/0x92b8e04cbf5f9360 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973277 expref: 10 pid: 6511 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216907.355194:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff952e413fd600/0x92b8e04cbf5f9424 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216907.355203:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e413fd600/0x92b8e04cbf5f9424 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216907.355220:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff952e413fd600/0x92b8e04cbf5f9424 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216907.355239:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff952e413fd600/0x92b8e04cbf5f9424 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216907.355247:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff952e413fd600/0x92b8e04cbf5f9424 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216907.355255:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff952e413fd600/0x92b8e04cbf5f9424 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216907.355261:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e413fd600 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:3.0:1782216907.355266:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff952e413fd600/0x92b8e04cbf5f9424 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216907.355274:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff952e413fd600/0x92b8e04cbf5f9424 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216907.355294:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff952e413fd600/0x92b8e04cbf5f9424 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216907.355314:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782216907.355388:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+9:2402:x1868789693028864:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 341us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216907.355396:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 39 00010000:00010000:1.0:1782216907.355994:0:10394:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff952e413fd600/0x92b8e04cbf5f9424 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216907.356014:0:10394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff952e413fd600/0x92b8e04cbf5f9424 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216907.356021:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e413fd600/0x92b8e04cbf5f9424 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216907.833244:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782216907.833269:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713013120:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782216907.833345:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216907.833452:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713013120 00000100:00100000:2.0:1782216907.833462:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713013120 00000100:00100000:2.0:1782216907.833575:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1782216907.833634:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713013120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782216907.833678:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1782216907.833754:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713013120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 169us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216907.833791:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1782216907.833863:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713013120:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1782216908.282531:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782216908.536787:0:6516:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1782216908.536801:0:6516:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff952e7dbbd800 from 4 10000000:01000000:0.0:1782216908.536807:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782216908.536858:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7c448000/0x92b8e04cbf5f942b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216908.536886:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e7c448000/0x92b8e04cbf5f942b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216908.536897:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e7c448000/0x92b8e04cbf5f942b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216908.536924:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e72e8ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713013248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782216908.536995:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216908.537065:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43759480 going to sleep for 11 seconds 00000100:00100000:3.0:1782216908.537117:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713013248 00000100:00100000:3.0:1782216908.537135:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713013248 00000100:00100000:3.0:1782216908.537208:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1782216908.537220:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e43998c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+20:6516:x1868789713013248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782216908.537241:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782216908.537262:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e7b362400/0x92b8e04cbf5f9432 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f942b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216908.537294:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e7b362400/0x92b8e04cbf5f9432 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f942b expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216908.537307:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e7b362400/0x92b8e04cbf5f9432 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f942b expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216908.537318:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b362400, rc 0) 00000100:00100000:3.0:1782216908.537465:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e43998c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:6516:x1868789713013248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 247us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216908.537474:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1782216908.537574:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e72e8ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713013248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782216908.537641:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e7c448000/0x92b8e04cbf5f942b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f9432 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216908.537651:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e7c448000/0x92b8e04cbf5f942b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f9432 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216908.537750:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4273fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713013376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782216908.537982:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216908.538018:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d427ae540 going to sleep for 11 seconds 00000100:00100000:0.0:1782216908.538221:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713013376 00000100:00100000:0.0:1782216908.538230:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713013376 00000100:00100000:0.0:1782216908.538284:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1782216908.538292:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4399b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:6516:x1868789713013376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782216908.538717:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4399b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:6516:x1868789713013376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 424us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216908.538726:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1782216908.539478:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4273fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713013376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782216908.539535:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4330e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713013504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782216908.539624:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216908.539644:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e42c59f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782216908.540013:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713013504 00000100:00100000:3.0:1782216908.540022:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713013504 00000100:00100000:3.0:1782216908.540080:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1782216908.540101:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e43999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:6516:x1868789713013504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782216908.540238:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e43999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:6516:x1868789713013504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216908.540247:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1782216908.540329:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4330e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713013504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782216908.541968:0:10424:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4330f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10424:1868789713013632:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782216908.542052:0:10424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216908.542095:0:10424:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e42c59300 going to sleep for 11 seconds 00000100:00100000:0.0:1782216908.542238:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713013632 00000100:00100000:0.0:1782216908.542249:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713013632 00000100:00100000:0.0:1782216908.542304:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1782216908.542313:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e43999c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:10424:x1868789713013632:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782216908.542528:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e43999c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:10424:x1868789713013632:12345-0@lo:502:llog_process_th.0 Request processed in 215us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216908.543865:0:10424:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4330f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10424:1868789713013632:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782216908.543909:0:10424:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782216908.543921:0:10424:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782216908.543924:0:10424:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1782216908.543931:0:10424:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff952e7dbbd800 00000020:00000080:1.0:1782216908.543934:0:10424:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1782216908.544030:0:10424:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4273f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10424:1868789713013760:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782216908.544090:0:10424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216908.544125:0:10424:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d427aecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782216908.544910:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1782216908.544973:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713013760 00000100:00100000:0.0:1782216908.544997:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713013760 00000100:00100000:0.0:1782216908.545104:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1782216908.545118:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e582c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:10424:x1868789713013760:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782216908.545247:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e582c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:10424:x1868789713013760:12345-0@lo:502:llog_process_th.0 Request processed in 133us (1155us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216908.545256:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1782216908.545315:0:10424:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4273f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10424:1868789713013760:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782216908.545346:0:10424:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782216908.545353:0:10424:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782216908.545355:0:10424:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1782216908.545359:0:10424:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1782216908.547147:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1782216908.547192:0:6516:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782216908.547208:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7c448000/0x92b8e04cbf5f942b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f9432 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216908.547224:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e7c448000/0x92b8e04cbf5f942b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f9432 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782216908.547236:0:6516:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782216908.547239:0:6516:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff952e74b5e800 from 4 10000000:01000000:2.0:1782216908.547242:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782216908.547295:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e413fda00/0x92b8e04cbf5f9439 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216908.547305:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e413fda00/0x92b8e04cbf5f9439 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216908.547318:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e413fda00/0x92b8e04cbf5f9439 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216908.547378:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4330e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713013888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782216908.547451:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216908.547497:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e42c59300 going to sleep for 11 seconds 00000100:00100000:1.0:1782216908.548491:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713013888 00000100:00100000:1.0:1782216908.548503:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713013888 00000100:00100000:1.0:1782216908.548557:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1782216908.548566:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e582c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:6516:x1868789713013888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782216908.548609:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782216908.548626:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952d43073800/0x92b8e04cbf5f9440 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f9439 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216908.548657:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952d43073800/0x92b8e04cbf5f9440 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9439 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216908.548677:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952d43073800/0x92b8e04cbf5f9440 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9439 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216908.548872:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43073800, rc 0) 00000100:00100000:1.0:1782216908.548943:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e582c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+22:6516:x1868789713013888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 378us (1492us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216908.548951:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1782216908.549644:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4330e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713013888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782216908.549677:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e413fda00/0x92b8e04cbf5f9439 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f9440 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216908.549700:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e413fda00/0x92b8e04cbf5f9439 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f9440 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216908.549785:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713014016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782216908.549841:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216908.549877:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d42661780 going to sleep for 11 seconds 00000100:00100000:3.0:1782216908.549897:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713014016 00000100:00100000:3.0:1782216908.549902:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713014016 00000100:00100000:3.0:1782216908.549941:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1782216908.549950:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+22:6516:x1868789713014016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782216908.550076:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+22:6516:x1868789713014016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216908.550085:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1782216908.550128:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713014016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782216908.550156:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713014144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782216908.550203:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216908.550221:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d42661780 going to sleep for 11 seconds 00000100:00100000:3.0:1782216908.550257:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713014144 00000100:00100000:3.0:1782216908.550261:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713014144 00000100:00100000:3.0:1782216908.550293:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1782216908.550303:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+22:6516:x1868789713014144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782216908.550369:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+22:6516:x1868789713014144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216908.550376:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1782216908.550410:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713014144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782216908.551194:0:10426:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4273ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10426:1868789713014272:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782216908.551237:0:10426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216908.551263:0:10426:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d427ff780 going to sleep for 11 seconds 00000100:00100000:3.0:1782216908.551648:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713014272 00000100:00100000:3.0:1782216908.551655:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713014272 00000100:00100000:3.0:1782216908.551700:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1782216908.551708:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+22:10426:x1868789713014272:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782216908.551791:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+22:10426:x1868789713014272:12345-0@lo:502:llog_process_th.0 Request processed in 83us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216908.551798:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1782216908.551841:0:10426:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4273ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10426:1868789713014272:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782216908.551864:0:10426:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782216908.551872:0:10426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782216908.551875:0:10426:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1782216908.551884:0:10426:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff952e74b5e800 00000020:00000080:3.0:1782216908.551886:0:10426:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1782216908.552426:0:10426:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10426:1868789713014400:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782216908.552470:0:10426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216908.552500:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713014400 00000100:00100000:3.0:1782216908.552504:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713014400 00000100:00100000:3.0:1782216908.552533:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1782216908.552539:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+22:10426:x1868789713014400:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782216908.552637:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+22:10426:x1868789713014400:12345-0@lo:502:llog_process_th.0 Request processed in 98us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216908.552644:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1782216908.552681:0:10426:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d426616c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782216908.552703:0:10426:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10426:1868789713014400:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782216908.552721:0:10426:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782216908.552725:0:10426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782216908.552727:0:10426:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1782216908.552732:0:10426:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1782216908.552798:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1782216908.552822:0:6516:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782216908.552831:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e413fda00/0x92b8e04cbf5f9439 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f9440 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216908.552841:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e413fda00/0x92b8e04cbf5f9439 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f9440 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782216908.552852:0:6516:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782216908.552856:0:6516:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff952e7b38d800 from 4 10000000:01000000:3.0:1782216908.552858:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782216908.552882:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7b362c00/0x92b8e04cbf5f9447 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216908.552891:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e7b362c00/0x92b8e04cbf5f9447 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216908.552901:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e7b362c00/0x92b8e04cbf5f9447 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216908.552916:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713014528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782216908.552960:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216908.552981:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d426616c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782216908.552997:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713014528 00000100:00100000:3.0:1782216908.553003:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713014528 00000100:00100000:3.0:1782216908.553032:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1782216908.553039:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+22:6516:x1868789713014528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782216908.553048:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782216908.553062:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e7b362a00/0x92b8e04cbf5f944e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f9447 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216908.553084:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e7b362a00/0x92b8e04cbf5f944e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9447 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216908.553094:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e7b362a00/0x92b8e04cbf5f944e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9447 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216908.553102:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b362a00, rc 0) 00000100:00100000:3.0:1782216908.553137:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:6516:x1868789713014528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216908.553143:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1782216908.553180:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713014528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782216908.553193:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e7b362c00/0x92b8e04cbf5f9447 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f944e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216908.553202:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e7b362c00/0x92b8e04cbf5f9447 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f944e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216908.553243:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713014656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782216908.553279:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216908.553292:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d426616c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782216908.553305:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713014656 00000100:00100000:3.0:1782216908.553308:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713014656 00000100:00100000:3.0:1782216908.553337:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1782216908.553345:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:6516:x1868789713014656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782216908.553430:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:6516:x1868789713014656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 88us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216908.553437:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1782216908.553467:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713014656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782216908.553497:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713014784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782216908.553529:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216908.553542:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d426616c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782216908.553555:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713014784 00000100:00100000:3.0:1782216908.553558:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713014784 00000100:00100000:3.0:1782216908.553669:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1782216908.553676:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:6516:x1868789713014784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782216908.553755:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:6516:x1868789713014784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216908.553762:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1782216908.553794:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713014784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782216908.571278:0:10429:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e72e8ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10429:1868789713014912:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782216908.573534:0:10429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216908.574245:0:10429:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43759e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782216908.574572:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713014912 00000100:00100000:2.0:1782216908.574840:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713014912 00000100:00100000:2.0:1782216908.574930:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1782216908.574942:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:10429:x1868789713014912:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782216908.575114:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:10429:x1868789713014912:12345-0@lo:502:llog_process_th.0 Request processed in 175us (1587us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216908.575123:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1782216908.575818:0:10429:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e72e8ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10429:1868789713014912:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782216908.575876:0:10429:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782216908.575887:0:10429:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782216908.575890:0:10429:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1782216908.575896:0:10429:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff952e7b38d800 00000020:00000080:1.0:1782216908.575899:0:10429:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1782216908.576008:0:10429:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4273ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10429:1868789713015040:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782216908.576299:0:10429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216908.576336:0:10429:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d427fff00 going to sleep for 11 seconds 00000100:00100000:0.0:1782216908.576975:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713015040 00000100:00100000:0.0:1782216908.576988:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713015040 00000100:00100000:0.0:1782216908.577053:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1782216908.577064:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:10429:x1868789713015040:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782216908.577215:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:10429:x1868789713015040:12345-0@lo:502:llog_process_th.0 Request processed in 152us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216908.577223:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1782216908.577270:0:10429:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4273ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10429:1868789713015040:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782216908.577319:0:10429:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782216908.577328:0:10429:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782216908.577330:0:10429:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1782216908.577335:0:10429:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1782216908.577519:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1782216908.577976:0:6516:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782216908.577996:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7b362c00/0x92b8e04cbf5f9447 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f944e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216908.578007:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e7b362c00/0x92b8e04cbf5f9447 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f944e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782216908.578027:0:6516:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1782216908.578031:0:6516:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff952e70905800 from 4 10000000:01000000:0.0:1782216908.578034:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782216908.579830:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7c449a00/0x92b8e04cbf5f9455 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216908.579847:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e7c449a00/0x92b8e04cbf5f9455 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216908.579859:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e7c449a00/0x92b8e04cbf5f9455 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216908.579883:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e72e8ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713015168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782216908.579946:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216908.579996:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43759a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782216908.580019:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713015168 00000100:00100000:0.0:1782216908.580025:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713015168 00000100:00100000:0.0:1782216908.580076:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1782216908.580085:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:6516:x1868789713015168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782216908.580098:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782216908.580110:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e7c448c00/0x92b8e04cbf5f945c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f9455 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216908.580133:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e7c448c00/0x92b8e04cbf5f945c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9455 expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216908.580146:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e7c448c00/0x92b8e04cbf5f945c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9455 expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216908.580166:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7c448c00, rc 0) 00000100:00100000:0.0:1782216908.580207:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:6516:x1868789713015168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216908.580214:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1782216908.580264:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e72e8ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713015168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782216908.580278:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e7c449a00/0x92b8e04cbf5f9455 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f945c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216908.580287:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e7c449a00/0x92b8e04cbf5f9455 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f945c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216908.580352:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e72e8ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713015296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782216908.580379:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216908.580403:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43759a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782216908.580432:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713015296 00000100:00100000:2.0:1782216908.580444:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713015296 00000100:00100000:2.0:1782216908.580496:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1782216908.580505:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52589850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:6516:x1868789713015296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782216908.580968:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52589850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:6516:x1868789713015296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 463us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216908.580976:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1782216908.581489:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e72e8ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713015296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782216908.581549:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e72e8ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713015424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782216908.581901:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216908.591521:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43759a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782216908.591566:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713015424 00000100:00100000:0.0:1782216908.591579:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713015424 00000100:00100000:0.0:1782216908.592178:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1782216908.592193:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52588c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:6516:x1868789713015424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782216908.592391:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52588c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:6516:x1868789713015424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 201us (10489us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216908.592443:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e72e8ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713015424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782216908.592539:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1782216908.599213:0:10431:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4330c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10431:1868789713015552:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782216908.599320:0:10431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216908.599376:0:10431:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e42c44240 going to sleep for 11 seconds 00000100:00100000:3.0:1782216908.599438:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713015552 00000100:00100000:3.0:1782216908.599447:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713015552 00000100:00100000:3.0:1782216908.599509:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1782216908.599519:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52589450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:10431:x1868789713015552:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782216908.599969:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52589450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:10431:x1868789713015552:12345-0@lo:502:llog_process_th.0 Request processed in 449us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216908.599978:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1782216908.600046:0:10431:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4330c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10431:1868789713015552:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782216908.600080:0:10431:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782216908.600092:0:10431:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782216908.600094:0:10431:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1782216908.600106:0:10431:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff952e70905800 00000020:00000080:3.0:1782216908.600109:0:10431:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1782216908.602379:0:10431:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10431:1868789713015680:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782216908.602470:0:10431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216908.602515:0:10431:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d426613c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782216908.602630:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713015680 00000100:00100000:2.0:1782216908.602639:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713015680 00000100:00100000:2.0:1782216908.602716:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1782216908.602726:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52589050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:10431:x1868789713015680:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782216908.602869:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52589050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:10431:x1868789713015680:12345-0@lo:502:llog_process_th.0 Request processed in 144us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216908.602883:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1782216908.603190:0:10431:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:10431:1868789713015680:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782216908.603223:0:10431:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782216908.603232:0:10431:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782216908.603234:0:10431:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1782216908.603244:0:10431:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1782216908.604549:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1782216908.604607:0:6516:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782216908.604622:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7c449a00/0x92b8e04cbf5f9455 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f945c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216908.604637:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e7c449a00/0x92b8e04cbf5f9455 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f945c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216909.119157:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216909.121859:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693028992 00000100:00100000:0.0:1782216909.121879:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693028992 00000100:00100000:0.0:1782216909.121947:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 270 00000100:00100000:0.0:1782216909.121957:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+9:6173:x1868789693028992:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782216909.121980:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782216909.122001:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e7c448a00/0x92b8e04cbf5f9463 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc65e7963be9732bd expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216909.122036:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e7c448a00/0x92b8e04cbf5f9463 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9732bd expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216909.122047:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e7c448a00/0x92b8e04cbf5f9463 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9732bd expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216909.122058:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7c448a00, rc 0) 00000100:00100000:0.0:1782216909.122128:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+10:6173:x1868789693028992:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 173us (2985us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216909.122135:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 270 00000100:00100000:0.0:1782216909.127131:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216909.127180:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693029120 00000100:00100000:0.0:1782216909.127191:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693029120 00000100:00100000:0.0:1782216909.127261:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 271 00000100:00100000:0.0:1782216909.127283:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+10:6173:x1868789693029120:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782216909.127477:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+10:6173:x1868789693029120:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 196us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216909.127497:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 271 00000100:00100000:3.0:1782216909.132434:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216909.132636:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693029248 00000100:00100000:2.0:1782216909.132649:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693029248 00000100:00100000:2.0:1782216909.132722:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 272 00000100:00100000:2.0:1782216909.132737:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+10:6173:x1868789693029248:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782216909.132906:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+10:6173:x1868789693029248:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 Request processed in 173us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216909.138411:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 272 00000100:00100000:2.0:1782216909.160757:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216909.161094:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693029376 00000100:00100000:1.0:1782216909.161109:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693029376 00000100:00100000:1.0:1782216909.161172:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 273 00000100:00100000:1.0:1782216909.161184:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52588050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+10:6718:x1868789693029376:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782216909.161399:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52588050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+10:6718:x1868789693029376:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 218us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216909.161408:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 273 00000100:00100000:0.0:1782216909.167499:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216909.167555:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693029504 00000100:00100000:1.0:1782216909.167568:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693029504 00000100:00100000:1.0:1782216909.167654:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 274 00000100:00100000:1.0:1782216909.167666:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52588850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+10:6718:x1868789693029504:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782216909.167849:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52588850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+10:6718:x1868789693029504:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 184us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216909.167859:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 274 00010000:00010000:3.0:1782216909.305910:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782216910.275546:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216910.275633:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693029632 00000100:00100000:1.0:1782216910.275647:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693029632 00000100:00100000:1.0:1782216910.275737:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 275 00000100:00100000:1.0:1782216910.275749:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+10:2404:x1868789693029632:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1782216910.275843:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+10:2404:x1868789693029632:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 96us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216910.275851:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 275 00000100:00100000:3.0:1782216910.278062:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782216910.278110:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782216910.278147:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782216910.278181:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782216910.278237:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693030144 00000100:00100000:3.0:1782216910.278247:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693030144 00000100:00100000:1.0:1782216910.278278:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693030016 00000100:00100000:1.0:1782216910.278284:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693030016 00000100:00100000:2.0:1782216910.278534:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693029888 00000100:00100000:2.0:1782216910.278541:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693029888 00000100:00100000:0.0:1782216910.280006:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693029760 00000100:00100000:0.0:1782216910.280019:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693029760 00000100:00100000:3.0:1782216910.280160:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 25 00000100:00100000:3.0:1782216910.280195:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4268c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:24a87249-c61f-41a1-85ec-9a313129e739+5:2404:x1868789693030144:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1782216910.280293:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4268c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:24a87249-c61f-41a1-85ec-9a313129e739+5:2404:x1868789693030144:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 101us (2181us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216910.280301:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 25 00000100:00100000:1.0:1782216910.282501:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 26 00000100:00100000:1.0:1782216910.282531:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4268ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24a87249-c61f-41a1-85ec-9a313129e739+5:2404:x1868789693030016:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1782216910.282642:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4268ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24a87249-c61f-41a1-85ec-9a313129e739+5:2404:x1868789693030016:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 127us (4460us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216910.282651:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 26 00000100:00080000:3.0:1782216910.292958:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782216910.293740:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782216910.293747:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782216910.293780:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 75 00000100:00100000:0.0:1782216910.293798:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4268d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+6:2404:x1868789693029760:12345-192.168.203.30@tcp:400:kworker.0 00000100:00080000:3.0:1782216910.293809:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782216910.293908:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4268d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+6:2404:x1868789693029760:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 115us (15758us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216910.293927:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 75 00000100:00100000:2.0:1782216910.298069:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 76 00000100:00100000:2.0:1782216910.298090:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4268dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+5:2404:x1868789693029888:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1782216910.298204:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4268dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+5:2404:x1868789693029888:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 121us (20154us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216910.298213:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 76 00010000:00010000:3.0:1782216910.331034:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216911.357651:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216911.426225:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4330c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713015808:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782216911.426254:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4273f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713016064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782216911.429223:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216911.429236:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4273fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713016192:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782216911.429292:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216911.429302:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4273ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713015936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782216911.429333:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216911.429361:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713015808 00000100:00100000:1.0:1782216911.429371:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713015808 00000100:00100000:1.0:1782216911.429432:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713016192 00000100:00100000:1.0:1782216911.429435:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713016192 00000100:00100000:1.0:1782216911.429449:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713015936 00000100:00100000:1.0:1782216911.429452:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713015936 00000100:00100000:1.0:1782216911.429470:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1782216911.429479:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4330ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713015808:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782216911.429494:0:8437:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1782216911.429505:0:8437:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:1.0:1782216911.429520:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782216911.429606:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4330ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713015808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216911.429615:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1782216911.429637:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1782216911.429645:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713016192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782216911.429675:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782216911.429711:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713016192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216911.429717:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1782216911.429729:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1782216911.429735:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4330dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713015936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782216911.429752:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782216911.429778:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4330dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713015936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216911.429784:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1782216911.429803:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782216911.429808:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782216911.429841:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4330c380 x1868789713015808/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216927 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216911.429865:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4330c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713015808:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1782216911.429878:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4273ce00 x1868789713015936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216927 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216911.429891:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4273ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713015936:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1782216911.429928:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4273fb80 x1868789713016192/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216927 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216911.429940:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4273fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713016192:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782216911.429957:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216911.430004:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713016064 00000100:00100000:2.0:1782216911.430010:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713016064 00000100:00080000:1.0:1782216911.430041:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782216911.430053:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1782216911.430062:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713016064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782216911.430074:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782216911.430111:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713016064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216911.430809:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789713016320:0@lo:400:kworker.0 00000100:00100000:0.0:1782216911.430867:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216911.435012:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782216911.435115:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713016576:0@lo:400:kworker.0 00000100:00100000:1.0:1782216911.435216:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216911.435263:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1868789713017088:0@lo:400:kworker.0 00000100:00100000:2.0:1782216911.435269:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713016576 00000100:00100000:2.0:1782216911.435279:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713016576 00000100:00100000:1.0:1782216911.435296:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216911.435335:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1782216911.435346:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713016576:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1782216911.435349:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4273f100 x1868789713016064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216927 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216911.435376:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4273f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713016064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782216911.435418:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713016576:12345-0@lo:400:kworker.0 Request processed in 73us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216911.435427:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1782216911.435432:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713016576:0@lo:400:kworker.0 00000100:00100000:1.0:1782216911.435448:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1782216911.435456:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1868789713016704:0@lo:400:kworker.0 00000100:00100000:1.0:1782216911.435481:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216911.435516:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1868789713017216:0@lo:400:kworker.0 00000100:00100000:1.0:1782216911.435539:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216911.435568:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713016320 00000100:00100000:1.0:1782216911.435573:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713016320 00000100:00100000:1.0:1782216911.435643:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1782216911.435650:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52589c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3649:x1868789713016320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216911.435696:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52589c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3649:x1868789713016320:12345-0@lo:400:kworker.0 Request processed in 47us (4828us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216911.435703:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1782216911.435739:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713017088 00000100:00100000:1.0:1782216911.435743:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713017088 00000100:00100000:1.0:1782216911.435780:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713016704 00000100:00100000:1.0:1782216911.435783:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713016704 00000100:00100000:1.0:1782216911.435793:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713017216 00000100:00100000:1.0:1782216911.435795:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713017216 00000100:00100000:1.0:1782216911.435809:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1782216911.435815:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1868789713017088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216911.435851:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1868789713017088:12345-0@lo:400:kworker.0 Request processed in 35us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216911.435858:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1782216911.435870:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1782216911.435875:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1868789713016704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216911.435916:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1868789713016704:12345-0@lo:400:kworker.0 Request processed in 40us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216911.435923:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1782216911.435935:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1782216911.435941:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1868789713017216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216911.435967:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1868789713017216:12345-0@lo:400:kworker.0 Request processed in 26us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216911.435973:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1782216911.436000:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782216911.436004:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782216911.436028:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1868789713016704:0@lo:400:kworker.0 00000100:00100000:1.0:1782216911.436039:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1868789713017216:0@lo:400:kworker.0 00010000:00080000:1.0:1782216911.436050:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4268fb80 x1868789713017088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216911.436061:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1868789713017088:0@lo:400:kworker.0 00000100:00100000:0.0:1782216911.436439:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1868789713016448:0@lo:400:kworker.0 00000100:00100000:0.0:1782216911.436479:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216911.437993:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1868789713016960:0@lo:400:kworker.0 00000100:00100000:0.0:1782216911.438068:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216911.438108:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1782216911.438115:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713016832:0@lo:400:kworker.0 00000100:00100000:0.0:1782216911.438144:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216911.438168:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1868789713017344:0@lo:400:kworker.0 00000100:00100000:0.0:1782216911.438187:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216911.438253:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789713016320:0@lo:400:kworker.0 00000100:00100000:0.0:1782216911.438291:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713016832 00000100:00100000:0.0:1782216911.438298:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713016832 00000100:00100000:0.0:1782216911.438351:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1782216911.438377:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b09c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713016832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216911.438439:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b09c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713016832:12345-0@lo:400:kworker.0 Request processed in 63us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216911.438446:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1782216911.438472:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713016448 00000100:00100000:0.0:1782216911.438476:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713016448 00000100:00100000:0.0:1782216911.438495:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713016960 00000100:00100000:0.0:1782216911.438497:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713016960 00000100:00100000:0.0:1782216911.438523:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713017344 00000100:00100000:0.0:1782216911.438525:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713017344 00000100:00100000:0.0:1782216911.438542:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1782216911.438547:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72e8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1868789713016448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216911.438718:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1782216911.438729:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1868789713016960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216911.438766:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1868789713016960:12345-0@lo:400:kworker.0 Request processed in 40us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216911.438772:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1782216911.438787:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1782216911.438793:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1868789713017344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216911.438830:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1868789713017344:12345-0@lo:400:kworker.0 Request processed in 38us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216911.438837:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1782216911.440424:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72e8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1868789713016448:12345-0@lo:400:kworker.0 Request processed in 33us (2101us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216911.440448:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1782216911.440534:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713016832:0@lo:400:kworker.0 00010000:00080000:0.0:1782216911.440554:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4268c380 x1868789713017344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216911.440566:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1868789713017344:0@lo:400:kworker.0 00000100:00100000:0.0:1782216911.441012:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1868789713016448:0@lo:400:kworker.0 00000100:00100000:0.0:1782216911.442615:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1868789713016960:0@lo:400:kworker.0 00000100:00080000:1.0:1782216911.442695:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782216911.442704:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782216911.929701:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4273ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713017472:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782216911.929814:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216911.929914:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713017472 00000100:00100000:1.0:1782216911.929925:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713017472 00000100:00100000:1.0:1782216911.929983:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1782216911.929992:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d410b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713017472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782216911.930038:0:7938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1782216911.930095:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d410b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713017472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216911.930111:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1782216911.930176:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4273ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713017472:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1782216912.379515:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782216912.958725:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713017600:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782216912.958963:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216912.959338:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713017600 00000100:00100000:0.0:1782216912.959348:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713017600 00000100:00100000:0.0:1782216912.959446:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1782216912.959456:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d410b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713017600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782216912.959682:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1782216912.959944:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d410b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713017600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 488us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216912.959954:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1782216912.960824:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713017600:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1782216913.400896:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782216914.329547:0:10695:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1782216914.430027:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216915.390399:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216915.390445:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216915.390470:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216915.390493:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216915.390517:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216915.390544:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693030528 00000100:00100000:2.0:1782216915.390553:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693030528 00000100:00100000:2.0:1782216915.390632:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693030400 00000100:00100000:2.0:1782216915.390636:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693030400 00000100:00100000:2.0:1782216915.390676:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 83 00000100:00100000:2.0:1782216915.390691:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4330c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+5:2405:x1868789693030528:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1782216915.390777:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4330c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+5:2405:x1868789693030528:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 87us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216915.390786:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 83 00000100:00100000:2.0:1782216915.390802:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 84 00000100:00100000:2.0:1782216915.390809:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4330d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+6:2405:x1868789693030400:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1782216915.390893:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4330d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+6:2405:x1868789693030400:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 83us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216915.390900:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 84 00000100:00100000:2.0:1782216915.390930:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693030784 00000100:00100000:2.0:1782216915.390933:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693030784 00000100:00100000:2.0:1782216915.390962:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693030656 00000100:00100000:2.0:1782216915.390982:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693030656 00000100:00100000:2.0:1782216915.391009:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 27 00000100:00100000:2.0:1782216915.391016:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4330d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:24a87249-c61f-41a1-85ec-9a313129e739+5:2405:x1868789693030784:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1782216915.391043:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4330d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:24a87249-c61f-41a1-85ec-9a313129e739+5:2405:x1868789693030784:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 28us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216915.391050:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 27 00000100:00100000:2.0:1782216915.391061:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 28 00000100:00100000:2.0:1782216915.391067:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4330fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:24a87249-c61f-41a1-85ec-9a313129e739+5:2405:x1868789693030656:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1782216915.391091:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4330fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:24a87249-c61f-41a1-85ec-9a313129e739+5:2405:x1868789693030656:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 24us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216915.391097:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 28 00000100:00080000:2.0:1782216915.391117:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782216915.391121:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782216915.391124:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782216915.391126:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782216915.391314:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693030272 00000100:00100000:3.0:1782216915.391319:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693030272 00000100:00100000:3.0:1782216915.391351:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 277 00000100:00100000:3.0:1782216915.391409:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+10:2405:x1868789693030272:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1782216915.391445:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+10:2405:x1868789693030272:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 87us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216915.391452:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 277 00010000:00010000:1.0:1782216915.448823:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216916.475062:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782216916.542035:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713017728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782216916.542103:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216916.542173:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4273ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713017856:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782216916.542198:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216916.542224:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782216916.542230:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713017984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782216916.542263:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216916.542294:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713017728 00000100:00100000:1.0:1782216916.542301:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713017728 00000100:00100000:1.0:1782216916.542344:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713017856 00000100:00100000:1.0:1782216916.542347:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713017856 00000100:00100000:1.0:1782216916.542365:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713017984 00000100:00100000:1.0:1782216916.542368:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713017984 00000100:00100000:1.0:1782216916.542385:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782216916.542393:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43605500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713017728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782216916.542422:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782216916.542466:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43605500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713017728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216916.542473:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782216916.542489:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1782216916.542495:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43606a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713017856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782216916.542514:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782216916.542545:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43606a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713017856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216916.542551:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1782216916.542564:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1782216916.542571:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43606d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713017984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782216916.542611:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782216916.542649:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43606d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713017984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216916.542655:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1782216916.542675:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782216916.542679:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1782216916.542806:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43605f80 x1868789713017984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216932 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216916.542824:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713017984:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1782216916.542837:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4273ed80 x1868789713017856/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216932 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216916.542847:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4273ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713017856:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1782216916.542875:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d410b1880 x1868789713017728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216932 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216916.542884:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713017728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782216916.545101:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782216916.545119:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4330f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713018112:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782216916.545171:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216916.545224:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713018112 00000100:00100000:1.0:1782216916.545231:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713018112 00000100:00100000:1.0:1782216916.545289:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1782216916.545298:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43605f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713018112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782216916.545317:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782216916.545354:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43605f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713018112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216916.545362:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1782216916.545384:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782216916.545406:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4330f100 x1868789713018112/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216932 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216916.545424:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4330f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713018112:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782216916.546952:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4330f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1868789713018624:0@lo:400:kworker.0 00000100:00100000:2.0:1782216916.546996:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216916.547026:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4330f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1868789713019136:0@lo:400:kworker.0 00000100:00100000:2.0:1782216916.547065:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216916.547092:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1782216916.547099:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4330ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789713018240:0@lo:400:kworker.0 00000100:00100000:2.0:1782216916.547126:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216916.547148:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4330c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713018752:0@lo:400:kworker.0 00000100:00100000:2.0:1782216916.547170:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216916.547187:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4330e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1868789713019264:0@lo:400:kworker.0 00000100:00100000:2.0:1782216916.547223:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216916.547262:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713018624 00000100:00100000:2.0:1782216916.547268:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713018624 00000100:00100000:2.0:1782216916.547298:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713019136 00000100:00100000:2.0:1782216916.547301:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713019136 00000100:00100000:2.0:1782216916.547321:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713019264 00000100:00100000:2.0:1782216916.547324:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713019264 00000100:00100000:2.0:1782216916.547340:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1782216916.547347:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4330f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1868789713018624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216916.547387:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4330f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1868789713018624:12345-0@lo:400:kworker.0 Request processed in 40us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216916.547394:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1782216916.547408:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1782216916.547413:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43313100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1868789713019136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216916.547440:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43313100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1868789713019136:12345-0@lo:400:kworker.0 Request processed in 27us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216916.547446:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1782216916.547458:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1782216916.547464:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43311f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1868789713019264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216916.547490:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43311f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1868789713019264:12345-0@lo:400:kworker.0 Request processed in 27us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216916.547496:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1782216916.547517:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713018240 00000100:00100000:2.0:1782216916.547521:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713018240 00000100:00100000:0.0:1782216916.547848:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713018752 00000100:00100000:0.0:1782216916.547853:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713018752 00000100:00100000:0.0:1782216916.547884:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1782216916.547891:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43310e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713018752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216916.547927:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43310e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713018752:12345-0@lo:400:kworker.0 Request processed in 36us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216916.547933:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1782216916.547955:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4330ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713018496:0@lo:400:kworker.0 00000100:00100000:0.0:1782216916.547981:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216916.547999:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4330e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1868789713019008:0@lo:400:kworker.0 00000100:00100000:0.0:1782216916.548019:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216916.548038:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1782216916.548043:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4330df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1868789713018368:0@lo:400:kworker.0 00000100:00100000:0.0:1782216916.548065:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216916.548082:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4330c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1868789713018880:0@lo:400:kworker.0 00000100:00100000:0.0:1782216916.548112:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216916.548140:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713018496 00000100:00100000:0.0:1782216916.548144:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713018496 00000100:00100000:0.0:1782216916.548167:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1782216916.548173:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713018496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216916.548206:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713018496:12345-0@lo:400:kworker.0 Request processed in 33us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216916.548220:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1782216916.548237:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713019008 00000100:00100000:0.0:1782216916.548240:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713019008 00000100:00100000:0.0:1782216916.548259:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713018368 00000100:00100000:0.0:1782216916.548261:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713018368 00000100:00100000:0.0:1782216916.548272:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713018880 00000100:00100000:0.0:1782216916.548274:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713018880 00000100:00100000:0.0:1782216916.548288:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1782216916.548294:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1868789713019008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216916.548324:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1868789713019008:12345-0@lo:400:kworker.0 Request processed in 30us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216916.548330:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1782216916.548341:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1782216916.548347:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1868789713018368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216916.548372:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1868789713018368:12345-0@lo:400:kworker.0 Request processed in 25us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216916.548377:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1782216916.548389:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1782216916.548395:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1868789713018880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216916.548420:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1868789713018880:12345-0@lo:400:kworker.0 Request processed in 25us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216916.548426:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1782216916.548464:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4330df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1868789713018368:0@lo:400:kworker.0 00000100:00100000:0.0:1782216916.548475:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4330c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1868789713018880:0@lo:400:kworker.0 00000100:00100000:0.0:1782216916.548483:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4330ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713018496:0@lo:400:kworker.0 00010000:00080000:0.0:1782216916.548505:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4330e680 x1868789713019008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216916.548515:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4330e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1868789713019008:0@lo:400:kworker.0 00000100:00100000:2.0:1782216916.551171:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1782216916.551191:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3647:x1868789713018240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216916.551265:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3647:x1868789713018240:12345-0@lo:400:kworker.0 Request processed in 82us (4137us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216916.551286:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1782216916.551345:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4330ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789713018240:0@lo:400:kworker.0 00000100:00100000:2.0:1782216916.551360:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4330c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713018752:0@lo:400:kworker.0 00010000:00080000:2.0:1782216916.551373:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4330e300 x1868789713019264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216916.551384:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4330e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1868789713019264:0@lo:400:kworker.0 00000100:00100000:2.0:1782216916.551395:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4330f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1868789713018624:0@lo:400:kworker.0 00000100:00100000:2.0:1782216916.551406:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4330f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1868789713019136:0@lo:400:kworker.0 00000100:00080000:2.0:1782216916.551442:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782216916.551447:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782216917.060792:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43312d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713019392:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782216917.060871:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216917.061789:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713019392 00000100:00100000:2.0:1782216917.061800:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713019392 00000100:00100000:2.0:1782216917.061852:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1782216917.061861:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713019392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782216917.061896:0:7938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1782216917.061950:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713019392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (1079us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216917.061957:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1782216917.062894:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43312d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713019392:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1782216917.506853:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782216918.074403:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713019520:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782216918.074471:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216918.074541:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713019520 00000100:00100000:0.0:1782216918.074548:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713019520 00000100:00100000:0.0:1782216918.074611:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1782216918.074629:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713019520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782216918.074665:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1782216918.074803:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713019520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 184us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216918.074810:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1782216918.074857:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713019520:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1782216918.534088:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216919.551021:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782216919.903046:0:10939:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing yml_node 00000100:00100000:2.0:1782216920.520436:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216920.520473:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216920.520502:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216920.520528:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693031168 00000100:00100000:2.0:1782216920.520537:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693031168 00000100:00100000:2.0:1782216920.520612:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693031040 00000100:00100000:2.0:1782216920.520621:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693031040 00000100:00100000:2.0:1782216920.520647:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 91 00000100:00100000:2.0:1782216920.520656:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43312a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+5:2404:x1868789693031168:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1782216920.520718:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43312a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+5:2404:x1868789693031168:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 63us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216920.520724:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 91 00000100:00100000:2.0:1782216920.520739:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 92 00000100:00100000:2.0:1782216920.520745:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43312300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+6:2404:x1868789693031040:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1782216920.520769:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43312300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+6:2404:x1868789693031040:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 24us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216920.520774:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 92 00000100:00080000:2.0:1782216920.520789:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782216920.520793:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782216920.520937:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693030912 00000100:00100000:3.0:1782216920.520941:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693030912 00000100:00100000:3.0:1782216920.520976:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 279 00000100:00100000:3.0:1782216920.520982:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52588450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+10:2404:x1868789693030912:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1782216920.521011:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52588450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+10:2404:x1868789693030912:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 30us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216920.521022:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 279 00000100:00100000:1.0:1782216920.527449:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216920.527480:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216920.527508:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693031296 00000100:00100000:1.0:1782216920.527517:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693031296 00000100:00100000:1.0:1782216920.527564:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693031424 00000100:00100000:1.0:1782216920.527566:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693031424 00000100:00100000:1.0:1782216920.527611:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 18 00000100:00100000:1.0:1782216920.527620:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24a87249-c61f-41a1-85ec-9a313129e739+5:2401:x1868789693031296:12345-192.168.203.30@tcp:9:kworker.0 00000020:00000080:1.0:1782216920.527654:0:8432:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f9375 00000100:00080000:1.0:1782216920.527662:0:8432:0:(import.c:65:import_set_state_nolock()) ffff952e7c6c8000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782216920.527715:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1782216920.527849:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24a87249-c61f-41a1-85ec-9a313129e739+2:2401:x1868789693031296:12345-192.168.203.30@tcp:9:kworker.0 Request processed in 230us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216920.527857:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 18 00000100:00100000:1.0:1782216920.527872:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:1.0:1782216920.527878:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43604e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24a87249-c61f-41a1-85ec-9a313129e739+5:2401:x1868789693031424:12345-192.168.203.30@tcp:9:kworker.0 00000020:00000080:1.0:1782216920.527889:0:8432:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f937c 00000100:00080000:1.0:1782216920.527895:0:8432:0:(import.c:65:import_set_state_nolock()) ffff952d436dc000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782216920.527913:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1782216920.527972:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43604e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24a87249-c61f-41a1-85ec-9a313129e739+2:2401:x1868789693031424:12345-192.168.203.30@tcp:9:kworker.0 Request processed in 94us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216920.527979:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00080000:1.0:1782216920.528039:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782216920.528043:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782216920.529313:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216920.529322:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216920.574194:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216921.593653:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216921.657932:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43313480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713019904:0@lo:400:kworker.0 00000100:00100000:2.0:1782216921.658014:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216921.658065:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43310a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1868789713020416:0@lo:400:kworker.0 00000100:00100000:2.0:1782216921.658088:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216921.658104:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43311500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1868789713020928:0@lo:400:kworker.0 00000100:00100000:2.0:1782216921.658121:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216921.658141:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1782216921.658147:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43310700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1868789713020032:0@lo:400:kworker.0 00000100:00100000:2.0:1782216921.658164:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216921.658182:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43311c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713020544:0@lo:400:kworker.0 00000100:00100000:2.0:1782216921.658202:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216921.658242:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43313b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713021056:0@lo:400:kworker.0 00000100:00100000:2.0:1782216921.658263:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216921.658296:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713019904 00000100:00100000:2.0:1782216921.658303:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713019904 00000100:00100000:2.0:1782216921.658345:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1782216921.658353:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c672a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713019904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216921.658403:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c672a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713019904:12345-0@lo:400:kworker.0 Request processed in 50us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216921.658411:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1782216921.658435:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713020416 00000100:00100000:2.0:1782216921.658438:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713020416 00000100:00100000:2.0:1782216921.658464:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713020928 00000100:00100000:2.0:1782216921.658467:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713020928 00000100:00100000:2.0:1782216921.658479:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713020032 00000100:00100000:2.0:1782216921.658481:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713020032 00000100:00100000:2.0:1782216921.658493:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1782216921.658498:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c672300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1868789713020416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216921.658527:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c672300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1868789713020416:12345-0@lo:400:kworker.0 Request processed in 29us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216921.658534:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1782216921.658545:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1782216921.658550:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c671880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1868789713020928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216921.658576:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c671880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1868789713020928:12345-0@lo:400:kworker.0 Request processed in 25us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216921.658618:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1782216921.658630:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1782216921.658635:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c670380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1868789713020032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216921.658682:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c670380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1868789713020032:12345-0@lo:400:kworker.0 Request processed in 35us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216921.658687:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1782216921.658730:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43310700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1868789713020032:0@lo:400:kworker.0 00000100:00100000:2.0:1782216921.658740:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43313480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713019904:0@lo:400:kworker.0 00010000:00080000:2.0:1782216921.658749:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43310a80 x1868789713020416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216921.658758:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43310a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1868789713020416:0@lo:400:kworker.0 00010000:00080000:2.0:1782216921.658767:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43311500 x1868789713020928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216921.658775:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43311500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1868789713020928:0@lo:400:kworker.0 00000100:00100000:1.0:1782216921.659003:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43310380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1868789713019776:0@lo:400:kworker.0 00000100:00100000:1.0:1782216921.659033:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216921.659052:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43313800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1868789713020288:0@lo:400:kworker.0 00000100:00100000:1.0:1782216921.659072:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216921.659087:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43311180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1868789713020800:0@lo:400:kworker.0 00000100:00100000:1.0:1782216921.659105:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216921.659133:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1782216921.659139:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43311880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17bce19a-7a0f-4c9d-b31c-4e0155298487:3648:1868789713019648:0@lo:400:kworker.0 00000100:00100000:1.0:1782216921.659165:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216921.659183:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43312680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713020160:0@lo:400:kworker.0 00000100:00100000:1.0:1782216921.659237:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216921.659258:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43310000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713020672:0@lo:400:kworker.0 00000100:00100000:1.0:1782216921.659279:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216921.659292:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43312d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713021184:0@lo:400:kworker.0 00000100:00100000:1.0:1782216921.659312:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216921.659333:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713020544 00000100:00100000:1.0:1782216921.659338:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713020544 00000100:00100000:1.0:1782216921.659360:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713021056 00000100:00100000:1.0:1782216921.659362:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713021056 00000100:00100000:1.0:1782216921.659373:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713020672 00000100:00100000:1.0:1782216921.659375:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713020672 00000100:00100000:1.0:1782216921.659386:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713021184 00000100:00100000:1.0:1782216921.659387:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713021184 00000100:00100000:1.0:1782216921.659400:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1782216921.659404:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c673480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713020544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216921.659440:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c673480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713020544:12345-0@lo:400:kworker.0 Request processed in 35us (1237us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216921.659446:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1782216921.659458:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1782216921.659464:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c670700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713021056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216921.659489:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c670700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713021056:12345-0@lo:400:kworker.0 Request processed in 26us (1225us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216921.659494:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1782216921.659504:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1782216921.659509:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b301f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713020672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216921.659538:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b301f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713020672:12345-0@lo:400:kworker.0 Request processed in 29us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216921.659553:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1782216921.659565:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1782216921.659570:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e74f8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713021184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216921.659684:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e74f8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713021184:12345-0@lo:400:kworker.0 Request processed in 112us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216921.659690:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1782216921.659812:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782216921.659815:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782216921.659817:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782216921.659827:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713019776 00000100:00100000:1.0:1782216921.659831:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713019776 00000100:00100000:1.0:1782216921.659846:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713020288 00000100:00100000:1.0:1782216921.659848:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713020288 00000100:00100000:1.0:1782216921.659864:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713020800 00000100:00100000:1.0:1782216921.659866:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713020800 00000100:00100000:1.0:1782216921.659877:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1782216921.659881:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1868789713019776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216921.659908:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1868789713019776:12345-0@lo:400:kworker.0 Request processed in 27us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216921.659914:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1782216921.659924:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1782216921.659930:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d410b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1868789713020288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216921.659953:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d410b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1868789713020288:12345-0@lo:400:kworker.0 Request processed in 24us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216921.659958:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1782216921.659969:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1782216921.659974:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1868789713020800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216921.660008:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1868789713020800:12345-0@lo:400:kworker.0 Request processed in 33us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216921.660014:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:1.0:1782216921.660080:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782216921.660092:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b301f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713021312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782216921.660115:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1782216921.660141:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43310000 x1868789713020672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216921.660151:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43310000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713020672:0@lo:400:kworker.0 00010000:00080000:1.0:1782216921.660160:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43312d80 x1868789713021184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216921.660167:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43312d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713021184:0@lo:400:kworker.0 00000100:00100000:1.0:1782216921.660176:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43310380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1868789713019776:0@lo:400:kworker.0 00000100:00100000:1.0:1782216921.660185:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43313800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1868789713020288:0@lo:400:kworker.0 00000100:00100000:1.0:1782216921.660193:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43311180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1868789713020800:0@lo:400:kworker.0 00000100:00100000:1.0:1782216921.660223:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713021440:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782216921.660244:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1782216921.660267:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43311c00 x1868789713020544/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216921.660276:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43311c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713020544:0@lo:400:kworker.0 00010000:00080000:1.0:1782216921.660286:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43313b80 x1868789713021056/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216921.660305:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43313b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713021056:0@lo:400:kworker.0 00000100:00100000:1.0:1782216921.660318:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782216921.660323:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713021568:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782216921.660343:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216921.660367:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713021312 00000100:00100000:1.0:1782216921.660371:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713021312 00000100:00100000:1.0:1782216921.660389:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713021440 00000100:00100000:1.0:1782216921.660391:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713021440 00000100:00100000:1.0:1782216921.660399:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713021568 00000100:00100000:1.0:1782216921.660401:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713021568 00000100:00100000:1.0:1782216921.660411:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1782216921.660417:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b302300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713021312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782216921.660437:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782216921.660469:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b302300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713021312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216921.660476:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1782216921.660486:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1782216921.660492:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b301880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713021440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782216921.660501:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782216921.660527:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b301880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713021440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 35us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216921.660532:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1782216921.660542:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1782216921.660547:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b300380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713021568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782216921.660561:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782216921.660641:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b300380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713021568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216921.660647:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1782216921.660674:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7b301f80 x1868789713021312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216937 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216921.660686:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b301f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713021312:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1782216921.660709:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7b302a00 x1868789713021568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216937 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216921.660719:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713021568:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1782216921.660727:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7b302d80 x1868789713021440/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216937 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216921.660736:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713021440:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782216921.660770:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713020160 00000100:00100000:1.0:1782216921.660773:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713020160 00000100:00100000:1.0:1782216921.660795:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1782216921.660801:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b300e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713020160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216921.660833:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b300e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713020160:12345-0@lo:400:kworker.0 Request processed in 33us (1597us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216921.660839:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1782216921.660861:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43312680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713020160:0@lo:400:kworker.0 00000100:00100000:2.0:1782216921.663851:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713019648 00000100:00100000:2.0:1782216921.663860:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713019648 00000100:00100000:2.0:1782216921.663908:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1782216921.663917:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e195450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3648:x1868789713019648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216921.663991:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e195450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3648:x1868789713019648:12345-0@lo:400:kworker.0 Request processed in 74us (4824us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216921.663998:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1782216921.664112:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c672680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713021696:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782216921.664150:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216921.664926:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713021696 00000100:00100000:2.0:1782216921.664934:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713021696 00000100:00100000:2.0:1782216921.664981:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1782216921.664989:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4268f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713021696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782216921.665008:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782216921.665050:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4268f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713021696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216921.665068:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1782216921.665171:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43311880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17bce19a-7a0f-4c9d-b31c-4e0155298487:3648:1868789713019648:0@lo:400:kworker.0 00010000:00080000:3.0:1782216921.665416:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7c672680 x1868789713021696/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216937 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216921.665430:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c672680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713021696:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782216922.168951:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782216922.168972:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c673800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713021824:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782216922.169049:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216922.169213:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713021824 00000100:00100000:2.0:1782216922.169220:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713021824 00000100:00100000:2.0:1782216922.169275:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1782216922.169284:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4268c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713021824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782216922.169316:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1782216922.169368:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4268c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713021824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216922.169374:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1782216922.169712:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c673800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713021824:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1782216922.617194:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216923.193577:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782216923.193630:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713021952:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782216923.193701:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216923.194007:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713021952 00000100:00100000:3.0:1782216923.194015:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713021952 00000100:00100000:3.0:1782216923.194067:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1782216923.194076:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c670a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713021952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782216923.194115:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1782216923.194171:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c670a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713021952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216923.194179:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1782216923.194305:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713021952:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1782216923.640804:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216924.672443:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782216925.305395:0:11122:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.83 00000100:00100000:2.0:1782216925.632857:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216925.635520:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693031680 00000100:00100000:0.0:1782216925.635542:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693031680 00000100:00100000:0.0:1782216925.635741:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 99 00000100:00100000:0.0:1782216925.635755:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c671c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+6:2404:x1868789693031680:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782216925.635864:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c671c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+6:2404:x1868789693031680:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 112us (3020us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216925.635881:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 99 00000100:00080000:1.0:1782216925.636133:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782216925.645942:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216925.649322:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693031552 00000100:00100000:2.0:1782216925.649340:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693031552 00000100:00100000:2.0:1782216925.649484:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 281 00000100:00100000:2.0:1782216925.649497:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e195050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+10:2404:x1868789693031552:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1782216925.651128:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e195050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+10:2404:x1868789693031552:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 1566us (5131us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216925.651145:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 281 00000100:00100000:0.0:1782216925.651470:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216925.651901:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693031808 00000100:00100000:2.0:1782216925.651913:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693031808 00000100:00100000:2.0:1782216925.651991:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 100 00000100:00100000:2.0:1782216925.652001:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+5:2404:x1868789693031808:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1782216925.652094:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+5:2404:x1868789693031808:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 93us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216925.652114:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 100 00000100:00080000:0.0:1782216925.653035:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1782216925.691764:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1782216925.765380:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 24a87249-c61f-41a1-85ec-9a313129e739 00000020:00000080:2.0:1782216925.765389:0:9512:0:(genops.c:906:class_export_put()) final put ffff952d436da000/24a87249-c61f-41a1-85ec-9a313129e739 00000020:00000080:1.0:1782216925.765652:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff952d436da000/24a87249-c61f-41a1-85ec-9a313129e739 for lustre-OST0001 00000020:00000080:1.0:1782216925.765691:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff952d436dc000 for lustre-OST0001 00000001:00100000:0.0:1782216925.766121:0:8428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 24a87249-c61f-41a1-85ec-9a313129e739 00000020:00000080:0.0:1782216925.766127:0:8428:0:(genops.c:906:class_export_put()) final put ffff952d42299000/24a87249-c61f-41a1-85ec-9a313129e739 00000020:00000080:1.0:1782216925.766198:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952d42299000/24a87249-c61f-41a1-85ec-9a313129e739 for lustre-OST0000 00000020:00000080:1.0:1782216925.766320:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff952e7c6c8000 for lustre-OST0000 00010000:00010000:1.0:1782216926.717420:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782216926.776842:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c670000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713022080:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782216926.776903:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216926.776982:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713022080 00000100:00100000:0.0:1782216926.776990:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713022080 00000100:00100000:0.0:1782216926.777178:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1782216926.777188:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43696d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713022080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782216926.777219:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782216926.777269:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43696d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713022080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216926.777287:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1782216926.777313:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713022336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782216926.777357:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216926.777384:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b302680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713022848:0@lo:400:kworker.0 00000100:00100000:0.0:1782216926.777410:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216926.777438:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b300000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1868789713023360:0@lo:400:kworker.0 00000100:00100000:0.0:1782216926.777462:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216926.777478:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b303100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713023872:0@lo:400:kworker.0 00000100:00100000:0.0:1782216926.777496:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216926.777511:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1782216926.777515:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713022208:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782216926.777540:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216926.777548:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b300700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1868789713022720:0@lo:400:kworker.0 00000100:00100000:0.0:1782216926.777575:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216926.777785:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b301c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1868789713023232:0@lo:400:kworker.0 00000100:00100000:0.0:1782216926.777809:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216926.777837:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1868789713023744:0@lo:400:kworker.0 00000100:00100000:0.0:1782216926.777857:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216926.777886:0:10535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713022336 00000100:00100000:0.0:1782216926.777890:0:10535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713022336 00000100:00100000:1.0:1782216926.777944:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713023872 00000100:00100000:1.0:1782216926.777949:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713023872 00000100:00080000:2.0:1782216926.777987:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782216926.777987:0:10535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713022208 00000100:00100000:0.0:1782216926.777991:0:10535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713022208 00000100:00080000:2.0:1782216926.777992:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782216926.778011:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1782216926.778016:0:10535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1782216926.778023:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43694380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3648:x1868789713023872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216926.778028:0:10535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43696a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713022336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782216926.778044:0:10535:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782216926.778087:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43694380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3648:x1868789713023872:12345-0@lo:400:kworker.0 Request processed in 66us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216926.778089:0:10535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43696a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713022336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216926.778102:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1782216926.778105:0:10535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1782216926.778124:0:10535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1782216926.778131:0:10535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43697480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713022208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782216926.778150:0:10535:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782216926.778154:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713023360 00000100:00100000:1.0:1782216926.778159:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713023360 00000100:00100000:0.0:1782216926.778180:0:10535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43697480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713022208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216926.778187:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713022720 00000100:00100000:0.0:1782216926.778188:0:10535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1782216926.778191:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713022720 00000100:00100000:1.0:1782216926.778209:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713023232 00000100:00100000:1.0:1782216926.778212:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713023232 00000100:00100000:0.0:1782216926.778213:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713023744 00000100:00100000:0.0:1782216926.778218:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713023744 00000100:00100000:1.0:1782216926.778231:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1782216926.778240:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43695880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1868789713023360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216926.778246:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1782216926.778263:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1868789713022720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216926.778277:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43695880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1868789713023360:12345-0@lo:400:kworker.0 Request processed in 37us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216926.778284:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1782216926.778301:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1782216926.778306:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1868789713022720:12345-0@lo:400:kworker.0 Request processed in 44us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216926.778311:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1868789713023232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216926.778317:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1782216926.778334:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1782216926.778342:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43697800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1868789713023744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216926.778349:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1868789713023232:12345-0@lo:400:kworker.0 Request processed in 39us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216926.778357:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1782216926.778379:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713022848 00000100:00100000:1.0:1782216926.778383:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713022848 00000100:00100000:0.0:1782216926.778384:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43697800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1868789713023744:12345-0@lo:400:kworker.0 Request processed in 41us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216926.778392:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1782216926.778424:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1782216926.778432:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43696300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713022848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216926.778468:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43696300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713022848:12345-0@lo:400:kworker.0 Request processed in 37us (1057us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216926.778473:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1782216926.778502:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b303480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17bce19a-7a0f-4c9d-b31c-4e0155298487:3650:1868789713022592:0@lo:400:kworker.0 00000100:00100000:1.0:1782216926.778530:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216926.778573:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b300a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713023104:0@lo:400:kworker.0 00000100:00100000:0.0:1782216926.778600:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713022592 00000100:00100000:0.0:1782216926.778605:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713022592 00000100:00100000:1.0:1782216926.778627:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216926.778638:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1782216926.778658:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b301500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1868789713023616:0@lo:400:kworker.0 00000100:00100000:1.0:1782216926.778679:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216926.778706:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e197c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3650:x1868789713022592:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1782216926.778711:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7c670000 x1868789713022080/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216942 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216926.778736:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c670000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713022080:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782216926.778743:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e197c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3650:x1868789713022592:12345-0@lo:400:kworker.0 Request processed in 40us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216926.778750:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1782216926.778768:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b303480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17bce19a-7a0f-4c9d-b31c-4e0155298487:3650:1868789713022592:0@lo:400:kworker.0 00000100:00100000:1.0:1782216926.778779:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1782216926.778787:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b301f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713022464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782216926.778813:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216926.778836:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b303800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1868789713022976:0@lo:400:kworker.0 00000100:00100000:3.0:1782216926.778851:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713022464 00000100:00100000:3.0:1782216926.778857:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713022464 00000100:00100000:1.0:1782216926.778858:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216926.778880:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b301180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713023488:0@lo:400:kworker.0 00000100:00100000:3.0:1782216926.778889:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1782216926.778907:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713022464:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782216926.778908:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1782216926.778923:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782216926.778932:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713024000:0@lo:400:kworker.0 00000100:00100000:3.0:1782216926.778957:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713022464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216926.778963:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1782216926.778972:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216926.778990:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713023104 00000100:00100000:3.0:1782216926.778994:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713023104 00010000:00080000:1.0:1782216926.779005:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7b301f80 x1868789713022464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216942 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216926.779018:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b301f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713022464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782216926.779025:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1782216926.779034:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713023104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216926.779049:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713023616 00000100:00100000:1.0:1782216926.779054:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713023616 00000100:00100000:3.0:1782216926.779074:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713023104:12345-0@lo:400:kworker.0 Request processed in 42us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216926.779081:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1782216926.779085:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713022976 00000100:00100000:0.0:1782216926.779088:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b300a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713023104:0@lo:400:kworker.0 00000100:00100000:1.0:1782216926.779090:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713022976 00000100:00100000:3.0:1782216926.779101:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713023488 00000100:00100000:3.0:1782216926.779105:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713023488 00000100:00100000:1.0:1782216926.779117:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1782216926.779126:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1868789713023616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216926.779132:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713024000 00000100:00100000:3.0:1782216926.779137:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713024000 00000100:00100000:3.0:1782216926.779163:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782216926.779163:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1868789713023616:12345-0@lo:400:kworker.0 Request processed in 37us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216926.779175:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713023488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216926.779176:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1782216926.779193:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1782216926.779201:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b303480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1868789713022976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216926.779217:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713023488:12345-0@lo:400:kworker.0 Request processed in 44us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216926.779224:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782216926.779239:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b303480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1868789713022976:12345-0@lo:400:kworker.0 Request processed in 37us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216926.779243:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1782216926.779250:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1782216926.779256:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713024000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216926.779289:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713024000:12345-0@lo:400:kworker.0 Request processed in 37us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216926.779295:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1782216926.779510:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782216926.779515:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782216926.779517:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1782216926.779542:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7b302d80 x1868789713022208/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216942 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216926.779564:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713022208:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782216926.779606:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b300700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1868789713022720:0@lo:400:kworker.0 00000100:00100000:2.0:1782216926.779624:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b301c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1868789713023232:0@lo:400:kworker.0 00010000:00080000:2.0:1782216926.779635:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7b303b80 x1868789713023744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216926.779644:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1868789713023744:0@lo:400:kworker.0 00000100:00100000:2.0:1782216926.779656:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b302680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713022848:0@lo:400:kworker.0 00010000:00080000:2.0:1782216926.779666:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7b300000 x1868789713023360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216926.779673:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b300000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1868789713023360:0@lo:400:kworker.0 00010000:00080000:2.0:1782216926.779682:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7b303100 x1868789713023872/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216926.779689:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b303100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713023872:0@lo:400:kworker.0 00010000:00080000:2.0:1782216926.779710:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7b302a00 x1868789713022336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216942 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216926.779723:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713022336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782216926.779789:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b303800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1868789713022976:0@lo:400:kworker.0 00010000:00080000:1.0:1782216926.779801:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7b301180 x1868789713023488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216926.779810:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b301180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713023488:0@lo:400:kworker.0 00010000:00080000:1.0:1782216926.779830:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7c6d5f80 x1868789713024000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216926.779838:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713024000:0@lo:400:kworker.0 00000100:00100000:1.0:1782216926.780085:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b301500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1868789713023616:0@lo:400:kworker.0 00000100:00100000:0.0:1782216927.291008:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782216927.291031:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c671180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713024128:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782216927.291105:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216927.291261:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713024128 00000100:00100000:1.0:1782216927.291268:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713024128 00000100:00100000:1.0:1782216927.291311:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1782216927.291320:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713024128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782216927.291352:0:7938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1782216927.291401:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713024128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216927.291408:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1782216927.291522:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c671180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713024128:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1782216927.736989:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782216928.325681:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782216928.325705:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713024256:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782216928.325772:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216928.325833:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713024256 00000100:00100000:3.0:1782216928.325839:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713024256 00000100:00100000:3.0:1782216928.325883:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1782216928.325892:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4268ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713024256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782216928.325927:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1782216928.325995:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4268ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713024256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216928.326001:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1782216928.326045:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713024256:0@lo:41:osp-pre-0-1.0 00000001:02000400:1.0:1782216928.372989:0:11220:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.83 00010000:00010000:2.0:1782216928.761328:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216929.784986:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782216930.749305:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216930.749361:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216930.749411:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782216930.749517:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693032192 00000100:00100000:3.0:1782216930.749538:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693032192 00000100:00100000:0.0:1782216930.749715:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693032064 00000100:00100000:0.0:1782216930.749732:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693032064 00000100:00100000:3.0:1782216930.749742:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 107 00000100:00100000:3.0:1782216930.749760:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+5:2404:x1868789693032192:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782216930.749814:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 108 00000100:00100000:0.0:1782216930.749828:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+6:2404:x1868789693032064:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1782216930.749871:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+5:2404:x1868789693032192:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 113us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216930.749881:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 107 00000100:00100000:0.0:1782216930.749936:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+6:2404:x1868789693032064:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 109us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216930.749946:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 108 00000100:00080000:1.0:1782216930.749984:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782216930.749991:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782216930.750060:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693031936 00000100:00100000:2.0:1782216930.750067:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693031936 00000100:00100000:2.0:1782216930.750374:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 283 00000100:00100000:2.0:1782216930.750383:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+10:2404:x1868789693031936:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1782216930.750467:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+10:2404:x1868789693031936:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 85us (1244us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216930.750474:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 283 00010000:00010000:1.0:1782216930.808759:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782216930.976531:0:11317:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.83 00010000:00010000:1.0:1782216931.833709:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216931.897892:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782216931.897925:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c671500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713024384:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782216931.898013:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216931.898099:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c673b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713024512:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782216931.898128:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216931.898176:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713024384 00000100:00100000:2.0:1782216931.898186:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713024384 00000100:00100000:2.0:1782216931.898250:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713024512 00000100:00100000:2.0:1782216931.898253:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713024512 00000100:00100000:2.0:1782216931.898272:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1782216931.898283:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c673100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713024384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782216931.898322:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782216931.898373:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c673100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713024384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216931.898402:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1782216931.898423:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1782216931.898430:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c670e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713024512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782216931.898448:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782216931.898481:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c670e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713024512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216931.898489:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1782216931.898511:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782216931.898515:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782216931.898563:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7c673b80 x1868789713024512/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216947 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216931.898604:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c673b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713024512:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1782216931.898637:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7c671500 x1868789713024384/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216947 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216931.898649:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c671500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713024384:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782216931.899236:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43695c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713024640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782216931.899275:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216931.899362:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713024640 00000100:00100000:0.0:1782216931.899367:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713024640 00000100:00100000:0.0:1782216931.899415:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1782216931.899422:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c671500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713024640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782216931.899438:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782216931.899473:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c671500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713024640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216931.899480:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1782216931.899711:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782216931.899734:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43695c00 x1868789713024640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216947 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216931.899750:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43695c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713024640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782216931.905370:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b301500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713024768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782216931.905466:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216931.905555:0:10535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713024768 00000100:00100000:1.0:1782216931.905564:0:10535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713024768 00000100:00100000:1.0:1782216931.905651:0:10535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1782216931.905660:0:10535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b301180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713024768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782216931.905690:0:10535:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782216931.905739:0:10535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b301180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713024768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216931.905758:0:10535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1782216931.905783:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1782216931.905820:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7b301500 x1868789713024768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216947 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216931.905845:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b301500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713024768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782216931.906051:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43697b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1868789713025280:0@lo:400:kworker.0 00000100:00100000:0.0:1782216931.906086:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216931.906106:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4330f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1868789713025792:0@lo:400:kworker.0 00000100:00100000:0.0:1782216931.906125:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216931.906145:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1782216931.906151:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43694000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789713024896:0@lo:400:kworker.0 00000100:00100000:0.0:1782216931.906178:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216931.906200:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43695c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713025408:0@lo:400:kworker.0 00000100:00100000:0.0:1782216931.906223:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216931.906241:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4330f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1868789713025920:0@lo:400:kworker.0 00000100:00100000:0.0:1782216931.906261:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216931.906283:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1868789713025024:0@lo:400:kworker.0 00000100:00100000:0.0:1782216931.906306:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216931.906334:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4330d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1868789713025536:0@lo:400:kworker.0 00000100:00100000:0.0:1782216931.906356:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216931.906368:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782216931.906373:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43695500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713025152:0@lo:400:kworker.0 00000100:00100000:0.0:1782216931.906393:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216931.906408:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4330fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1868789713025664:0@lo:400:kworker.0 00000100:00100000:0.0:1782216931.906446:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216931.906478:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713024896 00000100:00100000:0.0:1782216931.906483:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713024896 00000100:00100000:0.0:1782216931.906527:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1782216931.906535:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e196c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3647:x1868789713024896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216931.906576:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e196c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3647:x1868789713024896:12345-0@lo:400:kworker.0 Request processed in 42us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216931.906613:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1782216931.906647:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713025408 00000100:00100000:0.0:1782216931.906651:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713025408 00000100:00100000:0.0:1782216931.906677:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713025152 00000100:00100000:0.0:1782216931.906681:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713025152 00000100:00100000:0.0:1782216931.906696:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1782216931.906704:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4330ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713025408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216931.906740:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4330ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713025408:12345-0@lo:400:kworker.0 Request processed in 37us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216931.906746:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1782216931.906758:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1782216931.906764:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4330df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713025152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216931.906795:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4330df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713025152:12345-0@lo:400:kworker.0 Request processed in 31us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216931.906812:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1782216931.906832:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713025280 00000100:00100000:0.0:1782216931.906836:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713025280 00000100:00100000:0.0:1782216931.906853:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713025792 00000100:00100000:0.0:1782216931.906855:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713025792 00000100:00100000:0.0:1782216931.906874:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713025920 00000100:00100000:0.0:1782216931.906877:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713025920 00000100:00100000:0.0:1782216931.906888:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713025024 00000100:00100000:0.0:1782216931.906891:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713025024 00000100:00100000:0.0:1782216931.906901:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713025536 00000100:00100000:0.0:1782216931.906904:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713025536 00000100:00100000:0.0:1782216931.906914:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713025664 00000100:00100000:0.0:1782216931.906917:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713025664 00000100:00100000:0.0:1782216931.906930:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1782216931.906935:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4330e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1868789713025280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216931.906965:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4330e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1868789713025280:12345-0@lo:400:kworker.0 Request processed in 30us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216931.906971:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1782216931.906982:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1782216931.906987:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4330c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1868789713025792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216931.907009:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4330c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1868789713025792:12345-0@lo:400:kworker.0 Request processed in 22us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216931.907014:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1782216931.907023:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1782216931.907028:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4330e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1868789713025920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216931.907049:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4330e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1868789713025920:12345-0@lo:400:kworker.0 Request processed in 21us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216931.907054:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1782216931.907070:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1782216931.907075:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4330ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1868789713025024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216931.907099:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4330ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1868789713025024:12345-0@lo:400:kworker.0 Request processed in 24us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216931.907105:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1782216931.907113:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1782216931.907118:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4330c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1868789713025536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216931.907138:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4330c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1868789713025536:12345-0@lo:400:kworker.0 Request processed in 20us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216931.907144:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1782216931.907151:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1782216931.907156:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d425f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1868789713025664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216931.907179:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d425f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1868789713025664:12345-0@lo:400:kworker.0 Request processed in 23us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216931.907185:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:0.0:1782216931.907209:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782216931.907213:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782216931.907238:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43695500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713025152:0@lo:400:kworker.0 00010000:00080000:0.0:1782216931.907251:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4330fb80 x1868789713025664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216931.907261:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4330fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1868789713025664:0@lo:400:kworker.0 00000100:00100000:0.0:1782216931.907270:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1868789713025024:0@lo:400:kworker.0 00000100:00100000:0.0:1782216931.907278:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4330d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1868789713025536:0@lo:400:kworker.0 00000100:00100000:0.0:1782216931.907306:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43694000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789713024896:0@lo:400:kworker.0 00000100:00100000:0.0:1782216931.907324:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43695c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713025408:0@lo:400:kworker.0 00010000:00080000:0.0:1782216931.907333:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4330f100 x1868789713025920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216931.907342:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4330f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1868789713025920:0@lo:400:kworker.0 00000100:00100000:0.0:1782216931.907351:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43697b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1868789713025280:0@lo:400:kworker.0 00000100:00100000:0.0:1782216931.907360:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4330f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1868789713025792:0@lo:400:kworker.0 00000100:00100000:1.0:1782216932.416021:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b301500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713026048:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782216932.416097:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216932.416199:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713026048 00000100:00100000:1.0:1782216932.416217:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713026048 00000100:00100000:1.0:1782216932.416268:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1782216932.416277:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b303800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713026048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782216932.416312:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1782216932.416362:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b303800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713026048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216932.416370:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1782216932.416415:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b301500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713026048:0@lo:41:osp-pre-1-0.0 00000001:02000400:1.0:1782216932.581361:0:11365:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Jun 23 08:15:31 EDT 2026 00010000:00010000:2.0:1782216932.859053:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782216933.432859:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713026176:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782216933.432932:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216933.433305:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713026176 00000100:00100000:3.0:1782216933.433313:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713026176 00000100:00100000:3.0:1782216933.433369:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1782216933.433378:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b301500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713026176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782216933.433413:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1782216933.433473:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b301500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713026176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216933.433503:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1782216933.434022:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713026176:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1782216933.882051:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216934.905617:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782216935.871345:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216935.871380:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216935.871416:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216935.871445:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693032576 00000100:00100000:1.0:1782216935.871466:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693032576 00000100:00100000:1.0:1782216935.871528:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693032448 00000100:00100000:1.0:1782216935.871532:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693032448 00000100:00100000:1.0:1782216935.871556:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 115 00000100:00100000:1.0:1782216935.871576:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b302a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+5:2405:x1868789693032576:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1782216935.871663:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b302a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+5:2405:x1868789693032576:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 99us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216935.871671:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 115 00000100:00100000:1.0:1782216935.871688:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 116 00000100:00100000:1.0:1782216935.871694:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b303100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+6:2405:x1868789693032448:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1782216935.871718:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b303100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+6:2405:x1868789693032448:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 24us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216935.871723:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 116 00000100:00080000:1.0:1782216935.871742:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782216935.871745:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782216935.875739:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693032320 00000100:00100000:2.0:1782216935.875754:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693032320 00000100:00100000:2.0:1782216935.875859:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 285 00000100:00100000:2.0:1782216935.875869:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e197850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+10:2405:x1868789693032320:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1782216935.875944:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e197850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+10:2405:x1868789693032320:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 77us (4605us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216935.875951:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 285 00010000:00010000:2.0:1782216935.929759:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216936.955527:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782216937.018470:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c671f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713026432:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782216937.018545:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216937.018617:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782216937.018624:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c673b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713026304:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782216937.018644:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216937.018682:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b300000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713026560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782216937.018703:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216937.018726:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782216937.018731:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b301c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713026688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782216937.018753:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216937.018776:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713026432 00000100:00100000:1.0:1782216937.018789:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713026432 00000100:00100000:1.0:1782216937.018828:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713026304 00000100:00100000:1.0:1782216937.018831:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713026304 00000100:00100000:1.0:1782216937.018843:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713026560 00000100:00100000:1.0:1782216937.018845:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713026560 00000100:00100000:1.0:1782216937.018855:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713026688 00000100:00100000:1.0:1782216937.018856:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713026688 00000100:00100000:1.0:1782216937.018870:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1782216937.018877:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b302680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713026432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782216937.018904:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782216937.018942:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b302680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713026432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216937.018949:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1782216937.018964:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1782216937.018970:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b303b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713026304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782216937.018984:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782216937.019008:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b303b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713026304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216937.019014:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1782216937.019024:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1782216937.019030:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b300700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713026560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782216937.019038:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782216937.019075:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b300700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713026560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216937.019080:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1782216937.019091:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1782216937.019097:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b302d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713026688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782216937.019114:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782216937.019139:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b302d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713026688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216937.019144:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1782216937.019162:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782216937.019165:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1782216937.019198:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7b301c00 x1868789713026688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216953 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216937.019215:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b301c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713026688:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1782216937.019224:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7b300000 x1868789713026560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216953 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216937.019233:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b300000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713026560:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1782216937.019259:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7c673b80 x1868789713026304/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216953 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216937.019269:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c673b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713026304:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1782216937.019278:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7c671f80 x1868789713026432/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216953 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216937.019288:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c671f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713026432:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782216937.028666:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c671f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1868789713026944:0@lo:400:kworker.0 00000100:00100000:2.0:1782216937.028734:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216937.028775:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c673800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1868789713027456:0@lo:400:kworker.0 00000100:00100000:2.0:1782216937.028798:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216937.028825:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1782216937.028831:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c672d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17bce19a-7a0f-4c9d-b31c-4e0155298487:3648:1868789713026816:0@lo:400:kworker.0 00000100:00100000:2.0:1782216937.028857:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216937.028878:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c670000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713027328:0@lo:400:kworker.0 00000100:00100000:2.0:1782216937.028902:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216937.028919:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c670700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1868789713027840:0@lo:400:kworker.0 00000100:00100000:2.0:1782216937.028936:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216937.028957:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c673b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713027072:0@lo:400:kworker.0 00000100:00100000:2.0:1782216937.028976:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216937.028997:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c672680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1868789713027584:0@lo:400:kworker.0 00000100:00100000:2.0:1782216937.029016:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216937.029044:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1782216937.029050:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c671180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1868789713027200:0@lo:400:kworker.0 00000100:00100000:2.0:1782216937.029145:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216937.029156:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c673480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1868789713027712:0@lo:400:kworker.0 00000100:00100000:2.0:1782216937.029175:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216937.029202:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713026944 00000100:00100000:2.0:1782216937.029209:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713026944 00000100:00100000:2.0:1782216937.029246:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713027456 00000100:00100000:2.0:1782216937.029249:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713027456 00000100:00100000:2.0:1782216937.029271:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713027840 00000100:00100000:2.0:1782216937.029273:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713027840 00000100:00100000:2.0:1782216937.029285:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713027584 00000100:00100000:2.0:1782216937.029287:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713027584 00000100:00100000:2.0:1782216937.029299:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713027200 00000100:00100000:2.0:1782216937.029301:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713027200 00000100:00100000:2.0:1782216937.029311:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713027712 00000100:00100000:2.0:1782216937.029313:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713027712 00000100:00100000:2.0:1782216937.029328:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1782216937.029334:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43311880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1868789713026944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216937.029382:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43311880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1868789713026944:12345-0@lo:400:kworker.0 Request processed in 48us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216937.029389:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1782216937.029406:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1782216937.029411:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43312680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1868789713027456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216937.029437:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43312680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1868789713027456:12345-0@lo:400:kworker.0 Request processed in 26us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216937.029443:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1782216937.029454:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1782216937.029460:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43311c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1868789713027840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216937.029500:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43311c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1868789713027840:12345-0@lo:400:kworker.0 Request processed in 40us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216937.029507:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1782216937.029519:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1782216937.029525:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43313800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1868789713027584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216937.029554:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43313800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1868789713027584:12345-0@lo:400:kworker.0 Request processed in 29us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216937.029559:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1782216937.029570:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1782216937.029575:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43310380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1868789713027200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216937.029625:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43310380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1868789713027200:12345-0@lo:400:kworker.0 Request processed in 50us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216937.029632:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1782216937.029643:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1782216937.029649:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43312d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1868789713027712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216937.029673:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43312d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1868789713027712:12345-0@lo:400:kworker.0 Request processed in 24us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216937.029678:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1782216937.029699:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713026816 00000100:00100000:2.0:1782216937.029702:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713026816 00000100:00100000:2.0:1782216937.029725:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1782216937.029731:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e194050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3648:x1868789713026816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216937.029758:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e194050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3648:x1868789713026816:12345-0@lo:400:kworker.0 Request processed in 27us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216937.029764:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1782216937.029796:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713027328 00000100:00100000:2.0:1782216937.029800:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713027328 00000100:00100000:2.0:1782216937.029821:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713027072 00000100:00100000:2.0:1782216937.029824:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713027072 00000100:00100000:2.0:1782216937.029836:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1782216937.029842:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43313b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713027328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216937.029871:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43313b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713027328:12345-0@lo:400:kworker.0 Request processed in 29us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216937.029877:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1782216937.029888:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1782216937.029893:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43311180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713027072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216937.029918:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43311180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713027072:12345-0@lo:400:kworker.0 Request processed in 25us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216937.029924:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:2.0:1782216937.029942:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782216937.029945:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782216937.029965:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c672d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17bce19a-7a0f-4c9d-b31c-4e0155298487:3648:1868789713026816:0@lo:400:kworker.0 00000100:00100000:2.0:1782216937.029976:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c670000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713027328:0@lo:400:kworker.0 00010000:00080000:2.0:1782216937.029987:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7c670700 x1868789713027840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216937.029997:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c670700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1868789713027840:0@lo:400:kworker.0 00000100:00100000:2.0:1782216937.030005:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c671f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1868789713026944:0@lo:400:kworker.0 00000100:00100000:2.0:1782216937.030014:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c673800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1868789713027456:0@lo:400:kworker.0 00000100:00100000:2.0:1782216937.034618:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c671180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1868789713027200:0@lo:400:kworker.0 00000100:00100000:3.0:1782216937.034905:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c673480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1868789713027712:0@lo:400:kworker.0 00000100:00100000:3.0:1782216937.034918:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c673b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713027072:0@lo:400:kworker.0 00010000:00080000:3.0:1782216937.034932:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7c672680 x1868789713027584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216937.034942:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c672680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1868789713027584:0@lo:400:kworker.0 00000100:00100000:0.0:1782216937.531805:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43310000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713027968:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782216937.531871:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216937.532074:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713027968 00000100:00100000:2.0:1782216937.532083:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713027968 00000100:00100000:2.0:1782216937.532135:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1782216937.532146:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d425f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713027968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782216937.532181:0:7938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1782216937.532237:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d425f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713027968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216937.532245:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1782216937.532335:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43310000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713027968:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1782216937.977514:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782216938.561723:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782216938.561742:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713028096:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782216938.561801:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216938.561858:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713028096 00000100:00100000:3.0:1782216938.561865:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713028096 00000100:00100000:3.0:1782216938.561903:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1782216938.561912:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4268ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713028096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782216938.561942:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1782216938.561980:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4268ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713028096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216938.561987:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1782216938.562026:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713028096:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1782216939.008522:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216940.024934:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782216940.992852:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782216940.992887:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782216940.992910:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782216940.992935:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693032704 00000100:00100000:3.0:1782216940.992963:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693032704 00000100:00100000:3.0:1782216940.993012:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 287 00000100:00100000:3.0:1782216940.993021:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e194850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+10:2402:x1868789693032704:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1782216940.993092:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e194850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+10:2402:x1868789693032704:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 71us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216940.993099:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 287 00000100:00100000:3.0:1782216940.993131:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693032960 00000100:00100000:3.0:1782216940.993135:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693032960 00000100:00100000:3.0:1782216940.993168:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693032832 00000100:00100000:3.0:1782216940.993170:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693032832 00000100:00100000:3.0:1782216940.993191:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 123 00000100:00100000:3.0:1782216940.993197:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4268d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+5:2402:x1868789693032960:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1782216940.993233:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4268d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+5:2402:x1868789693032960:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 35us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216940.993238:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 123 00000100:00100000:3.0:1782216940.993249:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 124 00000100:00100000:3.0:1782216940.993255:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4268c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+6:2402:x1868789693032832:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1782216940.993277:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4268c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+6:2402:x1868789693032832:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 22us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216940.993283:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 124 00000100:00080000:3.0:1782216940.993303:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782216940.993306:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1782216941.049685:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216942.072934:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782216942.136933:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d425f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713028224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782216942.137005:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216942.137066:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713028224 00000100:00100000:1.0:1782216942.137075:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713028224 00000100:00100000:0.0:1782216942.137086:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782216942.137097:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b300000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713028352:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782216942.137131:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1782216942.137131:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216942.137145:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d425f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713028224:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782216942.137177:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713028352 00002000:00000024:1.0:1782216942.137180:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782216942.137182:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713028352 00000100:00100000:0.0:1782216942.137223:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1782216942.137233:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d425f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713028352:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782216942.137245:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d425f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713028224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (238us total) trans 0 rc 0/0 00002000:00000024:0.0:1782216942.137248:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782216942.137259:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1782216942.137290:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d425f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713028352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216942.137298:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1782216942.137339:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7b300000 x1868789713028352/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216958 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216942.137357:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b300000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713028352:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1782216942.137384:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d425f3b80 x1868789713028224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216958 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216942.137395:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d425f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713028224:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782216942.137514:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782216942.137543:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782216942.137554:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713028480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782216942.137607:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216942.138284:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782216942.138295:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43311500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713028608:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782216942.138330:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216942.138364:0:10535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713028480 00000100:00100000:2.0:1782216942.138369:0:10535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713028480 00000100:00100000:2.0:1782216942.138403:0:10535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713028608 00000100:00100000:2.0:1782216942.138407:0:10535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713028608 00000100:00100000:2.0:1782216942.138423:0:10535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1782216942.138430:0:10535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b301c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713028480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782216942.138458:0:10535:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782216942.138507:0:10535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b301c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713028480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216942.138514:0:10535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1782216942.138534:0:10535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1782216942.138542:0:10535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43310a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713028608:12345-0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1782216942.138546:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4268f800 x1868789713028480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216958 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00002000:00000024:2.0:1782216942.138555:0:10535:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782216942.138566:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713028480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782216942.138930:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d425f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713028992:0@lo:400:kworker.0 00000100:00100000:1.0:1782216942.138935:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d425f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1868789713029120:0@lo:400:kworker.0 00000100:00100000:2.0:1782216942.138982:0:10535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43310a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713028608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 440us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216942.139000:0:10535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1782216942.139018:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d425f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17bce19a-7a0f-4c9d-b31c-4e0155298487:3650:1868789713028736:0@lo:400:kworker.0 00000100:00100000:3.0:1782216942.139059:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d425f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1868789713028864:0@lo:400:kworker.0 00000100:00100000:0.0:1782216942.139329:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216942.139351:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d425f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1868789713029504:0@lo:400:kworker.0 00000100:00100000:0.0:1782216942.139405:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216942.139439:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713028992 00000100:00100000:0.0:1782216942.139454:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713028992 00000100:00100000:0.0:1782216942.139486:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1782216942.139493:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d425f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713028992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216942.139544:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d425f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713028992:12345-0@lo:400:kworker.0 Request processed in 51us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216942.139551:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1782216942.139623:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713029504 00000100:00100000:0.0:1782216942.139627:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713029504 00000100:00100000:0.0:1782216942.139656:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1782216942.139663:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d425f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1868789713029504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216942.139693:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d425f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1868789713029504:12345-0@lo:400:kworker.0 Request processed in 31us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216942.139700:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1782216942.139911:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d425f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713028992:0@lo:400:kworker.0 00010000:00080000:0.0:1782216942.139937:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d425f0380 x1868789713029504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216942.139948:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d425f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1868789713029504:0@lo:400:kworker.0 00000100:00100000:1.0:1782216942.140951:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216942.140991:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d425f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1868789713029632:0@lo:400:kworker.0 00000100:00100000:1.0:1782216942.141019:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216942.141117:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713029120 00000100:00100000:0.0:1782216942.141123:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713029120 00000100:00100000:0.0:1782216942.141160:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713029632 00000100:00100000:0.0:1782216942.141163:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713029632 00000100:00100000:0.0:1782216942.141186:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1782216942.141193:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b300a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1868789713029120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216942.141238:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b300a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1868789713029120:12345-0@lo:400:kworker.0 Request processed in 46us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216942.141245:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1782216942.141258:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1782216942.141266:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b301f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1868789713029632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216942.141293:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b301f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1868789713029632:12345-0@lo:400:kworker.0 Request processed in 29us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216942.141298:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1782216942.141328:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d425f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1868789713029120:0@lo:400:kworker.0 00000100:00100000:0.0:1782216942.141339:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d425f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1868789713029632:0@lo:400:kworker.0 00000100:00100000:2.0:1782216942.141487:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216942.141488:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216942.141611:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d425f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1868789713029376:0@lo:400:kworker.0 00000100:00100000:0.0:1782216942.141611:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713028864 00000100:00100000:0.0:1782216942.141617:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713028864 00000100:00100000:3.0:1782216942.141645:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216942.141652:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1782216942.141661:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4268f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1868789713028864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216942.141683:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713029376 00000100:00100000:3.0:1782216942.141688:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713029376 00000100:00100000:0.0:1782216942.141705:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4268f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1868789713028864:12345-0@lo:400:kworker.0 Request processed in 45us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216942.141714:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1782216942.141723:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4268fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1868789713029376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216942.141727:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1782216942.141764:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4268fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1868789713029376:12345-0@lo:400:kworker.0 Request processed in 42us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216942.141773:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d425f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1868789713028864:0@lo:400:kworker.0 00000100:00100000:3.0:1782216942.141774:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1782216942.141792:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d425f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1868789713029376:0@lo:400:kworker.0 00000100:00100000:2.0:1782216942.141976:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d425f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713029248:0@lo:400:kworker.0 00000100:00100000:2.0:1782216942.142002:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216942.142022:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d425f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1868789713029760:0@lo:400:kworker.0 00000100:00100000:2.0:1782216942.142040:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1782216942.142071:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43311500 x1868789713028608/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216958 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216942.142087:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43311500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713028608:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1782216942.142107:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782216942.142111:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782216942.142113:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782216942.142172:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713028736 00000100:00100000:1.0:1782216942.142177:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713028736 00000100:00100000:3.0:1782216942.142188:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713029248 00000100:00100000:3.0:1782216942.142194:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713029248 00000100:00100000:1.0:1782216942.142217:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1782216942.142229:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1782216942.142230:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e196450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3650:x1868789713028736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216942.142241:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43313480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713029248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216942.142273:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e196450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3650:x1868789713028736:12345-0@lo:400:kworker.0 Request processed in 48us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216942.142281:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1782216942.142289:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43313480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713029248:12345-0@lo:400:kworker.0 Request processed in 50us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216942.142297:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1782216942.142356:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d425f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17bce19a-7a0f-4c9d-b31c-4e0155298487:3650:1868789713028736:0@lo:400:kworker.0 00000100:00100000:2.0:1782216942.142367:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d425f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713029248:0@lo:400:kworker.0 00000100:00100000:0.0:1782216942.143544:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713029760 00000100:00100000:0.0:1782216942.143550:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713029760 00000100:00100000:0.0:1782216942.143620:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1782216942.143629:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43310700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1868789713029760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216942.143685:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43310700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1868789713029760:12345-0@lo:400:kworker.0 Request processed in 55us (1641us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216942.143692:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00010000:00080000:2.0:1782216942.143715:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d425f0700 x1868789713029760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216942.143728:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d425f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1868789713029760:0@lo:400:kworker.0 00000100:00080000:3.0:1782216942.143840:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782216942.648905:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782216942.648933:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43311500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713029888:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782216942.649004:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216942.649064:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713029888 00000100:00100000:0.0:1782216942.649076:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713029888 00000100:00100000:0.0:1782216942.650280:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1782216942.650299:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4268ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713029888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782216942.650344:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1782216942.650460:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4268ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713029888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 168us (1457us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216942.650472:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1782216942.654932:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43311500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713029888:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1782216943.096930:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782216943.672745:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d425f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713030016:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782216943.672877:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216943.680841:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713030016 00000100:00100000:3.0:1782216943.680855:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713030016 00000100:00100000:3.0:1782216943.680912:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1782216943.680921:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d425f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713030016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782216943.680972:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1782216943.681063:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d425f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713030016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 141us (8189us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216943.681082:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1782216943.681555:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d425f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713030016:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1782216944.123017:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782216945.144898:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782216946.110788:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216946.110833:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216946.110891:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216946.110972:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693033344 00000100:00100000:2.0:1782216946.110981:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693033344 00000100:00100000:2.0:1782216946.111048:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693033216 00000100:00100000:2.0:1782216946.111052:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693033216 00000100:00100000:2.0:1782216946.111076:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 131 00000100:00100000:2.0:1782216946.111087:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d425f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+5:2404:x1868789693033344:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1782216946.111168:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d425f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+5:2404:x1868789693033344:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 83us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216946.111176:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 131 00000100:00100000:2.0:1782216946.111194:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 132 00000100:00100000:2.0:1782216946.111201:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d425f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+6:2404:x1868789693033216:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1782216946.111226:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d425f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+6:2404:x1868789693033216:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 26us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216946.111233:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 132 00000100:00100000:3.0:1782216946.111300:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693033088 00000100:00100000:3.0:1782216946.111305:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693033088 00000100:00100000:3.0:1782216946.111392:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 289 00000100:00100000:3.0:1782216946.111401:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e196850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+10:2404:x1868789693033088:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1782216946.111441:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e196850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+10:2404:x1868789693033088:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 42us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216946.111448:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 289 00000100:00080000:0.0:1782216946.111659:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782216946.111664:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1782216946.168851:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782216946.885863:0:11994:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 08:15:45 (1782216945) === 00010000:00010000:1.0:1782216947.193305:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782216947.257902:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782216947.257984:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43311500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713030144:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782216947.258067:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216947.258927:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d425f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789713030400:0@lo:400:kworker.0 00000100:00100000:0.0:1782216947.258981:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216947.259011:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d425f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713030912:0@lo:400:kworker.0 00000100:00100000:0.0:1782216947.259038:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216947.259057:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4330f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713031424:0@lo:400:kworker.0 00000100:00100000:0.0:1782216947.259081:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216947.259100:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1782216947.259107:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d425f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1868789713030528:0@lo:400:kworker.0 00000100:00100000:0.0:1782216947.259130:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216947.259149:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d425f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1868789713031040:0@lo:400:kworker.0 00000100:00100000:0.0:1782216947.259170:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216947.259187:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4330f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1868789713031552:0@lo:400:kworker.0 00000100:00100000:0.0:1782216947.259207:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216947.259238:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713030400 00000100:00100000:0.0:1782216947.259245:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713030400 00000100:00100000:0.0:1782216947.259284:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1782216947.259292:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e195c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3647:x1868789713030400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216947.259336:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e195c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3647:x1868789713030400:12345-0@lo:400:kworker.0 Request processed in 45us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216947.259343:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1782216947.259370:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713030912 00000100:00100000:0.0:1782216947.259373:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713030912 00000100:00100000:0.0:1782216947.259424:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1782216947.259430:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713030912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216947.259465:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713030912:12345-0@lo:400:kworker.0 Request processed in 35us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216947.259729:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713030144 00000100:00100000:2.0:1782216947.259733:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713030144 00000100:00100000:2.0:1782216947.259771:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1782216947.259778:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4268ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713030144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782216947.259800:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782216947.259833:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4268ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713030144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (1767us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216947.259840:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1782216947.259881:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713030528 00000100:00100000:2.0:1782216947.259885:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713030528 00000100:00100000:2.0:1782216947.259905:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713031040 00000100:00100000:2.0:1782216947.259908:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713031040 00000100:00100000:2.0:1782216947.259920:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713031552 00000100:00100000:2.0:1782216947.259922:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713031552 00000100:00100000:2.0:1782216947.259947:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1782216947.259955:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43694000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1868789713030528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216947.259985:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43694000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1868789713030528:12345-0@lo:400:kworker.0 Request processed in 32us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216947.260001:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1782216947.260013:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1782216947.260018:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1868789713031040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216947.260044:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1868789713031040:12345-0@lo:400:kworker.0 Request processed in 26us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216947.260050:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1782216947.260060:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1782216947.260065:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43695500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1868789713031552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216947.260087:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43695500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1868789713031552:12345-0@lo:400:kworker.0 Request processed in 22us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216947.260093:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1782216947.260115:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d425f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713030656:0@lo:400:kworker.0 00000100:00100000:2.0:1782216947.260146:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216947.260164:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d425f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1868789713031168:0@lo:400:kworker.0 00000100:00100000:2.0:1782216947.260185:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216947.260198:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4330d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1868789713031680:0@lo:400:kworker.0 00000100:00100000:2.0:1782216947.260216:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216947.260232:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1782216947.260238:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d425f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713030272:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782216947.260258:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216947.260274:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d425f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1868789713030784:0@lo:400:kworker.0 00000100:00100000:2.0:1782216947.260291:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216947.260300:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d425f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713031296:0@lo:400:kworker.0 00000100:00100000:2.0:1782216947.260316:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216947.260339:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4330fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713031808:0@lo:400:kworker.0 00000100:00100000:2.0:1782216947.260359:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216947.260382:0:10535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713030272 00000100:00100000:2.0:1782216947.260385:0:10535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713030272 00000100:00100000:2.0:1782216947.260421:0:10535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1782216947.260427:0:10535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c673b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713030272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782216947.260443:0:10535:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782216947.260835:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782216947.260846:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b300000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713031936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782216947.260882:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216947.260911:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713031168 00000100:00100000:1.0:1782216947.260915:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713031168 00000100:00100000:1.0:1782216947.260948:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713031680 00000100:00100000:1.0:1782216947.260951:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713031680 00000100:00100000:1.0:1782216947.260966:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713030784 00000100:00100000:1.0:1782216947.260968:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713030784 00000100:00100000:1.0:1782216947.260979:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1782216947.260984:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43310000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1868789713031168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216947.261015:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43310000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1868789713031168:12345-0@lo:400:kworker.0 Request processed in 30us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216947.261021:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1782216947.261034:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1782216947.261039:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c672680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1868789713031680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216947.261064:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c672680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1868789713031680:12345-0@lo:400:kworker.0 Request processed in 25us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216947.261069:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1782216947.261080:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1782216947.261085:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c673480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1868789713030784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216947.261110:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c673480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1868789713030784:12345-0@lo:400:kworker.0 Request processed in 24us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216947.261116:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1782216947.261130:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713031936 00000100:00100000:1.0:1782216947.261134:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713031936 00000100:00100000:1.0:1782216947.261149:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1782216947.261155:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713031936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782216947.261166:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782216947.261204:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713031936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216947.261212:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:1.0:1782216947.261244:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7b300000 x1868789713031936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216963 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216947.261260:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b300000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713031936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782216947.261379:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d425f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1868789713030528:0@lo:400:kworker.0 00000100:00100000:1.0:1782216947.261389:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d425f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1868789713031040:0@lo:400:kworker.0 00000100:00100000:1.0:1782216947.261399:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4330f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1868789713031552:0@lo:400:kworker.0 00000100:00100000:1.0:1782216947.261421:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d425f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789713030400:0@lo:400:kworker.0 00000100:00100000:1.0:1782216947.261431:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d425f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713030912:0@lo:400:kworker.0 00000100:00080000:1.0:1782216947.261466:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782216947.261481:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782216947.261669:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782216947.261673:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782216947.261826:0:10025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713031424 00000100:00100000:3.0:1782216947.261830:0:10025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713031424 00000100:00100000:3.0:1782216947.261855:0:10025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713031296 00000100:00100000:3.0:1782216947.261857:0:10025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713031296 00000100:00100000:3.0:1782216947.261865:0:10025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713031808 00000100:00100000:3.0:1782216947.261868:0:10025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713031808 00000100:00100000:3.0:1782216947.261888:0:10025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782216947.261894:0:10025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43695c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713031424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216947.261930:0:10025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43695c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713031424:12345-0@lo:400:kworker.0 Request processed in 37us (2849us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216947.261946:0:10025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782216947.261958:0:10025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1782216947.261964:0:10025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c671180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3649:x1868789713031296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216947.261987:0:10025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c671180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3649:x1868789713031296:12345-0@lo:400:kworker.0 Request processed in 24us (1669us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216947.261999:0:10025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1782216947.262009:0:10025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1782216947.262014:0:10025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c673800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713031808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216947.262037:0:10025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c673800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713031808:12345-0@lo:400:kworker.0 Request processed in 24us (1678us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216947.262043:0:10025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1782216947.262063:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713030656 00000100:00100000:3.0:1782216947.262066:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713030656 00000100:00080000:1.0:1782216947.262132:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782216947.262160:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713032064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782216947.262188:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216947.262213:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713032064 00000100:00100000:1.0:1782216947.262216:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713032064 00000100:00100000:1.0:1782216947.262231:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1782216947.262237:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713032064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782216947.262248:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782216947.262279:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713032064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216947.262292:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:1.0:1782216947.262319:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4268df80 x1868789713032064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216963 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216947.262332:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713032064:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1782216947.262359:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43311500 x1868789713030144/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216963 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216947.262371:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43311500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713030144:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1782216947.262395:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4330f800 x1868789713031424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216947.262415:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4330f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713031424:0@lo:400:kworker.0 00010000:00080000:1.0:1782216947.262481:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d425f0380 x1868789713030272/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216963 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216947.262499:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d425f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713030272:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782216947.262511:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d425f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1868789713030784:0@lo:400:kworker.0 00010000:00080000:1.0:1782216947.262520:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d425f3b80 x1868789713031296/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216947.262527:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d425f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713031296:0@lo:400:kworker.0 00010000:00080000:1.0:1782216947.262534:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4330fb80 x1868789713031808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216947.262541:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4330fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713031808:0@lo:400:kworker.0 00010000:00080000:1.0:1782216947.262550:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d425f2300 x1868789713031168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216947.262563:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d425f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1868789713031168:0@lo:400:kworker.0 00010000:00080000:1.0:1782216947.262575:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4330d180 x1868789713031680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216947.262601:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4330d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1868789713031680:0@lo:400:kworker.0 00000100:00100000:2.0:1782216947.262706:0:10535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c673b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713030272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2277us (2444us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216947.262713:0:10535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1782216947.264032:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1782216947.264144:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1782216947.264157:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e50239c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713030656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216947.264227:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e50239c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713030656:12345-0@lo:400:kworker.0 Request processed in 74us (4081us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216947.264233:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1782216947.264744:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d425f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713030656:0@lo:400:kworker.0 00000100:00100000:1.0:1782216947.315881:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216947.315976:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693033472 00000100:00100000:2.0:1782216947.315988:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693033472 00000100:00100000:2.0:1782216947.316046:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 291 00000100:00100000:2.0:1782216947.316056:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e197050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+10:8725:x1868789693033472:12345-192.168.203.30@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782216947.316072:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782216947.316088:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e413fc600/0x92b8e04cbf5f946a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xc65e7963be9732c4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216947.316116:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e413fc600/0x92b8e04cbf5f946a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9732c4 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216947.316128:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e413fc600/0x92b8e04cbf5f946a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9732c4 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216947.316138:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e413fc600, rc 0) 00000100:00100000:2.0:1782216947.316199:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e197050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+11:8725:x1868789693033472:12345-192.168.203.30@tcp:101:mount.lustre.0 Request processed in 144us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216947.316219:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 291 00000100:00100000:3.0:1782216947.319922:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216947.320019:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693033600 00000100:00100000:0.0:1782216947.320029:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693033600 00000100:00100000:0.0:1782216947.320082:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 292 00000100:00100000:0.0:1782216947.320091:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e196050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+11:8725:x1868789693033600:12345-192.168.203.30@tcp:501:mount.lustre.0 00000100:00100000:0.0:1782216947.320244:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e196050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+11:8725:x1868789693033600:12345-192.168.203.30@tcp:501:mount.lustre.0 Request processed in 153us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216947.320253:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 292 00000100:00100000:1.0:1782216947.327353:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216947.327454:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693033728 00000100:00100000:0.0:1782216947.327465:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693033728 00000100:00100000:0.0:1782216947.327537:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 293 00000100:00100000:0.0:1782216947.327547:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e197450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+11:8725:x1868789693033728:12345-192.168.203.30@tcp:503:mount.lustre.0 00000100:00100000:0.0:1782216947.327725:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e197450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+11:8725:x1868789693033728:12345-192.168.203.30@tcp:503:mount.lustre.0 Request processed in 178us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216947.327733:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 293 00000100:00100000:1.0:1782216947.330293:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216947.330616:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693033856 00000100:00100000:2.0:1782216947.330625:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693033856 00000100:00100000:2.0:1782216947.330682:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 294 00000100:00100000:2.0:1782216947.330692:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e195850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+11:8729:x1868789693033856:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782216947.330833:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e195850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+11:8729:x1868789693033856:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 141us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216947.330841:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 294 00000100:00100000:1.0:1782216947.352401:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782216947.352511:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693033984 00000100:00100000:3.0:1782216947.352520:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693033984 00000100:00100000:3.0:1782216947.352574:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 295 00000100:00100000:3.0:1782216947.352607:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e194450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+11:8729:x1868789693033984:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782216947.352757:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e194450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+11:8729:x1868789693033984:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 175us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216947.352767:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 295 00000100:00100000:1.0:1782216947.355841:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216947.359870:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693034112 00000100:00100000:0.0:1782216947.359885:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693034112 00000100:00100000:0.0:1782216947.360008:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 296 00000100:00100000:0.0:1782216947.360019:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e194c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+11:8729:x1868789693034112:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782216947.360181:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e194c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+11:8729:x1868789693034112:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 162us (4345us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216947.360200:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 296 00000100:00100000:1.0:1782216947.366707:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216947.367075:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693034240 00000100:00100000:2.0:1782216947.367085:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693034240 00000100:00100000:2.0:1782216947.367144:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 297 00000100:00100000:2.0:1782216947.367154:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e190c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+11:8725:x1868789693034240:12345-192.168.203.30@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782216947.367171:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782216947.367190:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e413fde00/0x92b8e04cbf5f9471 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc65e7963be9732f5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216947.367220:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e413fde00/0x92b8e04cbf5f9471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9732f5 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216947.367233:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e413fde00/0x92b8e04cbf5f9471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9732f5 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216947.367243:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e413fde00, rc 0) 00000100:00100000:2.0:1782216947.367300:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e190c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+12:8725:x1868789693034240:12345-192.168.203.30@tcp:101:mount.lustre.0 Request processed in 147us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216947.367308:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 297 00000100:00100000:1.0:1782216947.377981:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216947.378075:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693034368 00000100:00100000:2.0:1782216947.378085:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693034368 00000100:00100000:2.0:1782216947.378139:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 298 00000100:00100000:2.0:1782216947.378148:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+12:8725:x1868789693034368:12345-192.168.203.30@tcp:256:mount.lustre.0 20000000:01000000:2.0:1782216947.378171:0:6514:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1782216947.378194:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1782216947.378198:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1782216947.378202:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1782216947.378205:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1782216947.378207:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1782216947.383268:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+12:8725:x1868789693034368:12345-192.168.203.30@tcp:256:mount.lustre.0 Request processed in 5111us (5285us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216947.383284:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 298 00000100:00100000:1.0:1782216947.392783:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216947.392875:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693034496 00000100:00100000:0.0:1782216947.392886:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693034496 00000100:00100000:0.0:1782216947.392942:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 299 00000100:00100000:0.0:1782216947.392952:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e191050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+12:8725:x1868789693034496:12345-192.168.203.30@tcp:101:mount.lustre.0 00010000:00010000:0.0:1782216947.392969:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782216947.392987:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e40030a00/0x92b8e04cbf5f9478 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc65e7963be9732fc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216947.393023:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e40030a00/0x92b8e04cbf5f9478 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9732fc expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216947.393035:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e40030a00/0x92b8e04cbf5f9478 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9732fc expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216947.393043:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e40030a00, rc 0) 00000100:00100000:0.0:1782216947.393103:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e191050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:8725:x1868789693034496:12345-192.168.203.30@tcp:101:mount.lustre.0 Request processed in 152us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216947.393111:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 299 00000100:00100000:1.0:1782216947.398388:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216947.398499:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693034624 00000100:00100000:2.0:1782216947.398509:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693034624 00000100:00100000:2.0:1782216947.398565:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 300 00000100:00100000:2.0:1782216947.398575:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e193c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:8725:x1868789693034624:12345-192.168.203.30@tcp:501:mount.lustre.0 00000100:00100000:2.0:1782216947.398739:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e193c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:8725:x1868789693034624:12345-192.168.203.30@tcp:501:mount.lustre.0 Request processed in 164us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216947.398747:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 300 00000100:00100000:1.0:1782216947.409057:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782216947.409149:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693034752 00000100:00100000:3.0:1782216947.409158:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693034752 00000100:00100000:3.0:1782216947.409215:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 301 00000100:00100000:3.0:1782216947.409225:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:8725:x1868789693034752:12345-192.168.203.30@tcp:503:mount.lustre.0 00000100:00100000:3.0:1782216947.409368:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:8725:x1868789693034752:12345-192.168.203.30@tcp:503:mount.lustre.0 Request processed in 144us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216947.409375:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 301 00000100:00100000:1.0:1782216947.416214:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216947.417302:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693034880 00000100:00100000:0.0:1782216947.417314:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693034880 00000100:00100000:0.0:1782216947.417422:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 302 00000100:00100000:0.0:1782216947.417432:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:8732:x1868789693034880:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782216947.418832:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:8732:x1868789693034880:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 1394us (2620us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216947.418843:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 302 00000100:00100000:1.0:1782216947.424098:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782216947.428797:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693035008 00000100:00100000:3.0:1782216947.428810:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693035008 00000100:00100000:3.0:1782216947.428884:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 303 00000100:00100000:3.0:1782216947.428894:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:8732:x1868789693035008:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782216947.429055:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:8732:x1868789693035008:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 161us (4965us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216947.429063:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 303 00000100:00100000:1.0:1782216947.447672:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216947.447712:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216947.447735:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216947.447762:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216947.447792:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693035776 00000100:00100000:1.0:1782216947.447799:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693035776 00000100:00100000:1.0:1782216947.447835:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693035136 00000100:00100000:1.0:1782216947.447837:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693035136 00000100:00100000:1.0:1782216947.447844:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693035392 00000100:00100000:1.0:1782216947.447846:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693035392 00000100:00100000:1.0:1782216947.447866:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693035904 00000100:00100000:1.0:1782216947.447868:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693035904 00000100:00100000:1.0:1782216947.447881:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 139 00000100:00100000:1.0:1782216947.447888:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+6:2405:x1868789693035776:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1782216947.447966:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+6:2405:x1868789693035776:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 78us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216947.447973:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 139 00000100:00100000:1.0:1782216947.447987:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 140 00000100:00100000:1.0:1782216947.447992:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+5:2405:x1868789693035904:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1782216947.448015:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+5:2405:x1868789693035904:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 22us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216947.448021:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 140 00000100:00100000:1.0:1782216947.448032:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:1.0:1782216947.448036:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1868789693035136:12345-192.168.203.30@tcp:38:mount.lustre.0 00010000:00080000:1.0:1782216947.448057:0:6519:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from a927f5f6-9735-45e0-abce-963bd125e020@192.168.203.30@tcp t0 exp 0000000000000000 cur 310 last 0 00000020:00000080:1.0:1782216947.448087:0:6519:0:(genops.c:1406:class_connect()) connect: client a927f5f6-9735-45e0-abce-963bd125e020, cookie 0x92b8e04cbf5f947f 00000004:00100000:1.0:1782216947.448111:0:6519:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1782216947.448202:0:6519:0:(import.c:65:import_set_state_nolock()) ffff952d43665800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782216947.448228:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a927f5f6-9735-45e0-abce-963bd125e020+6:2401:x1868789693035136:12345-192.168.203.30@tcp:38:mount.lustre.0 Request processed in 190us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216947.448234:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:1.0:1782216947.448245:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:1.0:1782216947.448250:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1868789693035392:12345-192.168.203.30@tcp:38:mount.lustre.0 00010000:00080000:1.0:1782216947.448262:0:6519:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from a927f5f6-9735-45e0-abce-963bd125e020@192.168.203.30@tcp t0 exp 0000000000000000 cur 310 last 0 00000020:00000080:1.0:1782216947.448288:0:6519:0:(genops.c:1406:class_connect()) connect: client a927f5f6-9735-45e0-abce-963bd125e020, cookie 0x92b8e04cbf5f9486 00000004:00100000:1.0:1782216947.448299:0:6519:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1782216947.448342:0:6519:0:(import.c:65:import_set_state_nolock()) ffff952d43666800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782216947.448362:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a927f5f6-9735-45e0-abce-963bd125e020+6:2401:x1868789693035392:12345-192.168.203.30@tcp:38:mount.lustre.0 Request processed in 111us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216947.448368:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:1.0:1782216947.451997:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216947.452087:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216947.453719:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216947.458622:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693035520 00000100:00100000:2.0:1782216947.458691:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693035520 00000100:00100000:2.0:1782216947.458776:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693035648 00000100:00100000:2.0:1782216947.458779:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693035648 00000100:00100000:2.0:1782216947.458853:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 18 00000100:00100000:3.0:1782216947.458886:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:3.0:1782216947.458897:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a927f5f6-9735-45e0-abce-963bd125e020+6:8725:x1868789693035648:12345-192.168.203.30@tcp:41:mount.lustre.0 00000004:00000024:3.0:1782216947.458941:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1782216947.459018:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a927f5f6-9735-45e0-abce-963bd125e020+6:8725:x1868789693035648:12345-192.168.203.30@tcp:41:mount.lustre.0 Request processed in 124us (6929us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216947.459026:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00080000:3.0:1782216947.459050:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782216947.459054:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782216947.459121:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a927f5f6-9735-45e0-abce-963bd125e020+6:0:x1868789693035520:12345-192.168.203.30@tcp:41:mount.lustre.0 00000004:00000024:2.0:1782216947.459254:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1782216947.459510:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a927f5f6-9735-45e0-abce-963bd125e020+6:0:x1868789693035520:12345-192.168.203.30@tcp:41:mount.lustre.0 Request processed in 611us (7483us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216947.459560:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 18 00000100:00100000:0.0:1782216947.460828:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693035264 00000100:00100000:0.0:1782216947.460838:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693035264 00000100:00100000:0.0:1782216947.460889:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00100000:0.0:1782216947.460897:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a927f5f6-9735-45e0-abce-963bd125e020+6:0:x1868789693035264:12345-192.168.203.30@tcp:41:mount.lustre.0 00000004:00000024:0.0:1782216947.460933:0:6548:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1782216947.461239:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a927f5f6-9735-45e0-abce-963bd125e020+6:0:x1868789693035264:12345-192.168.203.30@tcp:41:mount.lustre.0 Request processed in 340us (7523us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216947.461246:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00100000:3.0:1782216947.473488:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216947.473626:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693036032 00000100:00100000:2.0:1782216947.473636:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693036032 00000100:00100000:2.0:1782216947.473688:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:2.0:1782216947.473698:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4268c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a927f5f6-9735-45e0-abce-963bd125e020+6:8725:x1868789693036032:12345-192.168.203.30@tcp:40:mount.lustre.0 00000100:00100000:2.0:1782216947.473770:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4268c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a927f5f6-9735-45e0-abce-963bd125e020+6:8725:x1868789693036032:12345-192.168.203.30@tcp:40:mount.lustre.0 Request processed in 74us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216947.473778:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:1.0:1782216947.480985:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216947.481025:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216947.481064:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782216947.481141:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693036416 00000100:00100000:3.0:1782216947.481151:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693036416 00000100:00100000:3.0:1782216947.481204:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5 00000100:00100000:3.0:1782216947.481213:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a927f5f6-9735-45e0-abce-963bd125e020+6:8725:x1868789693036416:12345-192.168.203.30@tcp:900:mount.lustre.0 00000100:00100000:3.0:1782216947.481286:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a927f5f6-9735-45e0-abce-963bd125e020+6:8725:x1868789693036416:12345-192.168.203.30@tcp:900:mount.lustre.0 Request processed in 73us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216947.481311:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5 00000100:00100000:0.0:1782216947.481513:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693036160 00000100:00100000:0.0:1782216947.481517:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693036160 00000100:00100000:0.0:1782216947.481542:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693036288 00000100:00100000:0.0:1782216947.481545:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693036288 00000100:00100000:0.0:1782216947.481563:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00100000:0.0:1782216947.481569:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2401:x1868789693036160:12345-192.168.203.30@tcp:8:mount.lustre.0 00010000:00080000:0.0:1782216947.481630:0:8432:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from a927f5f6-9735-45e0-abce-963bd125e020@192.168.203.30@tcp t0 exp 0000000000000000 cur 310 last 0 00000020:00000080:0.0:1782216947.481664:0:8432:0:(genops.c:1406:class_connect()) connect: client a927f5f6-9735-45e0-abce-963bd125e020, cookie 0x92b8e04cbf5f948d 00002000:00100000:0.0:1782216947.481676:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a927f5f6-9735-45e0-abce-963bd125e020/ffff952d422ec800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782216947.481686:0:8432:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1782216947.481726:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:3.0:1782216947.481733:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2401:x1868789693036288:12345-192.168.203.30@tcp:8:mount.lustre.0 00010000:00080000:3.0:1782216947.481755:0:8435:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from a927f5f6-9735-45e0-abce-963bd125e020@192.168.203.30@tcp t0 exp 0000000000000000 cur 310 last 0 00002000:00080000:0.0:1782216947.481762:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000020:00000080:3.0:1782216947.481778:0:8435:0:(genops.c:1406:class_connect()) connect: client a927f5f6-9735-45e0-abce-963bd125e020, cookie 0x92b8e04cbf5f9494 00002000:00100000:3.0:1782216947.481786:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a927f5f6-9735-45e0-abce-963bd125e020/ffff952d43c06000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00080000:0.0:1782216947.481794:0:8432:0:(import.c:65:import_set_state_nolock()) ffff952d422ea800 : changing import state from RECOVER to FULL 00002000:00100000:3.0:1782216947.481795:0:8435:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1782216947.481845:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1782216947.481874:0:8435:0:(import.c:65:import_set_state_nolock()) ffff952d43c02800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782216947.481932:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a927f5f6-9735-45e0-abce-963bd125e020+6:2401:x1868789693036288:12345-192.168.203.30@tcp:8:mount.lustre.0 Request processed in 197us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216947.481938:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a927f5f6-9735-45e0-abce-963bd125e020+6:2401:x1868789693036160:12345-192.168.203.30@tcp:8:mount.lustre.0 Request processed in 365us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216947.481946:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:0.0:1782216947.484237:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00100000:1.0:1782216947.489529:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216947.490157:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693036544 00000100:00100000:2.0:1782216947.490167:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693036544 00000100:00100000:2.0:1782216947.490221:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1 00000100:00100000:2.0:1782216947.490231:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43310e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a927f5f6-9735-45e0-abce-963bd125e020+6:8725:x1868789693036544:12345-192.168.203.30@tcp:33:mount.lustre.0 00000004:00200000:2.0:1782216947.490312:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1782216947.491270:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43310e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a927f5f6-9735-45e0-abce-963bd125e020+6:8725:x1868789693036544:12345-192.168.203.30@tcp:33:mount.lustre.0 Request processed in 1038us (1746us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216947.491280:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1 00000100:00100000:3.0:1782216947.768884:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c671f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713032192:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782216947.768943:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216947.769081:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713032192 00000100:00100000:1.0:1782216947.769087:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713032192 00000100:00100000:1.0:1782216947.769126:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1782216947.769132:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4268ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713032192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782216947.769167:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1782216947.769216:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4268ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713032192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216947.769223:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1782216947.771478:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c671f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713032192:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1782216948.219335:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216948.793967:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782216948.793990:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c671f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713032320:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782216948.794055:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216948.794122:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713032320 00000100:00100000:2.0:1782216948.794129:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713032320 00000100:00100000:2.0:1782216948.794170:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1782216948.794178:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c670700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713032320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782216948.794210:0:7938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1782216948.794252:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c670700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713032320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216948.794260:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1782216948.794300:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c671f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713032320:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1782216949.240700:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216950.265435:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782216951.288984:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216952.312769:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782216952.376852:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43695f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713032576:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782216952.376920:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216952.376983:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43313b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713032448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782216952.377037:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216952.378151:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713032576 00000100:00100000:0.0:1782216952.378160:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713032576 00000100:00100000:0.0:1782216952.378217:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713032448 00000100:00100000:0.0:1782216952.378220:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713032448 00000100:00100000:0.0:1782216952.378241:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1782216952.378250:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43311180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713032576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782216952.378279:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782216952.378346:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43311180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713032576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (1425us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216952.378353:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1782216952.378382:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1782216952.378388:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43313480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713032448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782216952.378399:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782216952.378424:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43313480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713032448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (1388us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216952.378494:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1782216952.379488:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c670000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789713032832:0@lo:400:kworker.0 00000100:00100000:2.0:1782216952.379533:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216952.379560:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43c4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713033344:0@lo:400:kworker.0 00000100:00100000:2.0:1782216952.379596:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216952.379612:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43c48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1868789713033856:0@lo:400:kworker.0 00000100:00100000:2.0:1782216952.379634:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216952.379653:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1782216952.379659:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c672d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1868789713032960:0@lo:400:kworker.0 00000100:00100000:2.0:1782216952.379679:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216952.379695:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43c4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1868789713033472:0@lo:400:kworker.0 00000100:00100000:2.0:1782216952.379714:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216952.379727:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43c49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713033984:0@lo:400:kworker.0 00000100:00100000:2.0:1782216952.379746:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216952.379773:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713033856 00000100:00100000:2.0:1782216952.379784:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713033856 00000100:00100000:2.0:1782216952.379818:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713032960 00000100:00100000:2.0:1782216952.379821:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713032960 00000100:00100000:2.0:1782216952.379832:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713033472 00000100:00100000:2.0:1782216952.379834:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713033472 00000100:00100000:2.0:1782216952.379847:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1782216952.379854:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43c4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1868789713033856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216952.380011:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43c4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1868789713033856:12345-0@lo:400:kworker.0 Request processed in 156us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216952.380028:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1782216952.380043:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1782216952.380049:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43c48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1868789713032960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216952.380075:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43c48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1868789713032960:12345-0@lo:400:kworker.0 Request processed in 27us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216952.380081:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1782216952.380090:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1782216952.380095:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43c49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1868789713033472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216952.380269:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43c49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1868789713033472:12345-0@lo:400:kworker.0 Request processed in 20us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216952.380277:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1782216952.380298:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713033984 00000100:00100000:2.0:1782216952.380302:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713033984 00000100:00100000:2.0:1782216952.380381:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1782216952.380388:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43c4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713033984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216952.380421:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43c4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713033984:12345-0@lo:400:kworker.0 Request processed in 33us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216952.380427:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1782216952.380468:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c672d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1868789713032960:0@lo:400:kworker.0 00000100:00100000:2.0:1782216952.380478:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43c4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1868789713033472:0@lo:400:kworker.0 00010000:00080000:2.0:1782216952.380490:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43c49180 x1868789713033984/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216952.380500:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43c49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713033984:0@lo:400:kworker.0 00010000:00080000:2.0:1782216952.380511:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43c48000 x1868789713033856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216952.380519:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43c48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1868789713033856:0@lo:400:kworker.0 00000100:00080000:3.0:1782216952.381659:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782216952.381665:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782216952.381668:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782216952.381670:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782216952.381683:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713032832 00000100:00100000:3.0:1782216952.381688:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713032832 00000100:00100000:3.0:1782216952.381733:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1782216952.381742:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e190850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3649:x1868789713032832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216952.381797:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e190850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3649:x1868789713032832:12345-0@lo:400:kworker.0 Request processed in 57us (2265us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216952.381817:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1782216952.381863:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713033344 00000100:00100000:3.0:1782216952.381867:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713033344 00000100:00100000:3.0:1782216952.381895:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1782216952.381902:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43c4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713033344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216952.381919:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c670000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789713032832:0@lo:400:kworker.0 00000100:00100000:3.0:1782216952.381947:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43c4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713033344:12345-0@lo:400:kworker.0 Request processed in 44us (2363us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216952.381948:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43c4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713033344:0@lo:400:kworker.0 00000100:00100000:3.0:1782216952.381961:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1782216952.382042:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c672a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713033088:0@lo:400:kworker.0 00000100:00100000:3.0:1782216952.382073:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216952.382103:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43c48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1868789713033600:0@lo:400:kworker.0 00000100:00100000:3.0:1782216952.382127:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216952.382147:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43c49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713034112:0@lo:400:kworker.0 00000100:00100000:0.0:1782216952.382168:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713033600 00000100:00100000:3.0:1782216952.382174:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216952.382174:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713033600 00010000:00080000:3.0:1782216952.382207:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43695f80 x1868789713032576/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216968 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216952.382210:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713033088 00000100:00100000:2.0:1782216952.382216:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713033088 00000100:00100000:0.0:1782216952.382218:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1782216952.382230:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4268df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1868789713033600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216952.382234:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43695f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713032576:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1782216952.382254:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43313b80 x1868789713032448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216968 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216952.382256:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1782216952.382269:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4268ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713033088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216952.382274:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43313b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713032448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782216952.382274:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4268df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1868789713033600:12345-0@lo:400:kworker.0 Request processed in 44us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216952.382288:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00010000:00080000:3.0:1782216952.382315:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43c48a80 x1868789713033600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216952.382322:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4268ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713033088:12345-0@lo:400:kworker.0 Request processed in 54us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216952.382333:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43c48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1868789713033600:0@lo:400:kworker.0 00000100:00100000:2.0:1782216952.382336:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1782216952.382353:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1782216952.382358:0:10025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713034112 00000100:00100000:2.0:1782216952.382363:0:10025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713034112 00000100:00100000:3.0:1782216952.382364:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c671f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713032704:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782216952.382405:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216952.382413:0:10025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1782216952.382422:0:10025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4268f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713034112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216952.382430:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c670a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1868789713033216:0@lo:400:kworker.0 00000100:00100000:2.0:1782216952.382461:0:10025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4268f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713034112:12345-0@lo:400:kworker.0 Request processed in 40us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216952.382466:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216952.382473:0:10025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1782216952.382492:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43c49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1868789713033728:0@lo:400:kworker.0 00000100:00100000:2.0:1782216952.382494:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713033216 00000100:00100000:2.0:1782216952.382499:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713033216 00000100:00100000:3.0:1782216952.382522:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216952.382526:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1782216952.382541:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46db1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1868789713033216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216952.382543:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713034240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782216952.382576:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216952.382608:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46db1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1868789713033216:12345-0@lo:400:kworker.0 Request processed in 66us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216952.382614:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1782216952.382627:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c672a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713033088:0@lo:400:kworker.0 00000100:00100000:2.0:1782216952.382627:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713033728 00000100:00100000:2.0:1782216952.382632:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713033728 00010000:00080000:3.0:1782216952.382643:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43c49500 x1868789713034112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216952.382652:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1782216952.382654:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43c49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713034112:0@lo:400:kworker.0 00000100:00100000:2.0:1782216952.382662:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46db3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1868789713033728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216952.382684:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c670a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1868789713033216:0@lo:400:kworker.0 00000100:00100000:3.0:1782216952.382702:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43c49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1868789713033728:0@lo:400:kworker.0 00000100:00100000:2.0:1782216952.382704:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46db3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1868789713033728:12345-0@lo:400:kworker.0 Request processed in 41us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216952.382707:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713032704 00000100:00100000:1.0:1782216952.382715:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713032704 00000100:00100000:2.0:1782216952.382717:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:3.0:1782216952.382723:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782216952.382728:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782216952.382732:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782216952.382746:0:10535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713034240 00000100:00100000:2.0:1782216952.382751:0:10535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713034240 00000100:00100000:1.0:1782216952.382753:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1782216952.382762:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4268c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713032704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782216952.382784:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782216952.382887:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4268c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713032704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 126us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216952.382895:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:0.0:1782216952.383020:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7c671f80 x1868789713032704/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216968 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216952.383034:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c671f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713032704:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782216952.384402:0:10535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1782216952.384414:0:10535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46db2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713034240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782216952.384433:0:10535:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782216952.384479:0:10535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46db2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713034240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (1902us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216952.384485:0:10535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:0.0:1782216952.384636:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4268ce00 x1868789713034240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216968 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216952.384652:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713034240:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1782216952.553042:0:12187:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:1.0:1782216952.769347:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216952.769465:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216952.769496:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216952.769525:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216952.769553:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216952.769571:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216952.769634:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216952.769662:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693037440 00000100:00100000:1.0:1782216952.769670:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693037440 00000100:00100000:1.0:1782216952.769722:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693037312 00000100:00100000:1.0:1782216952.769725:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693037312 00000100:00100000:1.0:1782216952.769746:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 41 00000100:00100000:1.0:1782216952.769754:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4330d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a927f5f6-9735-45e0-abce-963bd125e020+6:2405:x1868789693037440:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1782216952.769888:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693036928 00000100:00100000:3.0:1782216952.769893:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693036928 00000100:00100000:3.0:1782216952.769916:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693037184 00000100:00100000:3.0:1782216952.769919:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693037184 00000100:00100000:3.0:1782216952.769929:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693036800 00000100:00100000:3.0:1782216952.769932:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693036800 00000100:00100000:3.0:1782216952.769943:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693037056 00000100:00100000:3.0:1782216952.769957:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693037056 00000100:00100000:3.0:1782216952.769975:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 147 00000100:00100000:3.0:1782216952.769982:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43311500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+5:2405:x1868789693036928:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1782216952.770060:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 148 00000100:00100000:2.0:1782216952.770069:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43313b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a927f5f6-9735-45e0-abce-963bd125e020+6:2405:x1868789693037184:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1782216952.770114:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4330d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a927f5f6-9735-45e0-abce-963bd125e020+6:2405:x1868789693037440:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 359us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216952.770121:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 41 00000100:00100000:1.0:1782216952.770138:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 42 00000100:00100000:1.0:1782216952.770152:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4330d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a927f5f6-9735-45e0-abce-963bd125e020+6:2405:x1868789693037312:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782216952.771229:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693036672 00000100:00100000:0.0:1782216952.771237:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693036672 00000100:00100000:0.0:1782216952.771277:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 305 00000100:00100000:0.0:1782216952.771286:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:2405:x1868789693036672:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1782216952.774708:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43311500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+5:2405:x1868789693036928:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 4715us (5232us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216952.774722:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 147 00000100:00100000:3.0:1782216952.774762:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 149 00000100:00100000:3.0:1782216952.774777:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4330ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+6:2405:x1868789693036800:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1782216952.774847:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4330ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+6:2405:x1868789693036800:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 77us (5293us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216952.774853:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 149 00000100:00100000:3.0:1782216952.774866:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 150 00000100:00100000:3.0:1782216952.774873:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4330df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a927f5f6-9735-45e0-abce-963bd125e020+6:2405:x1868789693037056:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1782216952.774894:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4330df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a927f5f6-9735-45e0-abce-963bd125e020+6:2405:x1868789693037056:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 22us (5322us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216952.774900:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 150 00000100:00080000:3.0:1782216952.774964:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782216952.774968:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782216952.774972:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782216952.774974:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782216952.778015:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43313b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a927f5f6-9735-45e0-abce-963bd125e020+6:2405:x1868789693037184:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 7936us (8506us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216952.778029:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 148 00000100:00100000:1.0:1782216952.778840:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4330d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a927f5f6-9735-45e0-abce-963bd125e020+6:2405:x1868789693037312:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 8685us (9201us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216952.778850:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 42 00000100:00100000:0.0:1782216952.779027:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:2405:x1868789693036672:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 7739us (9686us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216952.779036:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 305 00000100:00100000:2.0:1782216952.890645:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43c48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713034368:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782216952.890727:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216952.890795:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713034368 00000100:00100000:2.0:1782216952.891014:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713034368 00000100:00100000:2.0:1782216952.891058:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1782216952.891067:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43c49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713034368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782216952.891189:0:7938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1782216952.891239:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43c49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713034368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 172us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216952.891247:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1782216952.891290:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43c48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713034368:0@lo:41:osp-pre-1-0.0 00000001:00100000:3.0:1782216952.896099:0:6498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a927f5f6-9735-45e0-abce-963bd125e020 00000001:00100000:3.0:1782216952.896165:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a927f5f6-9735-45e0-abce-963bd125e020 00000001:00100000:1.0:1782216952.900158:0:8428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a927f5f6-9735-45e0-abce-963bd125e020 00000001:00100000:2.0:1782216952.903239:0:7451:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a927f5f6-9735-45e0-abce-963bd125e020 00010000:00010000:2.0:1782216953.336800:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216953.916697:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782216953.916718:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43c48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713034496:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782216953.916780:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216953.916898:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713034496 00000100:00100000:3.0:1782216953.916905:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713034496 00000100:00100000:3.0:1782216953.916954:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1782216953.916964:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43c4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713034496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782216953.917010:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1782216953.917073:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43c4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713034496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216953.917080:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1782216953.917122:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43c48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713034496:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1782216954.362655:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216955.384833:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216956.410225:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216957.432744:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782216957.497541:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43696300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789713034624:0@lo:400:kworker.0 00000100:00100000:0.0:1782216957.497626:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216957.498217:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46db0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713034880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782216957.498315:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216957.499007:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46db2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713035008:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782216957.499043:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216957.501636:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43c4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713035136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782216957.501711:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216957.501754:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782216957.501760:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43c4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713034752:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782216957.501782:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216957.501817:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713034624 00000100:00100000:0.0:1782216957.501824:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713034624 00000100:00100000:0.0:1782216957.501866:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1782216957.501872:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3647:x1868789713034624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216957.501916:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3647:x1868789713034624:12345-0@lo:400:kworker.0 Request processed in 44us (4291us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216957.501923:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1782216957.501967:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43696300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789713034624:0@lo:400:kworker.0 00000100:00100000:0.0:1782216957.502007:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43696300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1868789713035264:0@lo:400:kworker.0 00000100:00100000:0.0:1782216957.502057:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216957.502108:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713035264 00000100:00100000:0.0:1782216957.502112:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713035264 00000100:00100000:0.0:1782216957.502144:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1782216957.502151:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1868789713035264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216957.502181:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1868789713035264:12345-0@lo:400:kworker.0 Request processed in 30us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216957.502186:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1782216957.502210:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43696300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1868789713035264:0@lo:400:kworker.0 00000100:00100000:0.0:1782216957.502275:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713035648:0@lo:400:kworker.0 00000100:00100000:0.0:1782216957.502320:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216957.502361:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713035648 00000100:00100000:0.0:1782216957.502365:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713035648 00000100:00100000:0.0:1782216957.502616:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1782216957.502624:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43317480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713035648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216957.502701:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43317480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713035648:12345-0@lo:400:kworker.0 Request processed in 78us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216957.502707:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1782216957.502734:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713035648:0@lo:400:kworker.0 00000100:00100000:0.0:1782216957.502761:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43314700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1868789713035776:0@lo:400:kworker.0 00000100:00100000:0.0:1782216957.502781:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216957.502831:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43315c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1868789713036160:0@lo:400:kworker.0 00000100:00100000:0.0:1782216957.502849:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216957.502984:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713034880 00000100:00100000:3.0:1782216957.502989:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713034880 00000100:00100000:3.0:1782216957.503027:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713035008 00000100:00100000:3.0:1782216957.503030:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713035008 00000100:00100000:3.0:1782216957.503040:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713035136 00000100:00100000:3.0:1782216957.503042:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713035136 00000100:00100000:3.0:1782216957.503050:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713034752 00000100:00100000:3.0:1782216957.503052:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713034752 00000100:00100000:3.0:1782216957.503061:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1782216957.503067:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46db1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713034880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782216957.503086:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782216957.503116:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46db1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713034880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (4815us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216957.503121:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1782216957.503131:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1782216957.503136:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43c49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713035008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782216957.503149:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782216957.503174:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43c49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713035008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (4130us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216957.503188:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1782216957.503198:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1782216957.503203:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e75106850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713035136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782216957.503212:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1782216957.503310:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782216957.503314:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782216957.503452:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e75106850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713035136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 247us (1740us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216957.503458:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1782216957.503626:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1782216957.503631:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43694a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713034752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782216957.503640:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782216957.503672:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43694a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713034752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (1889us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216957.503677:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1782216957.503697:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713035776 00000100:00100000:3.0:1782216957.503700:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713035776 00000100:00100000:3.0:1782216957.503725:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713036160 00000100:00100000:3.0:1782216957.503728:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713036160 00000100:00100000:3.0:1782216957.503742:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1782216957.503747:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43316680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1868789713035776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216957.503775:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43316680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1868789713035776:12345-0@lo:400:kworker.0 Request processed in 28us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216957.503780:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1782216957.503789:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1782216957.503794:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1868789713036160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216957.503815:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1868789713036160:12345-0@lo:400:kworker.0 Request processed in 21us (965us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216957.503826:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00010000:00080000:3.0:1782216957.503853:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e46db0380 x1868789713034880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216973 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216957.503869:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46db0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713034880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782216957.503886:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43696300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713035392:0@lo:400:kworker.0 00000100:00100000:3.0:1782216957.503907:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216957.503927:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713035392 00000100:00100000:3.0:1782216957.503930:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713035392 00000100:00100000:3.0:1782216957.503948:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1782216957.503953:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46db0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713035392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216957.503978:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46db0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713035392:12345-0@lo:400:kworker.0 Request processed in 24us (70us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216957.503983:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1782216957.504001:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43696300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713035392:0@lo:400:kworker.0 00000100:00100000:3.0:1782216957.504007:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43317800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1868789713035904:0@lo:400:kworker.0 00000100:00100000:3.0:1782216957.504026:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216957.504041:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713035904 00000100:00100000:3.0:1782216957.504044:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713035904 00000100:00100000:3.0:1782216957.504058:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1782216957.504062:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46db2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1868789713035904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216957.504084:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46db2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1868789713035904:12345-0@lo:400:kworker.0 Request processed in 21us (57us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216957.504089:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00010000:00080000:3.0:1782216957.504107:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43317800 x1868789713035904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216957.504121:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43317800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1868789713035904:0@lo:400:kworker.0 00000100:00100000:3.0:1782216957.504140:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782216957.504145:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43695f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1868789713035520:0@lo:400:kworker.0 00000100:00100000:3.0:1782216957.504164:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216957.504181:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713035520 00000100:00100000:3.0:1782216957.504184:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713035520 00000100:00100000:3.0:1782216957.504197:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1782216957.504201:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46db0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1868789713035520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216957.504224:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46db0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1868789713035520:12345-0@lo:400:kworker.0 Request processed in 22us (58us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216957.504242:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1782216957.504262:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43695f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1868789713035520:0@lo:400:kworker.0 00000100:00100000:3.0:1782216957.504268:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43314a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1868789713036032:0@lo:400:kworker.0 00000100:00100000:3.0:1782216957.504285:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216957.504298:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713036032 00000100:00100000:3.0:1782216957.504300:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713036032 00000100:00100000:3.0:1782216957.504315:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1782216957.504319:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46db2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1868789713036032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216957.504357:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46db2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1868789713036032:12345-0@lo:400:kworker.0 Request processed in 37us (71us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216957.504363:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1782216957.504442:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43314a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1868789713036032:0@lo:400:kworker.0 00010000:00080000:0.0:1782216957.504767:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43c4a300 x1868789713035136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216973 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216957.504794:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43c4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713035136:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1782216957.504811:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43315c00 x1868789713036160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216957.504818:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43315c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1868789713036160:0@lo:400:kworker.0 00010000:00080000:0.0:1782216957.504828:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43c4aa00 x1868789713034752/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216973 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216957.504838:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43c4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713034752:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1782216957.504858:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782216957.504860:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782216957.504883:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43314700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1868789713035776:0@lo:400:kworker.0 00010000:00080000:2.0:1782216957.511233:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e46db2d80 x1868789713035008/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216973 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216957.511257:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46db2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713035008:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782216957.891901:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216957.893644:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216957.899493:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216957.899537:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216957.899569:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782216957.904380:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693037696 00000100:00100000:3.0:1782216957.904393:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693037696 00000100:00100000:3.0:1782216957.904547:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693037952 00000100:00100000:3.0:1782216957.904552:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693037952 00000100:00100000:3.0:1782216957.905162:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 157 00000100:00100000:3.0:1782216957.905175:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4330fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+6:2402:x1868789693037696:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1782216957.905383:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4330fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+6:2402:x1868789693037696:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 210us (13490us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216957.905391:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 157 00000100:00100000:3.0:1782216957.905412:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 158 00000100:00100000:3.0:1782216957.905420:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4330f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a927f5f6-9735-45e0-abce-963bd125e020+5:2402:x1868789693037952:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1782216957.905445:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4330f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a927f5f6-9735-45e0-abce-963bd125e020+5:2402:x1868789693037952:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 26us (11810us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216957.905451:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 158 00000100:00100000:3.0:1782216957.905705:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693038208 00000100:00100000:3.0:1782216957.905712:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693038208 00000100:00100000:3.0:1782216957.905747:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 43 00000100:00100000:3.0:1782216957.905754:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4330f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a927f5f6-9735-45e0-abce-963bd125e020+5:2402:x1868789693038208:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1782216957.905784:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4330f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a927f5f6-9735-45e0-abce-963bd125e020+5:2402:x1868789693038208:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 31us (6303us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216957.905790:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 43 00000100:00080000:3.0:1782216957.905805:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782216957.905810:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782216957.906439:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693037824 00000100:00100000:3.0:1782216957.906445:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693037824 00000100:00100000:1.0:1782216957.906689:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216957.906718:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216957.906740:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693038080 00000100:00100000:1.0:1782216957.906744:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693038080 00000100:00100000:1.0:1782216957.906775:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 159 00000100:00100000:1.0:1782216957.906784:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4330ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a927f5f6-9735-45e0-abce-963bd125e020+5:2403:x1868789693038080:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1782216957.906840:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4330ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a927f5f6-9735-45e0-abce-963bd125e020+5:2403:x1868789693038080:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 56us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216957.906847:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 159 00000100:00100000:1.0:1782216957.906869:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693037568 00000100:00100000:1.0:1782216957.906873:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693037568 00000100:00100000:1.0:1782216957.906926:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 307 00000100:00100000:1.0:1782216957.906932:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:2403:x1868789693037568:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1782216957.906957:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:2403:x1868789693037568:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 25us (7422us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216957.906977:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 307 00000100:00100000:2.0:1782216957.907221:0:10025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693038336 00000100:00100000:2.0:1782216957.907368:0:10025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693038336 00000100:00100000:2.0:1782216957.907407:0:10025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 44 00000100:00100000:2.0:1782216957.907423:0:10025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4330dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a927f5f6-9735-45e0-abce-963bd125e020+5:2403:x1868789693038336:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1782216957.907455:0:10025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4330dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a927f5f6-9735-45e0-abce-963bd125e020+5:2403:x1868789693038336:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 33us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216957.907461:0:10025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 44 00000100:00100000:3.0:1782216957.907764:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 160 00000100:00100000:3.0:1782216957.907774:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4330ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+5:2403:x1868789693037824:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1782216957.907806:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4330ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+5:2403:x1868789693037824:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 35us (8237us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216957.907821:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 160 00000100:00080000:2.0:1782216957.908217:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782216957.908221:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782216958.010623:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43c48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713036288:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782216958.010692:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216958.010759:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713036288 00000100:00100000:0.0:1782216958.010767:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713036288 00000100:00100000:0.0:1782216958.010810:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1782216958.010818:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43314700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713036288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782216958.010849:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1782216958.010892:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43314700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713036288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216958.010899:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1782216958.010941:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43c48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713036288:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1782216958.457292:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782216959.038623:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43315c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713036416:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782216959.038698:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216959.038794:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713036416 00000100:00100000:0.0:1782216959.038801:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713036416 00000100:00100000:0.0:1782216959.038864:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1782216959.038873:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46db2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713036416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782216959.038908:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1782216959.038950:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46db2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713036416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216959.038957:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1782216959.053450:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43315c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713036416:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1782216959.495288:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1782216959.968854:0:12503:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1782216959.969756:0:12503:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1782216960.505179:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216961.529505:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216962.554031:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782216962.621845:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43c4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713036544:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782216962.621954:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216962.622036:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43c4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1868789713037056:0@lo:400:kworker.0 00000100:00100000:0.0:1782216962.622068:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216962.622091:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43c49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1868789713037568:0@lo:400:kworker.0 00000100:00100000:0.0:1782216962.622113:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216962.622132:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c673100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1868789713038080:0@lo:400:kworker.0 00000100:00100000:0.0:1782216962.622153:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216962.622171:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1782216962.622178:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43c48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17bce19a-7a0f-4c9d-b31c-4e0155298487:3650:1868789713036928:0@lo:400:kworker.0 00000100:00100000:0.0:1782216962.622209:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216962.622233:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43c48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713037440:0@lo:400:kworker.0 00000100:00100000:0.0:1782216962.622258:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216962.622277:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43c4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713037952:0@lo:400:kworker.0 00000100:00100000:0.0:1782216962.622316:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216962.622346:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782216962.622381:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c673b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713038464:0@lo:400:kworker.0 00000100:00100000:0.0:1782216962.622414:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216962.622462:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43315c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713036672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782216962.622494:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216962.622515:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43c4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713037184:0@lo:400:kworker.0 00000100:00100000:0.0:1782216962.622539:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216962.622556:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43c49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1868789713037696:0@lo:400:kworker.0 00000100:00100000:0.0:1782216962.622619:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216962.622644:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c670e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1868789713038208:0@lo:400:kworker.0 00000100:00100000:0.0:1782216962.622671:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216962.622687:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1782216962.622695:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43c48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713036800:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782216962.622720:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216962.622746:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43c49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1868789713037312:0@lo:400:kworker.0 00000100:00100000:0.0:1782216962.622768:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216962.622777:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43c48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713037824:0@lo:400:kworker.0 00000100:00100000:0.0:1782216962.622792:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216962.622817:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c671500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713038336:0@lo:400:kworker.0 00000100:00100000:0.0:1782216962.622837:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216962.622880:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713036544 00000100:00100000:0.0:1782216962.622889:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713036544 00000100:00100000:0.0:1782216962.622945:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713036672 00000100:00100000:0.0:1782216962.622949:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713036672 00000100:00100000:0.0:1782216962.622964:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713036800 00000100:00100000:0.0:1782216962.622966:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713036800 00000100:00100000:0.0:1782216962.622983:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1782216962.623000:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43315180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713036544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782216962.623039:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782216962.623090:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43315180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713036544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (1140us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216962.623098:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1782216962.623124:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1782216962.623131:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43316a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713036672:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782216962.623133:0:10025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713037952 00000100:00100000:2.0:1782216962.623144:0:10025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713037952 00002000:00000024:0.0:1782216962.623150:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782216962.623195:0:10025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713038464 00000100:00100000:0.0:1782216962.623196:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43316a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1868789713036672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216962.623202:0:10025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713038464 00000100:00100000:0.0:1782216962.623208:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1782216962.623232:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1782216962.623237:0:10025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713037824 00000100:00100000:0.0:1782216962.623245:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43314a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713036800:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782216962.623246:0:10025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713037824 00002000:00000024:0.0:1782216962.623263:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782216962.623270:0:10025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713038336 00000100:00100000:2.0:1782216962.623275:0:10025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713038336 00000100:00100000:0.0:1782216962.623308:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43314a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1868789713036800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216962.623314:0:10025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1782216962.623327:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1782216962.623334:0:10025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43315f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713037952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216962.623356:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713037056 00000100:00100000:0.0:1782216962.623363:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713037056 00000100:00100000:0.0:1782216962.623392:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713037568 00000100:00100000:0.0:1782216962.623395:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713037568 00000100:00100000:0.0:1782216962.623416:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713038080 00000100:00100000:0.0:1782216962.623419:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713038080 00000100:00100000:2.0:1782216962.623430:0:10025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43315f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713037952:12345-0@lo:400:kworker.0 Request processed in 99us (1112us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216962.623435:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713037696 00000100:00100000:0.0:1782216962.623440:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713037696 00000100:00100000:2.0:1782216962.623442:0:10025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1782216962.623466:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713038208 00000100:00100000:0.0:1782216962.623472:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713038208 00000100:00100000:2.0:1782216962.623474:0:10025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1782216962.623485:0:10025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43316d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713038464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216962.623497:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713037312 00000100:00100000:0.0:1782216962.623511:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713037312 00000100:00100000:2.0:1782216962.623526:0:10025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43316d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713038464:12345-0@lo:400:kworker.0 Request processed in 42us (1110us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216962.623540:0:10025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1782216962.623543:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1782216962.623560:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43315500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1868789713037056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216962.623572:0:10025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1782216962.623612:0:10025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4268e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713037824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216962.623639:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43315500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1868789713037056:12345-0@lo:400:kworker.0 Request processed in 82us (1568us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216962.623647:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1782216962.623669:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1782216962.623681:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43317b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1868789713037568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216962.623700:0:10025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4268e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713037824:12345-0@lo:400:kworker.0 Request processed in 104us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216962.623710:0:10025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1782216962.623725:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43317b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1868789713037568:12345-0@lo:400:kworker.0 Request processed in 46us (1608us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216962.623741:0:10025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1782216962.623741:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1782216962.623760:0:10025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4268f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713038336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216962.623768:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1782216962.623779:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43317100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1868789713038080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216962.626107:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713037440 00000100:00100000:1.0:1782216962.626119:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713037440 00000100:00100000:1.0:1782216962.626169:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713037184 00000100:00100000:1.0:1782216962.626173:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713037184 00000100:00100000:1.0:1782216962.626193:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1782216962.626203:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43314e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713037440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216962.636636:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1782216962.636683:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43316300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713037184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216962.637049:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43316300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713037184:12345-0@lo:400:kworker.0 Request processed in 385us (14508us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216962.637058:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1782216962.637108:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1782216962.637119:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43315880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1868789713037696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216962.637158:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43315880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1868789713037696:12345-0@lo:400:kworker.0 Request processed in 42us (14540us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216962.637164:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1782216962.637180:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1782216962.637187:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43314380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1868789713038208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216962.637239:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43314380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1868789713038208:12345-0@lo:400:kworker.0 Request processed in 52us (14569us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216962.637246:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1782216962.637259:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1782216962.637266:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43317800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1868789713037312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216962.637306:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43317800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1868789713037312:12345-0@lo:400:kworker.0 Request processed in 40us (14536us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216962.637312:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:0.0:1782216962.637345:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782216962.637350:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782216962.637354:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782216962.637357:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782216962.637542:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43314e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713037440:12345-0@lo:400:kworker.0 Request processed in 11339us (15281us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216962.637550:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1782216962.637600:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713036928 00000100:00100000:1.0:1782216962.637611:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713036928 00000100:00100000:0.0:1782216962.637852:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782216962.637871:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d425f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713038592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782216962.637920:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1782216962.637994:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43c48700 x1868789713036800/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216978 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216962.638019:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43c48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713036800:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782216962.638034:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43c49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1868789713037312:0@lo:400:kworker.0 00010000:00080000:0.0:1782216962.638046:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43c48a80 x1868789713037824/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216962.638054:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43c48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713037824:0@lo:400:kworker.0 00010000:00080000:0.0:1782216962.638069:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43315c00 x1868789713036672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216978 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216962.638081:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43315c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713036672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782216962.638105:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43c4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713037184:0@lo:400:kworker.0 00010000:00080000:0.0:1782216962.638117:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43c49500 x1868789713037696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216962.638125:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43c49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1868789713037696:0@lo:400:kworker.0 00010000:00080000:0.0:1782216962.638136:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7c670e00 x1868789713038208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216962.638145:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c670e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1868789713038208:0@lo:400:kworker.0 00000100:00100000:0.0:1782216962.638193:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713038592 00000100:00100000:0.0:1782216962.638198:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713038592 00000100:00100000:0.0:1782216962.638233:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1782216962.638240:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4268ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713038592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782216962.638258:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782216962.638307:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4268ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713038592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216962.638314:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:0.0:1782216962.638337:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d425f3100 x1868789713038592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216978 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216962.638350:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d425f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713038592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782216962.639934:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1782216962.639955:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3650:x1868789713036928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216962.640038:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3650:x1868789713036928:12345-0@lo:400:kworker.0 Request processed in 92us (17827us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216962.640045:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1782216962.640165:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43317100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1868789713038080:12345-0@lo:400:kworker.0 Request processed in 16388us (18009us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216962.640174:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00010000:00080000:0.0:1782216962.640705:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7c673b80 x1868789713038464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216962.640734:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c673b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713038464:0@lo:400:kworker.0 00000100:00100000:0.0:1782216962.640753:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43c48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17bce19a-7a0f-4c9d-b31c-4e0155298487:3650:1868789713036928:0@lo:400:kworker.0 00000100:00100000:0.0:1782216962.640903:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43c48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713037440:0@lo:400:kworker.0 00010000:00080000:0.0:1782216962.640918:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43c4a680 x1868789713037952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216962.640927:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43c4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713037952:0@lo:400:kworker.0 00000100:00100000:0.0:1782216962.640942:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43c4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1868789713037056:0@lo:400:kworker.0 00000100:00100000:0.0:1782216962.640956:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43c49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1868789713037568:0@lo:400:kworker.0 00000100:00100000:0.0:1782216962.640969:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c673100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1868789713038080:0@lo:400:kworker.0 00010000:00080000:0.0:1782216962.640983:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43c4b480 x1868789713036544/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216978 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216962.641000:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43c4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713036544:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782216962.641560:0:10025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4268f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713038336:12345-0@lo:400:kworker.0 Request processed in 17795us (18710us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216962.641577:0:10025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1782216962.642536:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7c671500 x1868789713038336/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216962.642553:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c671500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713038336:0@lo:400:kworker.0 00000020:00000004:3.0:1782216962.811021:0:12601:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1782216962.811260:0:12601:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1782216963.004648:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782216963.004695:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782216963.004721:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782216963.004744:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782216963.004758:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782216963.004772:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782216963.004791:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216963.004986:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693038592 00000100:00100000:1.0:1782216963.004995:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693038592 00000100:00100000:1.0:1782216963.005060:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693038848 00000100:00100000:1.0:1782216963.005064:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693038848 00000100:00100000:1.0:1782216963.005079:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693038720 00000100:00100000:1.0:1782216963.005081:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693038720 00000100:00100000:1.0:1782216963.005111:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693038976 00000100:00100000:1.0:1782216963.005113:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693038976 00000100:00100000:1.0:1782216963.005129:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 167 00000100:00100000:1.0:1782216963.005138:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46db1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+6:2405:x1868789693038592:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1782216963.005208:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46db1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+6:2405:x1868789693038592:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 71us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216963.005215:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 167 00000100:00100000:1.0:1782216963.005231:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 168 00000100:00100000:1.0:1782216963.005238:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46db0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a927f5f6-9735-45e0-abce-963bd125e020+5:2405:x1868789693038848:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1782216963.005263:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46db0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a927f5f6-9735-45e0-abce-963bd125e020+5:2405:x1868789693038848:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 25us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216963.005269:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 168 00000100:00100000:1.0:1782216963.005283:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 169 00000100:00100000:1.0:1782216963.005289:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46db1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+5:2405:x1868789693038720:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1782216963.005320:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46db1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+5:2405:x1868789693038720:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 31us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216963.005326:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 169 00000100:00100000:1.0:1782216963.005337:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 170 00000100:00100000:1.0:1782216963.005343:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46db1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a927f5f6-9735-45e0-abce-963bd125e020+5:2405:x1868789693038976:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1782216963.005366:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46db1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a927f5f6-9735-45e0-abce-963bd125e020+5:2405:x1868789693038976:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 23us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216963.005382:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 170 00000100:00100000:1.0:1782216963.005400:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693039104 00000100:00100000:1.0:1782216963.005404:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693039104 00000100:00100000:1.0:1782216963.005454:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693039232 00000100:00100000:1.0:1782216963.005457:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693039232 00000100:00100000:1.0:1782216963.005480:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 49 00000100:00100000:1.0:1782216963.005487:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46db1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a927f5f6-9735-45e0-abce-963bd125e020+5:2405:x1868789693039104:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1782216963.005513:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46db1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a927f5f6-9735-45e0-abce-963bd125e020+5:2405:x1868789693039104:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 27us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216963.005519:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 49 00000100:00100000:1.0:1782216963.005531:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 50 00000100:00100000:1.0:1782216963.005536:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46db2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a927f5f6-9735-45e0-abce-963bd125e020+5:2405:x1868789693039232:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1782216963.005556:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46db2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a927f5f6-9735-45e0-abce-963bd125e020+5:2405:x1868789693039232:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 21us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216963.005561:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 50 00000100:00100000:1.0:1782216963.005576:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693038464 00000100:00100000:1.0:1782216963.005578:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693038464 00000100:00100000:1.0:1782216963.005627:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 309 00000100:00100000:1.0:1782216963.005633:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e192050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:2405:x1868789693038464:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1782216963.005658:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e192050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:2405:x1868789693038464:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 25us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216963.005663:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 309 00000100:00080000:3.0:1782216963.010004:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782216963.010013:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782216963.010017:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782216963.010020:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782216963.128891:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782216963.128914:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c671f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713038720:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782216963.128980:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216963.129249:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713038720 00000100:00100000:2.0:1782216963.129256:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713038720 00000100:00100000:2.0:1782216963.129316:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1782216963.129325:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713038720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782216963.129368:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1782216963.129422:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713038720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216963.129438:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1782216963.129573:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c671f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713038720:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1782216963.577733:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782216964.155353:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713038848:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782216964.155420:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216964.155490:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713038848 00000100:00100000:0.0:1782216964.155497:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713038848 00000100:00100000:0.0:1782216964.155538:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1782216964.155546:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4268ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713038848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782216964.155580:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1782216964.155637:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4268ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713038848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216964.155658:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1782216964.155702:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713038848:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1782216964.600809:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1782216965.305773:0:12698:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782216965.307551:0:12698:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1782216965.625024:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216966.670366:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216967.676237:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782216967.742541:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713038976:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782216967.742624:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216967.742674:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782216967.742681:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43315c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713039104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782216967.742704:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216967.742734:0:10535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713038976 00000100:00100000:0.0:1782216967.742742:0:10535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713038976 00000100:00100000:0.0:1782216967.742785:0:10535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713039104 00000100:00100000:0.0:1782216967.742788:0:10535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713039104 00000100:00100000:0.0:1782216967.742804:0:10535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1782216967.742812:0:10535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43c4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713038976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782216967.742840:0:10535:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782216967.742880:0:10535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43c4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713038976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216967.742888:0:10535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1782216967.742904:0:10535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1782216967.742909:0:10535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43c49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713039104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782216967.742923:0:10535:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782216967.742949:0:10535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43c49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713039104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216967.742955:0:10535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1782216967.742972:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782216967.742975:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1782216967.743001:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43315c00 x1868789713039104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216983 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216967.743028:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43315c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713039104:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1782216967.743040:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4268c000 x1868789713038976/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216983 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216967.743050:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713038976:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782216967.743106:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43c4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713039232:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782216967.743130:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216967.743157:0:10535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713039232 00000100:00100000:0.0:1782216967.743161:0:10535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713039232 00000100:00100000:0.0:1782216967.743184:0:10535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1782216967.743190:0:10535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43c4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713039232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782216967.743200:0:10535:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782216967.743227:0:10535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43c4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713039232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 37us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216967.743233:0:10535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:0.0:1782216967.743247:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782216967.743282:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43c4aa00 x1868789713039232/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216983 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216967.743294:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43c4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713039232:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782216967.747145:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c672a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1868789713039616:0@lo:400:kworker.0 00000100:00100000:2.0:1782216967.747208:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216967.747246:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c671500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1868789713040128:0@lo:400:kworker.0 00000100:00100000:2.0:1782216967.747279:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216967.747303:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4379b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713040640:0@lo:400:kworker.0 00000100:00100000:2.0:1782216967.747327:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216967.747350:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1782216967.747364:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c670a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17bce19a-7a0f-4c9d-b31c-4e0155298487:3650:1868789713039488:0@lo:400:kworker.0 00000100:00100000:2.0:1782216967.747392:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216967.750515:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d425f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713039360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782216967.761529:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216967.761625:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713039360 00000100:00100000:1.0:1782216967.761635:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713039360 00000100:00100000:1.0:1782216967.761698:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1782216967.761707:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43c4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713039360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782216967.761741:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782216967.761788:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43c4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713039360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216967.761795:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1782216967.763936:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782216967.763960:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c670000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713039744:0@lo:400:kworker.0 00000100:00100000:1.0:1782216967.764021:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216967.764678:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713039616 00000100:00100000:3.0:1782216967.764687:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713039616 00000100:00100000:3.0:1782216967.764736:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713040128 00000100:00100000:3.0:1782216967.764739:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713040128 00000100:00100000:3.0:1782216967.764771:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1782216967.764786:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1868789713039616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216967.764846:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1868789713039616:12345-0@lo:400:kworker.0 Request processed in 61us (17637us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216967.764853:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1782216967.764869:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1782216967.764875:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1868789713040128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216967.764901:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1868789713040128:12345-0@lo:400:kworker.0 Request processed in 27us (17621us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216967.764907:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:3.0:1782216967.764931:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782216967.764963:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713040640 00000100:00100000:2.0:1782216967.764969:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713040640 00010000:00080000:0.0:1782216967.765604:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d425f0e00 x1868789713039360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216983 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216967.765626:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d425f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713039360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782216967.765650:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713039744 00000100:00100000:0.0:1782216967.765654:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713039744 00000100:00100000:0.0:1782216967.765684:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1782216967.765691:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d425f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713039744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216967.765732:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d425f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713039744:12345-0@lo:400:kworker.0 Request processed in 41us (1711us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216967.765738:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1782216967.765764:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c672d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1868789713039872:0@lo:400:kworker.0 00000100:00100000:0.0:1782216967.765792:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216967.765817:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713039872 00000100:00100000:0.0:1782216967.765820:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713039872 00000100:00100000:0.0:1782216967.765842:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1782216967.765848:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43c48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1868789713039872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216967.765879:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43c48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1868789713039872:12345-0@lo:400:kworker.0 Request processed in 31us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216967.765884:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1782216967.765913:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c672d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1868789713039872:0@lo:400:kworker.0 00000100:00100000:0.0:1782216967.765920:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c673b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1868789713040384:0@lo:400:kworker.0 00000100:00100000:0.0:1782216967.765943:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216967.765962:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713040384 00000100:00100000:0.0:1782216967.765965:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713040384 00000100:00100000:0.0:1782216967.765993:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1782216967.766000:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43c48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1868789713040384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216967.766028:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43c48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1868789713040384:12345-0@lo:400:kworker.0 Request processed in 28us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216967.766043:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:0.0:1782216967.766058:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782216967.766073:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c673b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1868789713040384:0@lo:400:kworker.0 00000100:00100000:2.0:1782216967.766732:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1782216967.766744:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43798000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713040640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216967.766794:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43798000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713040640:12345-0@lo:400:kworker.0 Request processed in 53us (19466us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216967.766802:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1782216967.769321:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c670000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713039744:0@lo:400:kworker.0 00000100:00100000:1.0:1782216967.769423:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c673100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1868789713040256:0@lo:400:kworker.0 00000100:00100000:1.0:1782216967.769471:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216967.769877:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713039488 00000100:00100000:0.0:1782216967.769884:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713039488 00000100:00100000:0.0:1782216967.769923:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1782216967.769931:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e190450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3650:x1868789713039488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216967.769991:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e190450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3650:x1868789713039488:12345-0@lo:400:kworker.0 Request processed in 61us (22598us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216967.770000:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1782216967.773111:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713040256 00000100:00100000:3.0:1782216967.773126:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713040256 00000100:00100000:3.0:1782216967.773213:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1782216967.773225:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d425f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1868789713040256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216967.773339:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d425f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1868789713040256:12345-0@lo:400:kworker.0 Request processed in 117us (3867us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216967.773347:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00010000:00080000:3.0:1782216967.773393:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7c673100 x1868789713040256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216967.773409:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c673100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1868789713040256:0@lo:400:kworker.0 00000100:00100000:3.0:1782216967.773723:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c671f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713040000:0@lo:400:kworker.0 00000100:00100000:3.0:1782216967.773760:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216967.773785:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c670e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1868789713040512:0@lo:400:kworker.0 00000100:00100000:3.0:1782216967.773805:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216967.773826:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713040512 00000100:00100000:3.0:1782216967.773836:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713040512 00000100:00100000:3.0:1782216967.773862:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1782216967.773869:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43696d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1868789713040512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216967.773902:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43696d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1868789713040512:12345-0@lo:400:kworker.0 Request processed in 34us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216967.773909:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1782216967.773911:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713040000 00000100:00100000:2.0:1782216967.773917:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713040000 00010000:00080000:3.0:1782216967.773942:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7c670e00 x1868789713040512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216967.773952:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c670e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1868789713040512:0@lo:400:kworker.0 00000100:00100000:2.0:1782216967.773955:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1782216967.773967:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43696300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713040000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216967.773973:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c672a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1868789713039616:0@lo:400:kworker.0 00000100:00100000:3.0:1782216967.773988:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c671500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1868789713040128:0@lo:400:kworker.0 00010000:00080000:3.0:1782216967.774002:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4379b800 x1868789713040640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216967.774013:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4379b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713040640:0@lo:400:kworker.0 00000100:00100000:2.0:1782216967.774014:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43696300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713040000:12345-0@lo:400:kworker.0 Request processed in 47us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216967.774026:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1782216967.774048:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c670a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17bce19a-7a0f-4c9d-b31c-4e0155298487:3650:1868789713039488:0@lo:400:kworker.0 00000100:00100000:3.0:1782216967.774059:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c671f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713040000:0@lo:400:kworker.0 00000100:00080000:0.0:1782216967.774128:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000004:1.0:1782216967.846416:0:12795:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782216967.846841:0:12795:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1782216968.135751:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782216968.135810:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782216968.135850:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782216968.135882:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782216968.135908:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782216968.135931:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216968.136120:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693039488 00000100:00100000:0.0:1782216968.136133:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693039488 00000100:00100000:0.0:1782216968.136201:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693039744 00000100:00100000:0.0:1782216968.136205:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693039744 00000100:00100000:0.0:1782216968.136219:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693039616 00000100:00100000:0.0:1782216968.136221:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693039616 00000100:00100000:0.0:1782216968.136233:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693039872 00000100:00100000:0.0:1782216968.136236:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693039872 00000100:00100000:0.0:1782216968.136265:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 177 00000100:00100000:0.0:1782216968.136278:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43696a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+6:2404:x1868789693039488:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782216968.136386:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43696a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+6:2404:x1868789693039488:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 110us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216968.136394:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 177 00000100:00100000:0.0:1782216968.136416:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 178 00000100:00100000:0.0:1782216968.136423:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43697480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a927f5f6-9735-45e0-abce-963bd125e020+5:2404:x1868789693039744:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782216968.136467:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43697480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a927f5f6-9735-45e0-abce-963bd125e020+5:2404:x1868789693039744:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 45us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216968.136474:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 178 00000100:00100000:0.0:1782216968.136488:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 179 00000100:00100000:0.0:1782216968.136494:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+5:2404:x1868789693039616:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782216968.136519:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+5:2404:x1868789693039616:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 25us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216968.136526:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 179 00000100:00100000:0.0:1782216968.136537:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 180 00000100:00100000:0.0:1782216968.136542:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a927f5f6-9735-45e0-abce-963bd125e020+5:2404:x1868789693039872:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782216968.136568:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a927f5f6-9735-45e0-abce-963bd125e020+5:2404:x1868789693039872:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 25us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216968.136574:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 180 00000100:00080000:0.0:1782216968.136632:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782216968.136637:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782216968.136834:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216968.136842:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693039360 00000100:00100000:1.0:1782216968.136858:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693039360 00000100:00100000:2.0:1782216968.136876:0:10025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693040000 00000100:00100000:3.0:1782216968.136881:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693040128 00000100:00100000:2.0:1782216968.136884:0:10025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693040000 00000100:00100000:3.0:1782216968.136899:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693040128 00000100:00100000:1.0:1782216968.136931:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 311 00000100:00100000:1.0:1782216968.136946:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e193450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:2404:x1868789693039360:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1782216968.136976:0:10025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 22 00000100:00100000:2.0:1782216968.136987:0:10025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a927f5f6-9735-45e0-abce-963bd125e020+5:2401:x1868789693040000:12345-192.168.203.30@tcp:9:kworker.0 00000020:00000080:2.0:1782216968.137011:0:10025:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f948d 00000100:00100000:1.0:1782216968.137019:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e193450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:2404:x1868789693039360:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 76us (1165us total) trans 0 rc 0/0 00000100:00080000:2.0:1782216968.137021:0:10025:0:(import.c:65:import_set_state_nolock()) ffff952d422ea800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1782216968.137032:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 311 00000001:00000004:2.0:1782216968.137072:0:10025:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1782216968.137191:0:10025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a927f5f6-9735-45e0-abce-963bd125e020+2:2401:x1868789693040000:12345-192.168.203.30@tcp:9:kworker.0 Request processed in 207us (1257us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216968.137198:0:10025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 22 00010000:00010000:2.0:1782216968.137221:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1782216968.137240:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782216968.137244:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782216968.137522:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 23 00000100:00100000:2.0:1782216968.137532:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a927f5f6-9735-45e0-abce-963bd125e020+5:2401:x1868789693040128:12345-192.168.203.30@tcp:9:kworker.0 00000020:00000080:2.0:1782216968.137547:0:8432:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f9494 00000100:00080000:2.0:1782216968.137553:0:8432:0:(import.c:65:import_set_state_nolock()) ffff952d43c02800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782216968.137580:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1782216968.137765:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a927f5f6-9735-45e0-abce-963bd125e020+2:2401:x1868789693040128:12345-192.168.203.30@tcp:9:kworker.0 Request processed in 234us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216968.137772:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 23 00010000:00010000:2.0:1782216968.137790:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782216968.249244:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782216968.249279:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713040768:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782216968.249371:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216968.249604:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713040768 00000100:00100000:2.0:1782216968.249611:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713040768 00000100:00100000:2.0:1782216968.249659:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1782216968.249668:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43c49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713040768:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782216968.249700:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1782216968.249754:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43c49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713040768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216968.249770:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1782216968.251072:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713040768:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1782216968.696931:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216969.275115:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782216969.275145:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43c4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713040896:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782216969.275233:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216969.275330:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713040896 00000100:00100000:2.0:1782216969.275338:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713040896 00000100:00100000:2.0:1782216969.275391:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1782216969.275400:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713040896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782216969.275441:0:7938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1782216969.275505:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713040896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216969.275521:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1782216969.275573:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43c4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713040896:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1782216969.722662:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1782216970.569486:0:12893:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1782216970.570177:0:12893:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1782216970.745754:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782216971.772477:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216972.793147:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782216972.857667:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789713041024:0@lo:400:kworker.0 00000100:00100000:1.0:1782216972.857835:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216972.857904:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713041536:0@lo:400:kworker.0 00000100:00100000:1.0:1782216972.857937:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216972.857958:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713042048:0@lo:400:kworker.0 00000100:00100000:1.0:1782216972.857995:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216972.858014:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713042560:0@lo:400:kworker.0 00000100:00100000:1.0:1782216972.858034:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216972.858050:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1782216972.858056:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43310a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1868789713041152:0@lo:400:kworker.0 00000100:00100000:1.0:1782216972.858081:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216972.858099:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1868789713041664:0@lo:400:kworker.0 00000100:00100000:1.0:1782216972.858117:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216972.858132:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1868789713042176:0@lo:400:kworker.0 00000100:00100000:1.0:1782216972.858151:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216972.858166:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43c48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713042688:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782216972.858187:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216972.858214:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43313480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1868789713041408:0@lo:400:kworker.0 00000100:00100000:1.0:1782216972.858246:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216972.858263:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713041920:0@lo:400:kworker.0 00000100:00100000:1.0:1782216972.858358:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216972.858377:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713042432:0@lo:400:kworker.0 00000100:00100000:2.0:1782216972.858386:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713042048 00000100:00100000:2.0:1782216972.858396:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713042048 00000100:00100000:1.0:1782216972.858398:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216972.858415:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43c48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713042944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782216972.858459:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713042560 00000100:00100000:2.0:1782216972.858463:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713042560 00000100:00100000:2.0:1782216972.858478:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713041920 00000100:00100000:2.0:1782216972.858481:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713041920 00000100:00100000:2.0:1782216972.858495:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713042432 00000100:00100000:2.0:1782216972.858497:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713042432 00000100:00100000:1.0:1782216972.858498:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216972.858513:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1782216972.858518:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782216972.858523:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d425f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713042048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216972.858523:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43c49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713042816:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782216972.858543:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216972.858571:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713041024 00000100:00100000:1.0:1782216972.858598:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713041024 00000100:00100000:2.0:1782216972.858606:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d425f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713042048:12345-0@lo:400:kworker.0 Request processed in 84us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216972.858614:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1782216972.858629:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1782216972.858630:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1782216972.858635:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d425f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713042560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216972.858636:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e191850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3649:x1868789713041024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216972.858664:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d425f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713042560:12345-0@lo:400:kworker.0 Request processed in 28us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216972.858664:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e191850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3649:x1868789713041024:12345-0@lo:400:kworker.0 Request processed in 28us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216972.858671:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1782216972.858671:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1782216972.858681:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1782216972.858686:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d425f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713041920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216972.858717:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d425f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713041920:12345-0@lo:400:kworker.0 Request processed in 30us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216972.858799:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713041536 00000100:00100000:1.0:1782216972.858804:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713041536 00000100:00100000:1.0:1782216972.858835:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1782216972.858842:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d425f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713041536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216972.858877:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d425f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713041536:12345-0@lo:400:kworker.0 Request processed in 36us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216972.858881:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43311180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713041280:0@lo:400:kworker.0 00000100:00100000:1.0:1782216972.858884:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1782216972.858903:0:10025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1782216972.858909:0:10025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d425f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713042432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216972.858914:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216972.858936:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1868789713041792:0@lo:400:kworker.0 00000100:00100000:1.0:1782216972.858936:0:10025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d425f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713042432:12345-0@lo:400:kworker.0 Request processed in 27us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216972.858942:0:10025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1782216972.858956:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216972.858967:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1868789713042304:0@lo:400:kworker.0 00000100:00100000:1.0:1782216972.858967:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713041152 00000100:00100000:1.0:1782216972.858970:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713041152 00000100:00100000:3.0:1782216972.858987:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216972.858989:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713041664 00000100:00100000:1.0:1782216972.858992:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713041664 00000100:00100000:1.0:1782216972.859009:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713042176 00000100:00100000:3.0:1782216972.859010:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713041280 00000100:00100000:1.0:1782216972.859012:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713042176 00000100:00100000:3.0:1782216972.859013:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713041280 00000100:00100000:1.0:1782216972.859024:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713041408 00000100:00100000:1.0:1782216972.859026:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713041408 00000100:00100000:3.0:1782216972.859035:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1782216972.859037:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713041792 00000100:00100000:1.0:1782216972.859039:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713041792 00000100:00100000:3.0:1782216972.859040:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713041280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216972.859049:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713042304 00000100:00100000:1.0:1782216972.859058:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713042304 00000100:00100000:3.0:1782216972.859074:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713041280:12345-0@lo:400:kworker.0 Request processed in 34us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216972.859076:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1782216972.859081:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1782216972.859081:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d425f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1868789713041152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216972.859111:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d425f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1868789713041152:12345-0@lo:400:kworker.0 Request processed in 30us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216972.859117:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1782216972.859119:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43311180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713041280:0@lo:400:kworker.0 00000100:00100000:1.0:1782216972.859127:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1782216972.859132:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d425f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1868789713041664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216972.859158:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d425f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1868789713041664:12345-0@lo:400:kworker.0 Request processed in 25us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216972.859164:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1782216972.859175:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1782216972.859180:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d425f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1868789713042176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216972.859205:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d425f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1868789713042176:12345-0@lo:400:kworker.0 Request processed in 26us (1052us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216972.859210:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1782216972.859233:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1782216972.859239:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d425f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1868789713041408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216972.859265:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d425f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1868789713041408:12345-0@lo:400:kworker.0 Request processed in 27us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216972.859870:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1782216972.859893:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782216972.859898:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782216972.859899:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00080000:2.0:1782216972.859901:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782216972.859903:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782216972.859912:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1782216972.859919:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1868789713041792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216972.859970:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1868789713041792:12345-0@lo:400:kworker.0 Request processed in 52us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216972.859985:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1782216972.859998:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1782216972.860004:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1868789713042304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216972.860036:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1868789713042304:12345-0@lo:400:kworker.0 Request processed in 32us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216972.860042:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1782216972.860072:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713042688 00000100:00100000:1.0:1782216972.860078:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713042688 00010000:00080000:3.0:1782216972.860080:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e46da6680 x1868789713041792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216972.860094:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1868789713041792:0@lo:400:kworker.0 00000100:00100000:1.0:1782216972.860099:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713042944 00000100:00100000:1.0:1782216972.860101:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713042944 00010000:00080000:3.0:1782216972.860105:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e46da7b80 x1868789713042304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216972.860110:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713042816 00000100:00100000:1.0:1782216972.860112:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713042816 00000100:00100000:3.0:1782216972.860114:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1868789713042304:0@lo:400:kworker.0 00000100:00100000:1.0:1782216972.860122:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1782216972.860127:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d425f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713042688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782216972.860152:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782216972.860187:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d425f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713042688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (1998us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216972.860194:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1782216972.860205:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1782216972.860213:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d425f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713042944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782216972.860232:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782216972.860256:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d425f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713042944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (1757us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216972.860261:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1782216972.860814:0:10535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1782216972.860825:0:10535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d425f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713042816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782216972.860849:0:10535:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782216972.860887:0:10535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d425f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713042816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (2343us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216972.860894:0:10535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1782216972.860932:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b302300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713043072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782216972.860971:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216972.861009:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43310a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1868789713041152:0@lo:400:kworker.0 00000100:00100000:2.0:1782216972.861024:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1868789713041664:0@lo:400:kworker.0 00000100:00100000:2.0:1782216972.861038:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1868789713042176:0@lo:400:kworker.0 00010000:00080000:2.0:1782216972.861051:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43c48a80 x1868789713042688/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216988 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216972.861068:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43c48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713042688:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782216972.861083:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713041536:0@lo:400:kworker.0 00010000:00080000:2.0:1782216972.861096:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e46da5180 x1868789713042048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216972.861104:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713042048:0@lo:400:kworker.0 00010000:00080000:2.0:1782216972.861127:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7c6f1c00 x1868789713042560/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216972.861136:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713042560:0@lo:400:kworker.0 00000100:00100000:2.0:1782216972.861147:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789713041024:0@lo:400:kworker.0 00000100:00100000:1.0:1782216972.861373:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713043072 00000100:00100000:1.0:1782216972.861379:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713043072 00000100:00100000:1.0:1782216972.861420:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1782216972.861553:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43799500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713043072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782216972.861571:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782216972.861619:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43799500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713043072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 192us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216972.861626:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:1.0:1782216972.861679:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43c49880 x1868789713042816/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216988 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216972.861695:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43c49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713042816:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782216972.861709:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43313480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1868789713041408:0@lo:400:kworker.0 00010000:00080000:1.0:1782216972.861788:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e46da5f80 x1868789713041920/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216972.861797:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713041920:0@lo:400:kworker.0 00010000:00080000:1.0:1782216972.861811:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7c6f2d80 x1868789713042432/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216972.861819:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713042432:0@lo:400:kworker.0 00010000:00080000:1.0:1782216972.861830:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43c48700 x1868789713042944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216988 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216972.861842:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43c48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713042944:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1782216972.863507:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7b302300 x1868789713043072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216988 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216972.863535:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b302300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713043072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782216973.259538:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216973.259595:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216973.259619:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216973.259635:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216973.259656:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216973.259705:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693040384 00000100:00100000:1.0:1782216973.259715:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693040384 00000100:00080000:0.0:1782216973.259826:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782216973.259873:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693040512 00000100:00100000:1.0:1782216973.259878:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693040512 00000100:00100000:1.0:1782216973.259903:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693040768 00000100:00100000:1.0:1782216973.259912:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693040768 00000100:00100000:1.0:1782216973.259929:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693040640 00000100:00100000:1.0:1782216973.259932:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693040640 00000100:00100000:1.0:1782216973.259948:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 187 00000100:00100000:1.0:1782216973.259958:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43c48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+6:2403:x1868789693040384:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1782216973.260028:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43c48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+6:2403:x1868789693040384:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 71us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216973.260035:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 187 00000100:00100000:1.0:1782216973.260052:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 188 00000100:00100000:1.0:1782216973.260058:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43c49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+5:2402:x1868789693040512:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1782216973.260084:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43c49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+5:2402:x1868789693040512:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 26us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216973.260091:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 188 00000100:00100000:1.0:1782216973.260103:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 189 00000100:00100000:1.0:1782216973.260109:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43c48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a927f5f6-9735-45e0-abce-963bd125e020+5:2402:x1868789693040768:12345-192.168.203.30@tcp:400:kworker.0 00000100:00080000:0.0:1782216973.260208:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782216973.260211:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782216973.260876:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 190 00000100:00100000:2.0:1782216973.260904:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43c4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a927f5f6-9735-45e0-abce-963bd125e020+5:2403:x1868789693040640:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782216973.260916:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693040256 00000100:00100000:0.0:1782216973.260923:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693040256 00000100:00100000:0.0:1782216973.260967:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 313 00000100:00100000:0.0:1782216973.260977:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e58053450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:2402:x1868789693040256:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1782216973.260990:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43c4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a927f5f6-9735-45e0-abce-963bd125e020+5:2403:x1868789693040640:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 97us (1330us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216973.261001:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 190 00000100:00100000:0.0:1782216973.261022:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e58053450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:2402:x1868789693040256:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 44us (1438us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216973.261031:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 313 00000100:00100000:1.0:1782216973.261742:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43c48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a927f5f6-9735-45e0-abce-963bd125e020+5:2402:x1868789693040768:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 1630us (2102us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216973.261760:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 189 00000100:00100000:2.0:1782216973.374355:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782216973.379055:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713043200:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782216973.379180:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216973.379453:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713043200 00000100:00100000:2.0:1782216973.379464:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713043200 00000100:00100000:2.0:1782216973.379563:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1782216973.379575:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713043200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782216973.379647:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1782216973.379719:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713043200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 144us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216973.379726:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1782216973.379819:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713043200:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1782216973.817640:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1782216973.886327:0:8428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a927f5f6-9735-45e0-abce-963bd125e020 00000020:00000080:1.0:1782216973.886336:0:8428:0:(genops.c:906:class_export_put()) final put ffff952d422ec800/a927f5f6-9735-45e0-abce-963bd125e020 00000020:00000080:2.0:1782216973.887914:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952d422ec800/a927f5f6-9735-45e0-abce-963bd125e020 for lustre-OST0000 00000020:00000080:2.0:1782216973.887960:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff952d422ea800 for lustre-OST0000 00000001:00100000:0.0:1782216973.888395:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a927f5f6-9735-45e0-abce-963bd125e020 00000020:00000080:0.0:1782216973.888400:0:9512:0:(genops.c:906:class_export_put()) final put ffff952d43c06000/a927f5f6-9735-45e0-abce-963bd125e020 00000020:00000080:2.0:1782216973.888629:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff952d43c06000/a927f5f6-9735-45e0-abce-963bd125e020 for lustre-OST0001 00000020:00000080:2.0:1782216973.888657:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff952d43c02800 for lustre-OST0001 00000100:00100000:3.0:1782216974.394785:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c671f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713043328:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782216974.394855:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216974.395042:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713043328 00000100:00100000:0.0:1782216974.395050:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713043328 00000100:00100000:0.0:1782216974.395101:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1782216974.395111:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713043328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782216974.395153:0:7938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1782216974.395199:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713043328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216974.395206:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1782216974.404406:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c671f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713043328:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1782216974.840918:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782216975.551935:0:13037:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1782216975.867030:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216976.889032:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216977.913395:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216977.976818:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b301880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713043456:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782216977.976887:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216977.976950:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1868789713043968:0@lo:400:kworker.0 00000100:00100000:2.0:1782216977.976977:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216977.976997:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43313480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713044608:0@lo:400:kworker.0 00000100:00100000:2.0:1782216977.977019:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216977.977045:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713045120:0@lo:400:kworker.0 00000100:00100000:2.0:1782216977.977066:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216977.977083:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1782216977.977088:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713043840:0@lo:400:kworker.0 00000100:00100000:2.0:1782216977.977109:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216977.977124:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1868789713044480:0@lo:400:kworker.0 00000100:00100000:2.0:1782216977.977143:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216977.977159:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4379bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713044352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782216977.977178:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216977.977208:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1868789713044992:0@lo:400:kworker.0 00000100:00100000:2.0:1782216977.977228:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216977.977264:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789713043584:0@lo:400:kworker.0 00000100:00100000:0.0:1782216977.977530:0:10025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713044608 00000100:00100000:0.0:1782216977.977537:0:10025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713044608 00000100:00100000:0.0:1782216977.977603:0:10025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713045120 00000100:00100000:0.0:1782216977.977607:0:10025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713045120 00000100:00100000:0.0:1782216977.977630:0:10025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1782216977.977639:0:10025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713044608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216977.977697:0:10025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713044608:12345-0@lo:400:kworker.0 Request processed in 60us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216977.977729:0:10025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1782216977.977745:0:10025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1782216977.977751:0:10025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4379ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713045120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216977.977781:0:10025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4379ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713045120:12345-0@lo:400:kworker.0 Request processed in 31us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216977.977788:0:10025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1782216977.977805:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1868789713043712:0@lo:400:kworker.0 00000100:00100000:0.0:1782216977.977828:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216977.977850:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1868789713044224:0@lo:400:kworker.0 00000100:00100000:0.0:1782216977.977869:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216977.977885:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43311180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1868789713044864:0@lo:400:kworker.0 00000100:00100000:0.0:1782216977.977904:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216977.977912:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c670a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713045376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782216977.977933:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1782216977.978018:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782216977.978022:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782216977.978039:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713043968 00000100:00100000:0.0:1782216977.978043:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713043968 00000100:00100000:0.0:1782216977.978062:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713044480 00000100:00100000:0.0:1782216977.978065:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713044480 00000100:00100000:0.0:1782216977.978082:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713044992 00000100:00100000:0.0:1782216977.978084:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713044992 00000100:00100000:0.0:1782216977.978095:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713043712 00000100:00100000:0.0:1782216977.978097:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713043712 00000100:00100000:0.0:1782216977.978106:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713044224 00000100:00100000:0.0:1782216977.978108:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713044224 00000100:00100000:0.0:1782216977.978119:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713044864 00000100:00100000:0.0:1782216977.978127:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713044864 00000100:00100000:0.0:1782216977.978145:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1782216977.978150:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1868789713043968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216977.978195:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1868789713043968:12345-0@lo:400:kworker.0 Request processed in 32us (1205us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216977.978201:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1782216977.978215:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1782216977.978221:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4379a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1868789713044480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216977.978248:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4379a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1868789713044480:12345-0@lo:400:kworker.0 Request processed in 27us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216977.978254:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1782216977.978266:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1782216977.978272:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1868789713044992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216977.978313:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1868789713044992:12345-0@lo:400:kworker.0 Request processed in 42us (1084us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216977.978318:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1782216977.978331:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1782216977.978335:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216977.978336:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c671500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1868789713043712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216977.978359:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713044096:0@lo:400:kworker.0 00000100:00100000:0.0:1782216977.978363:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c671500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1868789713043712:12345-0@lo:400:kworker.0 Request processed in 27us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216977.978369:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1782216977.978448:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216977.978468:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43310a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713044736:0@lo:400:kworker.0 00000100:00100000:2.0:1782216977.978488:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216977.978502:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713045248:0@lo:400:kworker.0 00000100:00100000:2.0:1782216977.978521:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216977.978548:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1782216977.978558:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c672a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1868789713044224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216977.978571:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1782216977.978578:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c670e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1868789713044864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216977.978608:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c672a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1868789713044224:12345-0@lo:400:kworker.0 Request processed in 51us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216977.978624:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00080000:0.0:1782216977.978641:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782216977.978644:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782216977.978669:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1868789713043712:0@lo:400:kworker.0 00000100:00100000:0.0:1782216977.978679:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1868789713044224:0@lo:400:kworker.0 00000100:00100000:0.0:1782216977.978712:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713043584 00000100:00100000:0.0:1782216977.978715:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713043584 00000100:00100000:0.0:1782216977.978740:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1782216977.978746:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e43998c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3649:x1868789713043584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216977.978782:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e43998c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3649:x1868789713043584:12345-0@lo:400:kworker.0 Request processed in 35us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216977.978788:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1782216977.978820:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713044736 00000100:00100000:0.0:1782216977.978824:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713044736 00000100:00100000:0.0:1782216977.978844:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713045248 00000100:00100000:0.0:1782216977.978847:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713045248 00000100:00100000:0.0:1782216977.978860:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1782216977.978865:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713044736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216977.978894:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713044736:12345-0@lo:400:kworker.0 Request processed in 28us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216977.978900:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1782216977.978910:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1782216977.978916:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4379a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713045248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216977.978941:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4379a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713045248:12345-0@lo:400:kworker.0 Request processed in 26us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216977.978956:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1782216977.978970:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782216977.978972:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782216977.979784:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c670e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1868789713044864:12345-0@lo:400:kworker.0 Request processed in 1204us (1877us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216977.979794:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1782216977.979820:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713043840 00000100:00100000:2.0:1782216977.979825:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713043840 00000100:00100000:2.0:1782216977.979930:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713044096 00000100:00100000:2.0:1782216977.979934:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713044096 00000100:00100000:2.0:1782216977.980336:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1782216977.980346:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4379aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713043840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782216977.980388:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4379aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713043840:12345-0@lo:400:kworker.0 Request processed in 44us (3277us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216977.980395:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1782216977.980415:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1782216977.980416:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713043456 00000100:00100000:2.0:1782216977.980424:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4379b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713044096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216977.980424:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713043456 00000100:00100000:1.0:1782216977.980461:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713044352 00000100:00100000:3.0:1782216977.980465:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713045376 00000100:00100000:2.0:1782216977.980466:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4379b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713044096:12345-0@lo:400:kworker.0 Request processed in 44us (2018us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216977.980466:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713044352 00000100:00100000:3.0:1782216977.980473:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713045376 00000100:00100000:2.0:1782216977.980477:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1782216977.980508:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1782216977.980519:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4379b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713043456:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782216977.980528:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4379b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713045504:0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782216977.980542:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782216977.980578:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216977.980604:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4379b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713043456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (3715us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216977.980803:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789713043584:0@lo:400:kworker.0 00000100:00100000:2.0:1782216977.980815:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713044096:0@lo:400:kworker.0 00010000:00080000:2.0:1782216977.980828:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43310a80 x1868789713044736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216977.980838:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43310a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713044736:0@lo:400:kworker.0 00010000:00080000:2.0:1782216977.980937:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7c6d4700 x1868789713045248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216977.980947:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713045248:0@lo:400:kworker.0 00000100:00100000:2.0:1782216977.980988:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713043840:0@lo:400:kworker.0 00010000:00080000:2.0:1782216977.981000:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e46da6680 x1868789713044480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216977.981008:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1868789713044480:0@lo:400:kworker.0 00010000:00080000:2.0:1782216977.981019:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7c6d5880 x1868789713044992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216977.981027:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1868789713044992:0@lo:400:kworker.0 00010000:00080000:2.0:1782216977.981037:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7c6d6680 x1868789713045120/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216977.981045:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713045120:0@lo:400:kworker.0 00010000:00080000:2.0:1782216977.981054:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7b301880 x1868789713043456/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216993 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216977.981080:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b301880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713043456:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782216977.981094:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1868789713043968:0@lo:400:kworker.0 00010000:00080000:2.0:1782216977.981103:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43313480 x1868789713044608/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216977.981110:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43313480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713044608:0@lo:400:kworker.0 00000100:00100000:0.0:1782216977.981136:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43311180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1868789713044864:0@lo:400:kworker.0 00000100:00100000:2.0:1782216977.982130:0:10535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713045504 00000100:00100000:2.0:1782216977.982144:0:10535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713045504 00000100:00100000:1.0:1782216977.983941:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1782216977.983960:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c673100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713045376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782216977.983993:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782216977.984140:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1782216977.984178:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1782216977.984198:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43799880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713044352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782216977.984212:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782216977.984972:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c673100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713045376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1016us (7034us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216977.984981:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1782216977.985007:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1782216977.985016:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713045504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782216977.985031:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782216977.985150:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713045504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 135us (4571us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216977.985157:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:1.0:1782216977.985212:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4379b800 x1868789713045504/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216993 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216977.985232:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4379b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713045504:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1782216977.985347:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7c670a80 x1868789713045376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216993 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216977.985361:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c670a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713045376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782216977.985557:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43799880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713044352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1362us (8376us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216977.985565:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:2.0:1782216977.985676:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4379bb80 x1868789713044352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216993 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216977.985692:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4379bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713044352:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782216978.366613:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782216978.366662:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782216978.366708:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782216978.366733:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782216978.366760:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782216978.366790:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693041024 00000100:00100000:3.0:1782216978.366799:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693041024 00000100:00100000:3.0:1782216978.366863:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693041280 00000100:00100000:3.0:1782216978.366866:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693041280 00000100:00100000:3.0:1782216978.366882:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693041152 00000100:00100000:3.0:1782216978.366884:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693041152 00000100:00100000:3.0:1782216978.366896:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693041408 00000100:00100000:3.0:1782216978.366898:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693041408 00000100:00100000:3.0:1782216978.366914:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 197 00000100:00100000:3.0:1782216978.366923:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+6:2405:x1868789693041024:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1782216978.366994:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+6:2405:x1868789693041024:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 72us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216978.367002:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 197 00000100:00100000:3.0:1782216978.367019:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 198 00000100:00100000:3.0:1782216978.367025:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a927f5f6-9735-45e0-abce-963bd125e020+5:2405:x1868789693041280:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1782216978.367048:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a927f5f6-9735-45e0-abce-963bd125e020+5:2405:x1868789693041280:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 23us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216978.367055:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 198 00000100:00100000:3.0:1782216978.367065:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 199 00000100:00100000:3.0:1782216978.367070:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+5:2405:x1868789693041152:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1782216978.367092:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+5:2405:x1868789693041152:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 21us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216978.367098:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 199 00000100:00100000:3.0:1782216978.367109:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 200 00000100:00100000:3.0:1782216978.367115:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a927f5f6-9735-45e0-abce-963bd125e020+5:2405:x1868789693041408:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1782216978.367134:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a927f5f6-9735-45e0-abce-963bd125e020+5:2405:x1868789693041408:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 20us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216978.367148:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 200 00000100:00100000:3.0:1782216978.367165:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693040896 00000100:00100000:3.0:1782216978.367169:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693040896 00000100:00100000:3.0:1782216978.367204:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 315 00000100:00100000:3.0:1782216978.367210:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4399b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:2405:x1868789693040896:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1782216978.367235:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4399b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:2405:x1868789693040896:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 25us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216978.367241:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 315 00000100:00080000:3.0:1782216978.371374:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782216978.371385:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782216978.488865:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782216978.488889:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713045632:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782216978.488956:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216978.489246:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713045632 00000100:00100000:2.0:1782216978.489255:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713045632 00000100:00100000:2.0:1782216978.489344:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1782216978.489354:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b300380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713045632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782216978.489485:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1782216978.489549:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b300380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713045632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 197us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216978.489557:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1782216978.489635:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713045632:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1782216978.936859:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782216979.227762:0:13186:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffef40947d0 20000000:00000080:0.0:1782216979.227776:0:13186:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff952d43635400 uarg=0000000000000000 20000000:01000000:0.0:1782216979.227810:0:13186:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1782216979.227814:0:13186:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1782216979.227818:0:13186:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1782216979.228927:0:13187:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1782216979.229071:0:13186:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1782216979.237036:0:13186:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1782216979.237149:0:13186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff952e413fd800/0x92b8e04cbf5f949b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216979.237170:0:13186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952e7b362400/0x92b8e04cbf5f9432 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f942b expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216979.237188:0:13186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952d43073800/0x92b8e04cbf5f9440 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9439 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216979.237210:0:13186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952e7b362a00/0x92b8e04cbf5f944e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9447 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216979.237217:0:13186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952e7c448c00/0x92b8e04cbf5f945c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9455 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216979.237227:0:13186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952e7c448a00/0x92b8e04cbf5f9463 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9732bd expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216979.237233:0:13186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952e40030a00/0x92b8e04cbf5f9478 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9732fc expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216979.237242:0:13186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff952e413fd800/0x92b8e04cbf5f949b lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216979.237348:0:13186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952e40030a00/0x92b8e04cbf5f9478 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9732fc expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216979.237361:0:13186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff952e40030a00/0x92b8e04cbf5f9478 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9732fc expref: 12 pid: 6511 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216979.237375:0:13186:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43311180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13186:1868789713045760:192.168.203.30@tcp:104: 00010000:00010000:2.0:1782216979.237483:0:13186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952e7c448a00/0x92b8e04cbf5f9463 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9732bd expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216979.237491:0:13186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff952e7c448a00/0x92b8e04cbf5f9463 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9732bd expref: 12 pid: 6511 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216979.237498:0:13186:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43313480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13186:1868789713045888:192.168.203.30@tcp:104: 00010000:00010000:2.0:1782216979.237534:0:13186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952e7c448c00/0x92b8e04cbf5f945c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5f9455 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216979.237541:0:13186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff952e7c448c00/0x92b8e04cbf5f945c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9455 expref: 23 pid: 6511 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216979.237548:0:13186:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43310a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13186:1868789713046016:0@lo:104: 00000100:00100000:2.0:1782216979.239151:0:13186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782216979.239271:0:13186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952e7b362a00/0x92b8e04cbf5f944e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5f9447 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216979.239284:0:13186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff952e7b362a00/0x92b8e04cbf5f944e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9447 expref: 23 pid: 6513 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216979.239297:0:13186:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43dcad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13186:1868789713046144:0@lo:104: 00000100:00100000:2.0:1782216979.239336:0:13186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782216979.241425:0:13186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952d43073800/0x92b8e04cbf5f9440 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5f9439 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216979.241442:0:13186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff952d43073800/0x92b8e04cbf5f9440 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9439 expref: 23 pid: 6514 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216979.241455:0:13186:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43dca300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13186:1868789713046272:0@lo:104: 00000100:00100000:2.0:1782216979.241506:0:13186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216979.241547:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713046016 00000100:00100000:0.0:1782216979.241554:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713046016 00000100:00100000:0.0:1782216979.241608:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713046144 00000100:00100000:0.0:1782216979.241611:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713046144 00000100:00100000:0.0:1782216979.241624:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1782216979.241631:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43dc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+4:13186:x1868789713046016:12345-0@lo:104: 00010000:00010000:0.0:1782216979.241643:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff952e7c449a00/0x92b8e04cbf5f9455 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f945c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216979.241699:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782216979.241704:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43dc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+4:13186:x1868789713046016:12345-0@lo:104: Request processed in 74us (2556us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216979.241711:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1782216979.241737:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1782216979.241742:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+3:13186:x1868789713046144:12345-0@lo:104: 00010000:00010000:0.0:1782216979.241749:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff952e7b362c00/0x92b8e04cbf5f9447 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f944e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216979.241780:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1782216979.241785:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+3:13186:x1868789713046144:12345-0@lo:104: Request processed in 43us (2449us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216979.241790:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:0.0:1782216979.241804:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782216979.241809:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e7c449a00/0x92b8e04cbf5f9455 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f945c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216979.241817:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7c449a00 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:0.0:1782216979.241821:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e7c449a00/0x92b8e04cbf5f9455 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5f945c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216979.241830:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e7c449a00/0x92b8e04cbf5f9455 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5f945c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782216979.241836:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e7c449a00/0x92b8e04cbf5f9455 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5f945c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782216979.241843:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782216979.241871:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e7c449a00/0x92b8e04cbf5f9455 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f945c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216979.241877:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782216979.241893:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e7c449a00/0x92b8e04cbf5f9455 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f945c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216979.241910:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e7c449a00/0x92b8e04cbf5f9455 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f945c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216979.241930:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782216979.241934:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e7b362c00/0x92b8e04cbf5f9447 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f944e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216979.241940:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362c00 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:0.0:1782216979.241943:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e7b362c00/0x92b8e04cbf5f9447 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5f944e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216979.241950:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e7b362c00/0x92b8e04cbf5f9447 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5f944e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782216979.241956:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e7b362c00/0x92b8e04cbf5f9447 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5f944e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782216979.241962:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782216979.241974:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e7b362c00/0x92b8e04cbf5f9447 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f944e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216979.241979:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782216979.241985:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e7b362c00/0x92b8e04cbf5f9447 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f944e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216979.241991:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e7b362c00/0x92b8e04cbf5f9447 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f944e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216979.242000:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782216979.242005:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782216979.242007:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782216979.242019:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c670a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789713046400:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782216979.242045:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216979.242072:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782216979.242078:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c670000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789713046528:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782216979.242099:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216979.242127:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713046400 00000100:00100000:0.0:1782216979.242131:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713046400 00010000:00010000:0.0:1782216979.242147:0:8449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952e7c448c00/0x92b8e04cbf5f945c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9455 expref: 24 pid: 6511 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216979.242167:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713046528 00000100:00100000:0.0:1782216979.242170:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713046528 00010000:00010000:0.0:1782216979.242194:0:8449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952e7b362a00/0x92b8e04cbf5f944e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9447 expref: 25 pid: 6513 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216979.242213:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1782216979.242218:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c673b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17bce19a-7a0f-4c9d-b31c-4e0155298487+25:3649:x1868789713046400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782216979.242228:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782216979.242233:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952e7c448c00/0x92b8e04cbf5f945c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9455 expref: 25 pid: 6511 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216979.242241:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952e7c448c00/0x92b8e04cbf5f945c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9455 expref: 25 pid: 6511 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216979.242268:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782216979.242278:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782216979.242300:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c673b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17bce19a-7a0f-4c9d-b31c-4e0155298487+25:3649:x1868789713046400:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216979.242308:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1782216979.242325:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c670a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789713046400:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782216979.242331:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1782216979.242340:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c672d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3649:x1868789713046528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782216979.242349:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782216979.242353:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952e7b362a00/0x92b8e04cbf5f944e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9447 expref: 24 pid: 6513 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216979.242361:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952e7b362a00/0x92b8e04cbf5f944e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9447 expref: 24 pid: 6513 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216979.242369:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782216979.242406:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c672d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3649:x1868789713046528:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216979.242412:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1782216979.242866:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c670000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789713046528:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782216979.243065:0:13186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952e7b362400/0x92b8e04cbf5f9432 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5f942b expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216979.243076:0:13186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff952e7b362400/0x92b8e04cbf5f9432 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5f942b expref: 23 pid: 6511 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216979.243097:0:13186:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43dc8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13186:1868789713046656:0@lo:104: 00000100:00100000:2.0:1782216979.243126:0:13186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216979.243138:0:13186:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e47c56000 going to sleep for 11 seconds 00010000:00010000:2.0:1782216979.243151:0:13186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e7c448c00/0x92b8e04cbf5f945c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5f9455 expref: 23 pid: 6511 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216979.243162:0:13186:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43310a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13186:1868789713046016:0@lo:104: 00010000:00010000:2.0:1782216979.243171:0:13186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e7b362a00/0x92b8e04cbf5f944e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5f9447 expref: 22 pid: 6513 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216979.243188:0:13186:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43dcad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13186:1868789713046144:0@lo:104: 00000100:00100000:0.0:1782216979.243256:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713046272 00000100:00100000:0.0:1782216979.243260:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713046272 00000100:00100000:0.0:1782216979.243278:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713046656 00000100:00100000:0.0:1782216979.243280:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713046656 00000100:00100000:0.0:1782216979.243291:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1782216979.243296:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43dc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+4:13186:x1868789713046272:12345-0@lo:104: 00010000:00010000:0.0:1782216979.243305:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff952e413fda00/0x92b8e04cbf5f9439 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f9440 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216979.243407:0:13186:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43dca300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13186:1868789713046272:0@lo:104: 00010000:00010000:0.0:1782216979.243532:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782216979.243538:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43dc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+4:13186:x1868789713046272:12345-0@lo:104: Request processed in 242us (2033us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216979.243545:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1782216979.243561:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1782216979.243568:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43dcb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+3:13186:x1868789713046656:12345-0@lo:104: 00010000:00010000:0.0:1782216979.243576:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff952e7c448000/0x92b8e04cbf5f942b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f9432 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216979.243695:0:13186:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43dc8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13186:1868789713046656:0@lo:104: 00010000:00010000:3.0:1782216979.243878:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782216979.243884:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e413fda00/0x92b8e04cbf5f9439 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f9440 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216979.243891:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e413fda00 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:3.0:1782216979.243895:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e413fda00/0x92b8e04cbf5f9439 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5f9440 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216979.243904:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e413fda00/0x92b8e04cbf5f9439 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5f9440 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782216979.243912:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e413fda00/0x92b8e04cbf5f9439 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5f9440 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782216979.244029:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1782216979.244062:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e413fda00/0x92b8e04cbf5f9439 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f9440 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216979.244069:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1782216979.244111:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789713046784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782216979.244144:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782216979.244199:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e413fda00/0x92b8e04cbf5f9439 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f9440 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216979.244208:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e413fda00/0x92b8e04cbf5f9439 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f9440 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216979.244220:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782216979.244224:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e7c448000/0x92b8e04cbf5f942b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f9432 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216979.244229:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7c448000 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:3.0:1782216979.244232:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e7c448000/0x92b8e04cbf5f942b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5f9432 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216979.244238:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e7c448000/0x92b8e04cbf5f942b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5f9432 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782216979.244253:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e7c448000/0x92b8e04cbf5f942b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5f9432 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782216979.244259:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1782216979.244273:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e7c448000/0x92b8e04cbf5f942b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f9432 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216979.244279:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782216979.244390:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1782216979.244398:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43dcb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+3:13186:x1868789713046656:12345-0@lo:104: Request processed in 830us (1270us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216979.244405:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1782216979.244427:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713046784 00000100:00100000:0.0:1782216979.244431:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713046784 00010000:00010000:0.0:1782216979.244449:0:8449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952d43073800/0x92b8e04cbf5f9440 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9439 expref: 22 pid: 6514 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216979.244561:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782216979.244644:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1782216979.244652:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b301180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17bce19a-7a0f-4c9d-b31c-4e0155298487+22:3647:x1868789713046784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782216979.244664:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782216979.244682:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952d43073800/0x92b8e04cbf5f9440 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9439 expref: 22 pid: 6514 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216979.244692:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952d43073800/0x92b8e04cbf5f9440 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5f9439 expref: 22 pid: 6514 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216979.244703:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952d43073800/0x92b8e04cbf5f9440 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5f9439 expref: 22 pid: 6514 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216979.244712:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782216979.244785:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17bce19a-7a0f-4c9d-b31c-4e0155298487:3648:1868789713046912:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782216979.244812:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782216979.245129:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e7c448000/0x92b8e04cbf5f942b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f9432 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216979.245139:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e7c448000/0x92b8e04cbf5f942b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f9432 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216979.245151:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216979.245153:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216979.245154:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782216979.245212:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b301180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:3647:x1868789713046784:12345-0@lo:103:ldlm_bl.0 Request processed in 560us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216979.245220:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1782216979.245232:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713046912 00000100:00100000:0.0:1782216979.245236:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713046912 00010000:00010000:0.0:1782216979.245319:0:8449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952e7b362400/0x92b8e04cbf5f9432 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f942b expref: 21 pid: 6511 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216979.245389:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1782216979.245396:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43dc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:3648:x1868789713046912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782216979.245407:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782216979.245411:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952e7b362400/0x92b8e04cbf5f9432 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f942b expref: 21 pid: 6511 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216979.245420:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952e7b362400/0x92b8e04cbf5f9432 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5f942b expref: 21 pid: 6511 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216979.245431:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e7b362400/0x92b8e04cbf5f9432 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5f942b expref: 21 pid: 6511 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216979.245440:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782216979.245489:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43dc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17bce19a-7a0f-4c9d-b31c-4e0155298487+20:3648:x1868789713046912:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216979.245496:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1782216979.245549:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17bce19a-7a0f-4c9d-b31c-4e0155298487:3648:1868789713046912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782216979.245699:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789713046784:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782216979.247246:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216979.247323:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693041664 00000100:00100000:0.0:1782216979.247329:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693041664 00010000:00010000:0.0:1782216979.247359:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952e7c448a00/0x92b8e04cbf5f9463 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9732bd expref: 13 pid: 6511 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216979.247394:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 44 00000100:00100000:0.0:1782216979.247403:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:2403:x1868789693041664:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782216979.247418:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782216979.247423:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952e7c448a00/0x92b8e04cbf5f9463 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9732bd expref: 13 pid: 6511 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216979.247450:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952e7c448a00/0x92b8e04cbf5f9463 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9732bd expref: 13 pid: 6511 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216979.247465:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782216979.247627:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:2403:x1868789693041664:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 224us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216979.247635:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 44 00000100:00100000:2.0:1782216979.247870:0:13186:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43311180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13186:1868789713045760:192.168.203.30@tcp:104: 00010000:00010000:2.0:1782216979.247887:0:13186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e7c448a00/0x92b8e04cbf5f9463 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9732bd expref: 12 pid: 6511 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216979.247898:0:13186:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43313480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13186:1868789713045888:192.168.203.30@tcp:104: 00010000:00010000:2.0:1782216979.247938:0:13186:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff952e413fd800/0x92b8e04cbf5f949b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216979.248893:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216979.248943:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693041536 00000100:00100000:0.0:1782216979.248950:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693041536 00010000:00010000:0.0:1782216979.248976:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952e40030a00/0x92b8e04cbf5f9478 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9732fc expref: 12 pid: 6511 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216979.249024:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 45 00000100:00100000:0.0:1782216979.249033:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e6f92e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+12:2402:x1868789693041536:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782216979.249044:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782216979.249049:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952e40030a00/0x92b8e04cbf5f9478 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9732fc expref: 12 pid: 6511 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216979.249060:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952e40030a00/0x92b8e04cbf5f9478 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9732fc expref: 12 pid: 6511 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216979.249074:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e40030a00/0x92b8e04cbf5f9478 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9732fc expref: 12 pid: 6511 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216979.249087:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff952e413fd800/0x92b8e04cbf5f949b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216979.249096:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e413fd800/0x92b8e04cbf5f949b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216979.249122:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff952e413fd800/0x92b8e04cbf5f949b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216979.249129:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff952e413fd800/0x92b8e04cbf5f949b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216979.249136:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff952e413fd800/0x92b8e04cbf5f949b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216979.249143:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff952e413fd800/0x92b8e04cbf5f949b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216979.249150:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e413fd800 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:0.0:1782216979.249155:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff952e413fd800/0x92b8e04cbf5f949b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216979.249162:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff952e413fd800/0x92b8e04cbf5f949b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216979.249183:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff952e413fd800/0x92b8e04cbf5f949b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216979.249192:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782216979.249228:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e6f92e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+11:2402:x1868789693041536:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 192us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216979.249235:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 45 00010000:00010000:2.0:1782216979.250040:0:13186:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff952e413fd800/0x92b8e04cbf5f949b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216979.250061:0:13186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff952e413fd800/0x92b8e04cbf5f949b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216979.250066:0:13186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e413fd800/0x92b8e04cbf5f949b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216979.519294:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43dc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713047040:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782216979.519363:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216979.519457:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713047040 00000100:00100000:2.0:1782216979.519464:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713047040 00000100:00100000:2.0:1782216979.519516:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1782216979.519525:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43dca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713047040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782216979.519567:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1782216979.519628:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43dca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713047040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216979.519635:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1782216979.519686:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43dc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713047040:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1782216979.960800:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782216980.798807:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216980.798905:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693041792 00000100:00100000:0.0:1782216980.798915:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693041792 00000100:00100000:0.0:1782216980.802654:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 316 00000100:00100000:0.0:1782216980.802699:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e43999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+11:6173:x1868789693041792:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782216980.802718:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782216980.802739:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e40031c00/0x92b8e04cbf5f94a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc65e7963be97332d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216980.802767:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e40031c00/0x92b8e04cbf5f94a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97332d expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216980.802778:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e40031c00/0x92b8e04cbf5f94a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97332d expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216980.802787:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e40031c00, rc 0) 00000100:00100000:0.0:1782216980.802857:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e43999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+12:6173:x1868789693041792:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 166us (4058us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216980.802864:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 316 00000100:00100000:1.0:1782216980.807228:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216980.812481:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693041920 00000100:00100000:0.0:1782216980.812497:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693041920 00000100:00100000:1.0:1782216980.816908:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 317 00000100:00100000:1.0:1782216980.816924:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e43999c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+12:6173:x1868789693041920:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782216980.817087:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e43999c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+12:6173:x1868789693041920:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 165us (9867us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216980.817094:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 317 00000100:00100000:0.0:1782216980.829793:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216980.832468:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693042048 00000100:00100000:1.0:1782216980.832481:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693042048 00000100:00100000:1.0:1782216980.833553:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 318 00000100:00100000:1.0:1782216980.833566:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e582c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+12:6173:x1868789693042048:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782216980.834397:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e582c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+12:6173:x1868789693042048:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 Request processed in 831us (4610us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216980.834406:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 318 00000100:00100000:0.0:1782216980.847794:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216980.848120:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693042176 00000100:00100000:1.0:1782216980.848131:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693042176 00000100:00100000:1.0:1782216980.848194:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 319 00000100:00100000:1.0:1782216980.848203:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e582c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+12:6173:x1868789693042176:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782216980.848219:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782216980.848235:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952d43072400/0x92b8e04cbf5f94a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc65e7963be973334 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216980.848372:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952d43072400/0x92b8e04cbf5f94a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973334 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216980.848383:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952d43072400/0x92b8e04cbf5f94a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973334 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216980.848392:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43072400, rc 0) 00000100:00100000:1.0:1782216980.848466:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e582c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:6173:x1868789693042176:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 263us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216980.848473:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 319 00000100:00100000:2.0:1782216980.859871:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216980.862612:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693042304 00000100:00100000:1.0:1782216980.862626:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693042304 00000100:00100000:2.0:1782216980.862911:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 320 00000100:00100000:2.0:1782216980.862923:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:6173:x1868789693042304:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782216980.863080:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:6173:x1868789693042304:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 159us (3217us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216980.863089:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 320 00000100:00100000:0.0:1782216980.865105:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216980.872643:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693042432 00000100:00100000:1.0:1782216980.872658:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693042432 00000100:00100000:1.0:1782216980.872730:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 321 00000100:00100000:1.0:1782216980.872739:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:6173:x1868789693042432:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782216980.872885:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:6173:x1868789693042432:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 Request processed in 146us (7787us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216980.872893:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 321 00010000:00010000:3.0:1782216980.988722:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782216980.998358:0:6516:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782216980.998367:0:6516:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff952e7dbbd800 from 7 10000000:01000000:1.0:1782216980.998372:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782216980.998417:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952d43073000/0x92b8e04cbf5f94b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216980.998431:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952d43073000/0x92b8e04cbf5f94b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216980.998442:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952d43073000/0x92b8e04cbf5f94b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216980.998465:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b302680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713047168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782216980.998527:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216980.998570:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e7b1a7300 going to sleep for 11 seconds 00000100:00100000:1.0:1782216980.998612:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713047168 00000100:00100000:1.0:1782216980.998618:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713047168 00000100:00100000:2.0:1782216980.999440:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1782216980.999452:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+20:6516:x1868789713047168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782216980.999472:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782216980.999485:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e413fd800/0x92b8e04cbf5f94b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f94b0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216980.999508:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e413fd800/0x92b8e04cbf5f94b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f94b0 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216980.999518:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e413fd800/0x92b8e04cbf5f94b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f94b0 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216980.999526:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e413fd800, rc 0) 00000100:00100000:2.0:1782216980.999578:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:6516:x1868789713047168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (1051us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216980.999614:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1782216981.000777:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b302680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713047168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782216981.000803:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952d43073000/0x92b8e04cbf5f94b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f94b7 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216981.000814:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952d43073000/0x92b8e04cbf5f94b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f94b7 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216981.000896:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43dc8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713047296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782216981.000942:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216981.000972:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e51fec180 going to sleep for 11 seconds 00000100:00100000:1.0:1782216981.001344:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713047296 00000100:00100000:1.0:1782216981.001353:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713047296 00000100:00100000:1.0:1782216981.001398:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1782216981.001407:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:6516:x1868789713047296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782216981.001519:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:6516:x1868789713047296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216981.001527:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1782216981.002564:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43dc8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713047296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782216981.002641:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43dc8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713047424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782216981.002711:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216981.002741:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e51fec180 going to sleep for 11 seconds 00000100:00100000:2.0:1782216981.002756:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713047424 00000100:00100000:2.0:1782216981.002761:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713047424 00000100:00100000:2.0:1782216981.002793:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1782216981.002801:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:6516:x1868789713047424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782216981.002894:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:6516:x1868789713047424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216981.002900:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1782216981.002943:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43dc8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713047424:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1782216981.011383:0:13264:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1782216981.011604:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1782216981.011632:0:6516:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782216981.011644:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952d43073000/0x92b8e04cbf5f94b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f94b7 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216981.011655:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952d43073000/0x92b8e04cbf5f94b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f94b7 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782216981.012345:0:6516:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782216981.012349:0:6516:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff952e74b5e800 from 7 10000000:01000000:2.0:1782216981.012353:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782216981.012391:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e413fda00/0x92b8e04cbf5f94be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216981.012401:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e413fda00/0x92b8e04cbf5f94be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216981.012411:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e413fda00/0x92b8e04cbf5f94be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216981.012448:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43dc8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713047552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782216981.012509:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216981.012545:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e51fec180 going to sleep for 11 seconds 00000100:00100000:2.0:1782216981.012568:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713047552 00000100:00100000:2.0:1782216981.012573:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713047552 00000100:00100000:2.0:1782216981.012771:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1782216981.012781:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:6516:x1868789713047552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782216981.012795:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782216981.012807:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e413fd600/0x92b8e04cbf5f94c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f94be expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216981.012828:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e413fd600/0x92b8e04cbf5f94c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f94be expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216981.012838:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e413fd600/0x92b8e04cbf5f94c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f94be expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216981.012847:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e413fd600, rc 0) 00000100:00100000:2.0:1782216981.012883:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+22:6516:x1868789713047552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216981.012890:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1782216981.018779:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43dc8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713047552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782216981.018807:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e413fda00/0x92b8e04cbf5f94be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f94c5 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216981.018820:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e413fda00/0x92b8e04cbf5f94be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f94c5 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216981.018901:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6d5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713047680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782216981.018959:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216981.018998:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e51fec180 going to sleep for 11 seconds 00000100:00100000:2.0:1782216981.019172:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713047680 00000100:00100000:2.0:1782216981.019179:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713047680 00000100:00100000:2.0:1782216981.020357:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1782216981.020367:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+22:6516:x1868789713047680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782216981.020519:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+22:6516:x1868789713047680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 153us (1558us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216981.020533:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1782216981.020650:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6d5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713047680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782216981.020926:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6d5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713047808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782216981.020971:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216981.021006:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e51fec180 going to sleep for 11 seconds 00000100:00100000:2.0:1782216981.021074:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713047808 00000100:00100000:2.0:1782216981.021080:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713047808 00000100:00100000:2.0:1782216981.021105:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1782216981.021112:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+22:6516:x1868789713047808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782216981.021208:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+22:6516:x1868789713047808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216981.021215:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1782216981.021500:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6d5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713047808:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1782216981.022476:0:13265:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1782216981.023034:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1782216981.023057:0:6516:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782216981.023067:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e413fda00/0x92b8e04cbf5f94be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f94c5 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216981.023078:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e413fda00/0x92b8e04cbf5f94be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f94c5 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782216981.023089:0:6516:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782216981.023092:0:6516:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff952e7b38d800 from 7 10000000:01000000:2.0:1782216981.023094:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782216981.023129:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e413fc400/0x92b8e04cbf5f94cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216981.023137:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e413fc400/0x92b8e04cbf5f94cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216981.023146:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e413fc400/0x92b8e04cbf5f94cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216981.023182:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43dcad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713047936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782216981.023251:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216981.023289:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e6fad8240 going to sleep for 11 seconds 00000100:00100000:1.0:1782216981.023392:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713047936 00000100:00100000:1.0:1782216981.023399:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713047936 00000100:00100000:1.0:1782216981.023447:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1782216981.023456:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+22:6516:x1868789713047936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782216981.023468:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782216981.023481:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952d43073600/0x92b8e04cbf5f94d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f94cc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216981.023502:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952d43073600/0x92b8e04cbf5f94d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f94cc expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216981.023512:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952d43073600/0x92b8e04cbf5f94d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f94cc expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216981.023521:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43073600, rc 0) 00000100:00100000:1.0:1782216981.023558:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:6516:x1868789713047936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216981.023565:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1782216981.023914:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43dcad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713047936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782216981.023929:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e413fc400/0x92b8e04cbf5f94cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f94d3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216981.023937:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e413fc400/0x92b8e04cbf5f94cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f94d3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216981.023993:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43dcad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713048064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782216981.024020:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216981.024040:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e6fad8240 going to sleep for 11 seconds 00000100:00100000:2.0:1782216981.024052:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713048064 00000100:00100000:2.0:1782216981.024055:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713048064 00000100:00100000:2.0:1782216981.024088:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1782216981.024095:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:6516:x1868789713048064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782216981.024203:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:6516:x1868789713048064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216981.024210:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1782216981.024339:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43dcad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713048064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782216981.024369:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43dcad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713048192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782216981.024407:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216981.024430:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e51f75d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782216981.024485:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713048192 00000100:00100000:3.0:1782216981.024490:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713048192 00000100:00100000:3.0:1782216981.024521:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1782216981.024528:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52589850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:6516:x1868789713048192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782216981.024794:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52589850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:6516:x1868789713048192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 265us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216981.024802:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1782216981.024885:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43dcad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713048192:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1782216981.026476:0:13266:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1782216981.026758:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1782216981.026790:0:6516:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782216981.026801:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e413fc400/0x92b8e04cbf5f94cc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f94d3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216981.026812:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e413fc400/0x92b8e04cbf5f94cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f94d3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782216981.026822:0:6516:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782216981.026824:0:6516:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff952e70905800 from 7 10000000:01000000:2.0:1782216981.026827:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782216981.026862:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7c448a00/0x92b8e04cbf5f94da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216981.026871:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e7c448a00/0x92b8e04cbf5f94da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216981.026881:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e7c448a00/0x92b8e04cbf5f94da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216981.026901:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43dcad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713048320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782216981.026961:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216981.027343:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e51f75d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782216981.028768:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713048320 00000100:00100000:1.0:1782216981.028780:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713048320 00000100:00100000:1.0:1782216981.028839:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1782216981.028850:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52588c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:6516:x1868789713048320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782216981.028873:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782216981.028891:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952d43073e00/0x92b8e04cbf5f94e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f94da expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216981.028917:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952d43073e00/0x92b8e04cbf5f94e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f94da expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216981.028928:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952d43073e00/0x92b8e04cbf5f94e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f94da expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216981.028938:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43073e00, rc 0) 00000100:00100000:1.0:1782216981.029004:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52588c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:6516:x1868789713048320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (2043us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216981.029013:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1782216981.032309:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43dcad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713048320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782216981.032339:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e7c448a00/0x92b8e04cbf5f94da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f94e1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216981.032351:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e7c448a00/0x92b8e04cbf5f94da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f94e1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216981.032431:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43dcad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713048448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782216981.032494:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216981.032537:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e51f75d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782216981.032627:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713048448 00000100:00100000:3.0:1782216981.032635:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713048448 00000100:00100000:3.0:1782216981.032925:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1782216981.032935:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52589450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:6516:x1868789713048448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782216981.033059:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52589450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:6516:x1868789713048448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216981.033067:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1782216981.033107:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43dcad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713048448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782216981.033139:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6d5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713048576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782216981.033191:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216981.033211:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e51f28e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782216981.033223:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713048576 00000100:00100000:3.0:1782216981.033227:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713048576 00000100:00100000:3.0:1782216981.033258:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1782216981.033265:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52589050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:6516:x1868789713048576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782216981.033344:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52589050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:6516:x1868789713048576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216981.033351:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1782216981.033390:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6d5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713048576:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1782216981.034533:0:13267:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1782216981.034830:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1782216981.034850:0:6516:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782216981.034860:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7c448a00/0x92b8e04cbf5f94da lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f94e1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216981.034871:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e7c448a00/0x92b8e04cbf5f94da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f94e1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216982.014603:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216983.032829:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782216983.096897:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713048704:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782216983.096972:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216983.097087:0:10535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713048704 00000100:00100000:1.0:1782216983.097095:0:10535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713048704 00000100:00100000:1.0:1782216983.097167:0:10535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1782216983.097178:0:10535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c673b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713048704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782216983.097206:0:10535:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1782216983.097305:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782216983.097580:0:10535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c673b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713048704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 404us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216983.097602:0:10535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1782216983.097626:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789713048832:0@lo:400:kworker.0 00000100:00100000:1.0:1782216983.097666:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216983.097691:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782216983.097698:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1868789713048960:0@lo:400:kworker.0 00000100:00100000:1.0:1782216983.097747:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216983.097775:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713048832 00000100:00100000:1.0:1782216983.097780:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713048832 00000100:00100000:1.0:1782216983.097807:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1782216983.097815:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3647:x1868789713048832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216983.097848:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3647:x1868789713048832:12345-0@lo:400:kworker.0 Request processed in 34us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216983.097855:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1782216983.097879:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713048960 00000100:00100000:1.0:1782216983.097882:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713048960 00000100:00100000:1.0:1782216983.097904:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1782216983.097909:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b300700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1868789713048960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216983.097934:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b300700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1868789713048960:12345-0@lo:400:kworker.0 Request processed in 25us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216983.097939:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1782216983.097970:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1868789713048960:0@lo:400:kworker.0 00000100:00100000:1.0:1782216983.097977:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789713048832:0@lo:400:kworker.0 00000100:00100000:1.0:1782216983.099122:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713049344:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782216983.099180:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216983.099448:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782216983.099457:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b300e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713049472:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782216983.099482:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216983.099508:0:10535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713049344 00000100:00100000:1.0:1782216983.099513:0:10535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713049344 00000100:00100000:1.0:1782216983.099552:0:10535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713049472 00000100:00100000:1.0:1782216983.099556:0:10535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713049472 00000100:00100000:1.0:1782216983.099604:0:10535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1782216983.099613:0:10535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b301c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713049344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782216983.099636:0:10535:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782216983.099683:0:10535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b301c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713049344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216983.099690:0:10535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1782216983.099704:0:10535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1782216983.099710:0:10535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b303800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713049472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782216983.099732:0:10535:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782216983.099758:0:10535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b303800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713049472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216983.099764:0:10535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:1.0:1782216983.099795:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7b300e00 x1868789713049472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216999 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216983.099811:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b300e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713049472:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1782216983.099822:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7b302d80 x1868789713049344/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216999 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216983.099831:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713049344:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782216983.100177:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41bf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1868789713049984:0@lo:400:kworker.0 00000100:00100000:3.0:1782216983.100220:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216983.100245:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1782216983.100250:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1868789713049856:0@lo:400:kworker.0 00000100:00100000:3.0:1782216983.100268:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216983.100279:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41bf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713050368:0@lo:400:kworker.0 00000100:00100000:3.0:1782216983.100296:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216983.100318:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713049088:0@lo:400:kworker.0 00000100:00100000:3.0:1782216983.100339:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216983.100356:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1868789713049600:0@lo:400:kworker.0 00000100:00100000:3.0:1782216983.100377:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216983.100393:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41bf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1868789713050112:0@lo:400:kworker.0 00000100:00100000:3.0:1782216983.100412:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216983.100440:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1782216983.100446:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43dca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713049216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782216983.100467:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216983.100484:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713049728:0@lo:400:kworker.0 00000100:00100000:3.0:1782216983.100504:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216983.100521:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41bfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1868789713050240:0@lo:400:kworker.0 00000100:00100000:3.0:1782216983.100541:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216983.100562:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713049216 00000100:00100000:3.0:1782216983.100566:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713049216 00000100:00100000:3.0:1782216983.100613:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1782216983.100621:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42612d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713049216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782216983.100633:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782216983.100675:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42612d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713049216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216983.100681:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1782216983.100700:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713049984 00000100:00100000:3.0:1782216983.100704:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713049984 00000100:00100000:3.0:1782216983.100959:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713049856 00000100:00100000:3.0:1782216983.100963:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713049856 00000100:00100000:3.0:1782216983.100980:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713049600 00000100:00100000:3.0:1782216983.100982:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713049600 00000100:00100000:3.0:1782216983.100993:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713050112 00000100:00100000:3.0:1782216983.100995:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713050112 00000100:00100000:3.0:1782216983.101008:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713050240 00000100:00100000:3.0:1782216983.101010:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713050240 00000100:00100000:3.0:1782216983.101025:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1782216983.101031:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1868789713049984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216983.101070:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1868789713049984:12345-0@lo:400:kworker.0 Request processed in 39us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216983.101085:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1782216983.101099:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1782216983.101106:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1868789713049856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216983.101136:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1868789713049856:12345-0@lo:400:kworker.0 Request processed in 31us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216983.101142:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1782216983.101167:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1782216983.101173:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1868789713049600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216983.101201:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1868789713049600:12345-0@lo:400:kworker.0 Request processed in 29us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216983.101370:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1782216983.101384:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1782216983.101390:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1868789713050112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216983.101419:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1868789713050112:12345-0@lo:400:kworker.0 Request processed in 30us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216983.101425:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1782216983.101435:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1782216983.101439:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1868789713050240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216983.101461:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1868789713050240:12345-0@lo:400:kworker.0 Request processed in 22us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216983.101466:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1782216983.101486:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713049088 00000100:00100000:3.0:1782216983.101489:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713049088 00000100:00100000:3.0:1782216983.101509:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713049728 00000100:00100000:3.0:1782216983.101512:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713049728 00000100:00100000:3.0:1782216983.101535:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1782216983.101540:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713049088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216983.101571:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713049088:12345-0@lo:400:kworker.0 Request processed in 30us (1231us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216983.101576:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1782216983.101605:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1782216983.101610:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42612a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713049728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216983.101631:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42612a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713049728:12345-0@lo:400:kworker.0 Request processed in 22us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216983.101636:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00010000:00080000:3.0:1782216983.101940:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43dca680 x1868789713049216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216999 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216983.101959:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43dca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713049216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782216983.101972:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713049728:0@lo:400:kworker.0 00010000:00080000:3.0:1782216983.101981:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d41bfa300 x1868789713050240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216983.101989:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41bfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1868789713050240:0@lo:400:kworker.0 00000100:00100000:3.0:1782216983.101999:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713049088:0@lo:400:kworker.0 00000100:00100000:3.0:1782216983.102008:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1868789713049600:0@lo:400:kworker.0 00000100:00100000:3.0:1782216983.102017:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41bf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1868789713050112:0@lo:400:kworker.0 00000100:00100000:3.0:1782216983.102056:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1868789713049856:0@lo:400:kworker.0 00010000:00080000:3.0:1782216983.102068:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d41bf9500 x1868789713049984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782216999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216983.102092:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41bf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1868789713049984:0@lo:400:kworker.0 00000100:00080000:1.0:1782216983.105129:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782216983.105138:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782216983.105141:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782216983.105153:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1782216983.105244:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7b303b80 x1868789713048704/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782216999 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216983.105267:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713048704:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782216983.105317:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713050368 00000100:00100000:0.0:1782216983.105324:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713050368 00000100:00100000:0.0:1782216983.105374:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1782216983.105383:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713050368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216983.105463:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713050368:12345-0@lo:400:kworker.0 Request processed in 81us (5164us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216983.105471:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:0.0:1782216983.105508:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d41bf8380 x1868789713050368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782216999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216983.105518:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41bf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713050368:0@lo:400:kworker.0 00000100:00100000:0.0:1782216983.486077:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216983.486120:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216983.486164:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216983.486185:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216983.486203:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216983.486236:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693042688 00000100:00100000:0.0:1782216983.486244:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693042688 00000100:00100000:0.0:1782216983.486293:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693042944 00000100:00100000:0.0:1782216983.486297:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693042944 00000100:00100000:0.0:1782216983.486310:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693042816 00000100:00100000:0.0:1782216983.486312:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693042816 00000100:00100000:0.0:1782216983.486323:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693043072 00000100:00100000:0.0:1782216983.486325:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693043072 00000100:00100000:0.0:1782216983.486339:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 207 00000100:00100000:0.0:1782216983.486347:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c672d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+6:2402:x1868789693042688:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782216983.486410:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c672d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+6:2402:x1868789693042688:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 64us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216983.486430:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 207 00000100:00100000:0.0:1782216983.486445:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 208 00000100:00100000:0.0:1782216983.486451:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c670000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a927f5f6-9735-45e0-abce-963bd125e020+5:2402:x1868789693042944:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782216983.486473:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c670000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a927f5f6-9735-45e0-abce-963bd125e020+5:2402:x1868789693042944:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 22us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216983.486478:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 208 00000100:00100000:0.0:1782216983.486488:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 209 00000100:00100000:0.0:1782216983.486493:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c670a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+5:2402:x1868789693042816:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782216983.486510:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c670a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+5:2402:x1868789693042816:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 17us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216983.486515:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 209 00000100:00100000:0.0:1782216983.486523:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 210 00000100:00100000:0.0:1782216983.486528:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c671f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a927f5f6-9735-45e0-abce-963bd125e020+5:2402:x1868789693043072:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782216983.486543:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c671f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a927f5f6-9735-45e0-abce-963bd125e020+5:2402:x1868789693043072:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 15us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216983.486548:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 210 00000100:00100000:0.0:1782216983.486563:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693042560 00000100:00100000:0.0:1782216983.486566:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693042560 00000100:00100000:0.0:1782216983.486613:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 335 00000100:00100000:0.0:1782216983.486620:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:2402:x1868789693042560:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782216983.486655:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:2402:x1868789693042560:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 36us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216983.486661:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 335 00000100:00080000:1.0:1782216983.487453:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782216983.487459:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782216983.609370:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713050496:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782216983.609436:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216983.609499:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713050496 00000100:00100000:3.0:1782216983.609506:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713050496 00000100:00100000:3.0:1782216983.609543:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1782216983.609551:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713050496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1782216983.609609:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1782216983.609665:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713050496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216983.609673:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1782216983.609724:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713050496:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1782216983.702463:0:13384:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1782216984.056742:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782216984.635239:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782216984.635259:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713050624:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782216984.635326:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216984.635394:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713050624 00000100:00100000:3.0:1782216984.635402:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713050624 00000100:00100000:3.0:1782216984.635441:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1782216984.635449:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713050624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782216984.635483:0:7938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1782216984.635524:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713050624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216984.635531:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1782216984.635571:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713050624:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1782216985.080989:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216986.104808:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782216987.128703:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782216988.152809:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782216988.218634:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713050880:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782216988.218703:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216988.218784:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713050880 00000100:00100000:0.0:1782216988.218791:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713050880 00000100:00100000:0.0:1782216988.218843:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1782216988.218852:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713050880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782216988.218882:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782216988.218922:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713050880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216988.218929:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:0.0:1782216988.218950:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782216988.218975:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e46da7800 x1868789713050880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782217004 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216988.218993:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713050880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782216988.219387:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713050752:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782216988.219422:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216988.219455:0:10535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713050752 00000100:00100000:3.0:1782216988.219459:0:10535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713050752 00000100:00100000:3.0:1782216988.219484:0:10535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1782216988.219492:0:10535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42611f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713050752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782216988.219515:0:10535:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782216988.219548:0:10535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42611f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713050752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216988.219554:0:10535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:3.0:1782216988.219578:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7b302d80 x1868789713050752/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782217004 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216988.219621:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713050752:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782216988.219735:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1868789713051264:0@lo:400:kworker.0 00000100:00100000:3.0:1782216988.219763:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216988.219783:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42611180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1868789713051776:0@lo:400:kworker.0 00000100:00100000:3.0:1782216988.219804:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216988.219821:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41bf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1868789713052288:0@lo:400:kworker.0 00000100:00100000:3.0:1782216988.219840:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216988.219854:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1782216988.219859:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17bce19a-7a0f-4c9d-b31c-4e0155298487:3650:1868789713051136:0@lo:400:kworker.0 00000100:00100000:3.0:1782216988.219882:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216988.219899:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713051648:0@lo:400:kworker.0 00000100:00100000:3.0:1782216988.219940:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216988.219961:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1868789713052160:0@lo:400:kworker.0 00000100:00100000:3.0:1782216988.219985:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216988.220013:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713051648 00000100:00100000:3.0:1782216988.220019:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713051648 00000100:00100000:3.0:1782216988.220073:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1782216988.220079:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713051648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216988.220125:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713051648:12345-0@lo:400:kworker.0 Request processed in 46us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216988.220131:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1782216988.220158:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713051648:0@lo:400:kworker.0 00000100:00100000:1.0:1782216988.220429:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713051136 00000100:00100000:1.0:1782216988.220433:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713051136 00000100:00100000:1.0:1782216988.220476:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1782216988.220483:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3650:x1868789713051136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216988.220521:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3650:x1868789713051136:12345-0@lo:400:kworker.0 Request processed in 38us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216988.220527:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1782216988.220554:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713051264 00000100:00100000:1.0:1782216988.220557:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713051264 00000100:00100000:1.0:1782216988.220574:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713051776 00000100:00100000:1.0:1782216988.220576:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713051776 00000100:00100000:1.0:1782216988.220622:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713052288 00000100:00100000:1.0:1782216988.220625:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713052288 00000100:00100000:1.0:1782216988.220636:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713052160 00000100:00100000:1.0:1782216988.220638:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713052160 00000100:00100000:1.0:1782216988.220650:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1782216988.220655:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1868789713051264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216988.220683:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1868789713051264:12345-0@lo:400:kworker.0 Request processed in 27us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216988.220689:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1782216988.220700:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1782216988.220705:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1868789713051776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216988.220727:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1868789713051776:12345-0@lo:400:kworker.0 Request processed in 23us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216988.220732:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1782216988.220742:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1782216988.220747:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1868789713052288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216988.220768:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1868789713052288:12345-0@lo:400:kworker.0 Request processed in 21us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216988.220783:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1782216988.220793:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1782216988.220797:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1868789713052160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216988.220819:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1868789713052160:12345-0@lo:400:kworker.0 Request processed in 22us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216988.220824:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1782216988.220843:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17bce19a-7a0f-4c9d-b31c-4e0155298487:3650:1868789713051136:0@lo:400:kworker.0 00000100:00100000:1.0:1782216988.220852:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1868789713052160:0@lo:400:kworker.0 00000100:00100000:1.0:1782216988.220860:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1868789713051264:0@lo:400:kworker.0 00000100:00100000:1.0:1782216988.220867:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42611180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1868789713051776:0@lo:400:kworker.0 00010000:00080000:1.0:1782216988.220877:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d41bf8380 x1868789713052288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782216988.220887:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41bf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1868789713052288:0@lo:400:kworker.0 00000100:00100000:0.0:1782216988.221034:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b300e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713051008:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782216988.221062:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216988.221085:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1868789713051520:0@lo:400:kworker.0 00000100:00100000:0.0:1782216988.221102:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216988.221126:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42611880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713052032:0@lo:400:kworker.0 00000100:00100000:0.0:1782216988.221144:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216988.221156:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b301500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713052544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782216988.221180:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216988.221203:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1782216988.221210:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42610a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713051392:0@lo:400:kworker.0 00000100:00100000:0.0:1782216988.221230:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216988.221244:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42610000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1868789713051904:0@lo:400:kworker.0 00000100:00100000:0.0:1782216988.221259:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216988.221269:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41bf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713052416:0@lo:400:kworker.0 00000100:00100000:0.0:1782216988.221284:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216988.221304:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713052032 00000100:00100000:0.0:1782216988.221307:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713052032 00000100:00100000:0.0:1782216988.221329:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713052416 00000100:00100000:0.0:1782216988.221331:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713052416 00000100:00100000:0.0:1782216988.221346:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1782216988.221351:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713052032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216988.221378:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713052032:12345-0@lo:400:kworker.0 Request processed in 27us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216988.221384:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1782216988.221394:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1782216988.221398:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4268c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713052416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216988.221417:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4268c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713052416:12345-0@lo:400:kworker.0 Request processed in 18us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216988.221422:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1782216988.221435:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713051392 00000100:00100000:0.0:1782216988.221437:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713051392 00000100:00100000:0.0:1782216988.221455:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1782216988.221459:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713051392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216988.221492:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713051392:12345-0@lo:400:kworker.0 Request processed in 33us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216988.221498:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:0.0:1782216988.221516:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782216988.221519:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782216988.221521:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782216988.221523:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782216988.221530:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713051520 00000100:00100000:0.0:1782216988.221532:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713051520 00000100:00100000:0.0:1782216988.221546:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713051904 00000100:00100000:0.0:1782216988.221548:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713051904 00000100:00100000:0.0:1782216988.221562:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1782216988.221566:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1868789713051520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782216988.221789:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713051008 00000100:00100000:1.0:1782216988.221793:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713051008 00000100:00100000:1.0:1782216988.221807:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713052544 00000100:00100000:1.0:1782216988.221809:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713052544 00000100:00100000:1.0:1782216988.221818:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1782216988.221823:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713051008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782216988.221835:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782216988.221860:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713051008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 37us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216988.221866:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1782216988.221881:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1782216988.221886:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713052544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782216988.221896:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782216988.221915:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713052544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 29us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216988.221920:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1782216988.221959:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1868789713051520:12345-0@lo:400:kworker.0 Request processed in 43us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216988.221966:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1782216988.221977:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1782216988.221983:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1868789713051904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216988.222006:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1868789713051904:12345-0@lo:400:kworker.0 Request processed in 24us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216988.222011:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00080000:0.0:1782216988.222035:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782216988.222065:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42610a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713051392:0@lo:400:kworker.0 00010000:00080000:0.0:1782216988.222075:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d42610000 x1868789713051904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216988.222084:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42610000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1868789713051904:0@lo:400:kworker.0 00010000:00080000:0.0:1782216988.222101:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d41bf9500 x1868789713052416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782217004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216988.222119:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41bf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713052416:0@lo:400:kworker.0 00010000:00080000:0.0:1782216988.222128:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7b300e00 x1868789713051008/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782217004 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216988.222140:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b300e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713051008:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782216988.222148:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1868789713051520:0@lo:400:kworker.0 00010000:00080000:0.0:1782216988.222155:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d42611880 x1868789713052032/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782217004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216988.222163:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42611880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713052032:0@lo:400:kworker.0 00010000:00080000:0.0:1782216988.222170:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7b301500 x1868789713052544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782217004 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216988.222179:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b301500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713052544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782216988.607540:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216988.607609:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216988.607647:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216988.607672:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216988.607692:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216988.607721:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693043200 00000100:00100000:2.0:1782216988.607731:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693043200 00000100:00100000:2.0:1782216988.607782:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 337 00000100:00100000:2.0:1782216988.607793:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52588050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:2404:x1868789693043200:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1782216988.607862:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52588050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:2404:x1868789693043200:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 71us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216988.607870:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 337 00000100:00100000:0.0:1782216988.610755:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693043328 00000100:00100000:0.0:1782216988.610768:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693043328 00000100:00100000:0.0:1782216988.610828:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693043584 00000100:00100000:0.0:1782216988.610832:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693043584 00000100:00100000:0.0:1782216988.610846:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693043456 00000100:00100000:0.0:1782216988.610848:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693043456 00000100:00100000:0.0:1782216988.610860:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693043712 00000100:00100000:0.0:1782216988.610862:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693043712 00000100:00100000:0.0:1782216988.610881:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 217 00000100:00100000:0.0:1782216988.610890:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43dcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+6:2404:x1868789693043328:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782216988.610961:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43dcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+6:2404:x1868789693043328:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 71us (3430us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216988.610975:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 217 00000100:00100000:0.0:1782216988.610993:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 218 00000100:00100000:0.0:1782216988.610999:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43dc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a927f5f6-9735-45e0-abce-963bd125e020+5:2404:x1868789693043584:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782216988.611027:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43dc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a927f5f6-9735-45e0-abce-963bd125e020+5:2404:x1868789693043584:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 28us (3444us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216988.611032:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 218 00000100:00100000:0.0:1782216988.611043:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 219 00000100:00100000:0.0:1782216988.611049:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+5:2404:x1868789693043456:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782216988.611072:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+5:2404:x1868789693043456:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 23us (3399us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216988.611078:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 219 00000100:00100000:0.0:1782216988.611089:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 220 00000100:00100000:0.0:1782216988.611096:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43dc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a927f5f6-9735-45e0-abce-963bd125e020+5:2404:x1868789693043712:12345-192.168.203.30@tcp:400:kworker.0 00000100:00080000:1.0:1782216988.611118:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782216988.611124:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782216988.611140:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43dc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a927f5f6-9735-45e0-abce-963bd125e020+5:2404:x1868789693043712:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 43us (3445us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216988.611147:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 220 00000100:00100000:0.0:1782216988.729115:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713052672:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782216988.729180:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216988.729510:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713052672 00000100:00100000:1.0:1782216988.729518:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713052672 00000100:00100000:1.0:1782216988.729566:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1782216988.729575:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43315c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713052672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782216988.729703:0:7938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1782216988.734888:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43315c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713052672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5305us (5698us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216988.734903:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1782216988.735115:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713052672:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1782216988.764468:0:13533:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 08:16:27 (1782216987) === 00010000:00010000:3.0:1782216989.177005:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782216989.199117:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216989.199174:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216989.199330:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693043840 00000100:00100000:2.0:1782216989.199340:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693043840 00000100:00100000:2.0:1782216989.199395:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 22 00000100:00100000:2.0:1782216989.199405:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52f7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+6:2403:x1868789693043840:12345-192.168.203.30@tcp:41:mkdir.0 00000004:00000024:2.0:1782216989.199441:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1782216989.199520:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52f7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+6:2403:x1868789693043840:12345-192.168.203.30@tcp:41:mkdir.0 Request processed in 116us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216989.199527:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 22 00000100:00100000:1.0:1782216989.199621:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693043968 00000100:00100000:1.0:1782216989.199626:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693043968 00000100:00100000:1.0:1782216989.199663:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2 00000100:00100000:1.0:1782216989.199671:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52f7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:24a87249-c61f-41a1-85ec-9a313129e739+6:10493:x1868789693043968:12345-192.168.203.30@tcp:700:mkdir.0 00000100:00100000:1.0:1782216989.199705:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52f7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:24a87249-c61f-41a1-85ec-9a313129e739+6:10493:x1868789693043968:12345-192.168.203.30@tcp:700:mkdir.0 Request processed in 36us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216989.199713:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2 00000100:00100000:0.0:1782216989.201775:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216989.201886:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693044224 00000100:00100000:2.0:1782216989.201894:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693044224 00000100:00100000:2.0:1782216989.201958:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 23 00000100:00100000:2.0:1782216989.201967:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52f7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+6:10493:x1868789693044224:12345-192.168.203.30@tcp:36:mkdir.0 00010000:00010000:2.0:1782216989.202016:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782216989.202042:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7c448800/0x92b8e04cbf5f938a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9732a8 expref: 6 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.202060:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952e46d75300) 00010000:00010000:2.0:1782216989.202116:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782216989.202210:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7c448c00/0x92b8e04cbf5f94e8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.202224:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7c448c00/0x92b8e04cbf5f94e8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.202233:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7c448c00/0x92b8e04cbf5f94e8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.202245:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7c449a00/0x92b8e04cbf5f94ef lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.202251:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7c449a00/0x92b8e04cbf5f94ef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.202258:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7c449a00/0x92b8e04cbf5f94ef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.202761:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7c448000/0x92b8e04cbf5f94f6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.202771:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7c448000/0x92b8e04cbf5f94f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.202787:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7c448000/0x92b8e04cbf5f94f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782216989.202802:0:6518:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002f950366 reply state 000000007399cef6 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff952e7c448000/0x92b8e04cbf5f94f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.202812:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7c448000/0x92b8e04cbf5f94f6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.202819:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff952d410a7b00) 00010000:00010000:2.0:1782216989.202821:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1782216989.202824:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1782216989.202828:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1782216989.202834:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7c448c00/0x92b8e04cbf5f94e8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.202840:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7c448c00/0x92b8e04cbf5f94e8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.202847:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7c448c00/0x92b8e04cbf5f94e8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.202852:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7c448c00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782216989.202856:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7c448c00/0x92b8e04cbf5f94e8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.202862:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7c448c00/0x92b8e04cbf5f94e8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.202870:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d410a7a00) 00010000:00010000:2.0:1782216989.202872:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782216989.202882:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7c448c00/0x92b8e04cbf5f94e8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.202888:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7c448c00/0x92b8e04cbf5f94e8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782216989.202902:0:6518:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002f950366 reply state 000000007399cef6 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff952e7c449a00/0x92b8e04cbf5f94ef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.202910:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7c449a00/0x92b8e04cbf5f94ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.202915:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff952d410a7e00) 00010000:00010000:2.0:1782216989.202917:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1782216989.202919:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1782216989.202983:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52f7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+7:10493:x1868789693044224:12345-192.168.203.30@tcp:36:mkdir.0 Request processed in 1016us (1214us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1782216989.202991:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 23 00000100:00100000:3.0:1782216989.212953:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216989.213031:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693044352 00000100:00100000:2.0:1782216989.213041:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693044352 00000100:00100000:2.0:1782216989.213096:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 24 00000100:00100000:2.0:1782216989.213114:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+7:10496:x1868789693044352:12345-192.168.203.30@tcp:101:chmod.0 00010000:00010000:2.0:1782216989.213134:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782216989.213155:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7c448800/0x92b8e04cbf5f94fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be97333b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.213257:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f9504 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.213270:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f9504 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.213290:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f9504 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782216989.213332:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1782216989.213336:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782216989.213367:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f9504 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.213392:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7c448800/0x92b8e04cbf5f94fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97333b expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.213409:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f9504 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97333b expref: 8 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.213417:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d410a7f00) 00010000:00010000:2.0:1782216989.213420:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782216989.213423:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2c600, rc 0) 00000100:00100000:2.0:1782216989.213487:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+8:10496:x1868789693044352:12345-192.168.203.30@tcp:101:chmod.0 Request processed in 373us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216989.213493:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 24 00000100:00100000:1.0:1782216989.224972:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216989.225072:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693044608 00000100:00100000:2.0:1782216989.225082:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693044608 00000100:00100000:2.0:1782216989.225431:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 25 00000100:00100000:2.0:1782216989.225439:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+8:10496:x1868789693044608:12345-192.168.203.30@tcp:36:chmod.0 00010000:00010000:2.0:1782216989.225482:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782216989.225502:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f9504 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97333b expref: 8 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.225531:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d410a7f00) 00010000:00010000:2.0:1782216989.225540:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782216989.225563:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f950b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.225575:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f950b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.225779:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f950b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782216989.226040:0:6518:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cf3ae523 reply state 0000000007a2f850 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f950b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216989.226065:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f950b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216989.226072:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d410a7a00) 00010000:00010000:1.0:1782216989.226075:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1782216989.226078:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1782216989.226085:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1782216989.226177:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+9:10496:x1868789693044608:12345-192.168.203.30@tcp:36:chmod.0 Request processed in 736us (1211us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1782216989.226185:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 25 00000100:00100000:1.0:1782216989.260856:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216989.260954:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693044736 00000100:00100000:2.0:1782216989.260963:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693044736 00000100:00100000:2.0:1782216989.261013:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 26 00000100:00100000:2.0:1782216989.261023:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b301500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+9:10499:x1868789693044736:12345-192.168.203.30@tcp:101:chown.0 00010000:00010000:2.0:1782216989.261045:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782216989.261063:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f9512 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973342 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.261132:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9519 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.261145:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9519 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.261155:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9519 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782216989.261213:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1782216989.261230:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782216989.261263:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9519 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.261286:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f9512 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973342 expref: 11 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.261301:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9519 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973342 expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.261309:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d410a7a00) 00010000:00010000:2.0:1782216989.261312:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782216989.261314:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2d800, rc 0) 00000100:00100000:2.0:1782216989.261367:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b301500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+10:10499:x1868789693044736:12345-192.168.203.30@tcp:101:chown.0 Request processed in 345us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216989.261374:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 26 00000100:00100000:2.0:1782216989.269420:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216989.269517:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693044864 00000100:00100000:0.0:1782216989.269527:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693044864 00000100:00100000:1.0:1782216989.269726:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 27 00000100:00100000:1.0:1782216989.269739:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43dc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+10:10499:x1868789693044864:12345-192.168.203.30@tcp:101:chown.0 00010000:00010000:1.0:1782216989.269760:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782216989.269783:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9520 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973349 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216989.269844:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9527 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216989.269858:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9527 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216989.269869:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9527 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216989.269879:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072000/0x92b8e04cbf5f952e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216989.269903:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072000/0x92b8e04cbf5f952e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216989.269910:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072000/0x92b8e04cbf5f952e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216989.269985:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5f9535 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216989.269994:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5f9535 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216989.270000:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5f9535 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782216989.270039:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1782216989.270043:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782216989.270060:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5f9535 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216989.270071:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9527 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216989.270077:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9527 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216989.270083:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9527 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216989.270089:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43072600 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782216989.270093:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9527 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216989.270116:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9527 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216989.270132:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d410a7a00) 00010000:00010000:1.0:1782216989.270136:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782216989.270140:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9527 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216989.270146:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9527 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216989.270160:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072000/0x92b8e04cbf5f952e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216989.270166:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072000/0x92b8e04cbf5f952e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216989.270172:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072000/0x92b8e04cbf5f952e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216989.270177:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43072000 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782216989.270180:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072000/0x92b8e04cbf5f952e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216989.270185:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072000/0x92b8e04cbf5f952e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216989.270191:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff952d410a7e00) 00010000:00010000:1.0:1782216989.270194:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782216989.270196:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072000/0x92b8e04cbf5f952e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216989.270556:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072000/0x92b8e04cbf5f952e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216989.270631:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9520 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973349 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216989.270645:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5f9535 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973349 expref: 11 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216989.270652:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff952d410a7b00) 00010000:00010000:1.0:1782216989.270655:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782216989.270657:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43073800, rc 0) 00000100:00100000:1.0:1782216989.270716:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43dc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+11:10499:x1868789693044864:12345-192.168.203.30@tcp:101:chown.0 Request processed in 980us (1304us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216989.270724:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 27 00000100:00100000:1.0:1782216989.273898:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216989.273992:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693044992 00000100:00100000:2.0:1782216989.274001:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693044992 00000100:00100000:2.0:1782216989.274090:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6 00000100:00100000:2.0:1782216989.274109:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b300e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:24a87249-c61f-41a1-85ec-9a313129e739+11:10499:x1868789693044992:12345-192.168.203.30@tcp:900:chown.0 00000100:00100000:2.0:1782216989.274191:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b300e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:24a87249-c61f-41a1-85ec-9a313129e739+11:10499:x1868789693044992:12345-192.168.203.30@tcp:900:chown.0 Request processed in 92us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216989.274199:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6 00000100:00100000:0.0:1782216989.277171:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216989.277365:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693045248 00000100:00100000:2.0:1782216989.277375:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693045248 00000100:00100000:2.0:1782216989.277434:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 28 00000100:00100000:2.0:1782216989.277443:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52f7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+11:10499:x1868789693045248:12345-192.168.203.30@tcp:36:chown.0 00010000:00010000:2.0:1782216989.277507:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782216989.277750:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5f9535 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973349 expref: 11 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.277770:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff952d410a7b00) 00010000:00010000:2.0:1782216989.277775:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782216989.277800:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f953c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.277812:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f953c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.277822:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f953c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782216989.287645:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:0.0:1782216989.287789:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7c449a00/0x92b8e04cbf5f94ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.287801:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7c449a00/0x92b8e04cbf5f94ef lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.287809:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7c449a00/0x92b8e04cbf5f94ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.287816:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7c449a00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782216989.287820:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7c449a00/0x92b8e04cbf5f94ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.287829:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7c449a00/0x92b8e04cbf5f94ef lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.287846:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff952d410a7e00) 00010000:00010000:0.0:1782216989.287849:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782216989.287853:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7c449a00/0x92b8e04cbf5f94ef lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.287859:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7c449a00/0x92b8e04cbf5f94ef lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.287880:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7c448000/0x92b8e04cbf5f94f6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.287886:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7c448000/0x92b8e04cbf5f94f6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.287904:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7c448000/0x92b8e04cbf5f94f6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.287909:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7c448000 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782216989.287912:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7c448000/0x92b8e04cbf5f94f6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.287919:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7c448000/0x92b8e04cbf5f94f6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.287929:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff952d410a7b00) 00010000:00010000:0.0:1782216989.287932:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782216989.287938:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7c448000/0x92b8e04cbf5f94f6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.287943:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7c448000/0x92b8e04cbf5f94f6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.287955:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f950b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.287961:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f950b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.287965:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f950b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.287969:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2c400 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782216989.287972:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f950b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.287986:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f950b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.287994:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d410a7a00) 00010000:00010000:0.0:1782216989.287996:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782216989.287998:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f950b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.288003:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f950b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782216989.297656:0:6519:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004e3c0e04 reply state 00000000baa6d385 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f953c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.297683:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f953c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.297692:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff952d410a7b00) 00010000:00010000:2.0:1782216989.297695:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1782216989.297698:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1782216989.297710:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:2.0:1782216989.298072:0:6519:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1782216989.298095:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52f7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+7:10499:x1868789693045248:12345-192.168.203.30@tcp:36:chown.0 Request processed in 20650us (20930us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1782216989.298115:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 28 00010000:00010000:0.0:1782216989.298167:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f953c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.298184:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f953c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.298192:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f953c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.298197:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2c600 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782216989.298202:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f953c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.298209:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f953c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.298221:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff952d410a7b00) 00010000:00010000:0.0:1782216989.298224:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782216989.298228:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f953c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.298252:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f953c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216989.310976:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216989.311045:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693045376 00000100:00100000:2.0:1782216989.311064:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693045376 00000100:00100000:2.0:1782216989.311127:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 29 00000100:00100000:2.0:1782216989.311138:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52f7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+6:10500:x1868789693045376:12345-192.168.203.30@tcp:101:touch.500 00010000:00010000:2.0:1782216989.311159:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782216989.311190:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2de00/0x92b8e04cbf5f9543 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973350 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782216989.312249:0:6520:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1008us 00010000:00010000:0.0:1782216989.338741:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e40030800/0x92b8e04cbf5f954a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.338761:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e40030800/0x92b8e04cbf5f954a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.338771:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e40030800/0x92b8e04cbf5f954a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.338786:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e40030a00/0x92b8e04cbf5f9551 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.338793:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e40030a00/0x92b8e04cbf5f9551 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.338800:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e40030a00/0x92b8e04cbf5f9551 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.338917:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e40030c00/0x92b8e04cbf5f9558 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.338926:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e40030c00/0x92b8e04cbf5f9558 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.338933:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e40030c00/0x92b8e04cbf5f9558 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782216989.338974:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1782216989.338977:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782216989.339007:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e40030c00/0x92b8e04cbf5f9558 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.339019:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e40030800/0x92b8e04cbf5f954a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.339025:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e40030800/0x92b8e04cbf5f954a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.339033:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e40030800/0x92b8e04cbf5f954a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.339040:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e40030800 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782216989.339045:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e40030800/0x92b8e04cbf5f954a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.339054:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e40030800/0x92b8e04cbf5f954a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.339067:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d410a7a00) 00010000:00010000:0.0:1782216989.339071:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782216989.339076:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e40030800/0x92b8e04cbf5f954a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.339083:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e40030800/0x92b8e04cbf5f954a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.339096:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e40030a00/0x92b8e04cbf5f9551 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.339127:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e40030a00/0x92b8e04cbf5f9551 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.339133:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e40030a00/0x92b8e04cbf5f9551 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.339139:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e40030a00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782216989.339142:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e40030a00/0x92b8e04cbf5f9551 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.339149:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e40030a00/0x92b8e04cbf5f9551 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.339158:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff952d426a0200) 00010000:00010000:0.0:1782216989.339161:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782216989.339163:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e40030a00/0x92b8e04cbf5f9551 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.339170:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e40030a00/0x92b8e04cbf5f9551 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.340160:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2de00/0x92b8e04cbf5f9543 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973350 expref: 8 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.340179:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e40030c00/0x92b8e04cbf5f9558 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973350 expref: 7 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.340186:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff952d426a0500) 00010000:00010000:0.0:1782216989.340188:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1782216989.340198:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e40030c00, rc 0) 00000100:00100000:0.0:1782216989.340273:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52f7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+7:10500:x1868789693045376:12345-192.168.203.30@tcp:101:touch.500 Request processed in 29135us (29303us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216989.340282:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 29 00000100:00100000:1.0:1782216989.353372:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216989.356618:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693045632 00000100:00100000:0.0:1782216989.356632:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693045632 00000100:00100000:0.0:1782216989.356886:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 30 00000100:00100000:0.0:1782216989.356897:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b302d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+7:10500:x1868789693045632:12345-192.168.203.30@tcp:101:touch.500 00010000:00010000:0.0:1782216989.356927:0:6548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782216989.356946:0:6548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e40030a00/0x92b8e04cbf5f955f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973357 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.357048:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e40030800/0x92b8e04cbf5f9566 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.357063:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e40030800/0x92b8e04cbf5f9566 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.357074:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e40030800/0x92b8e04cbf5f9566 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.357120:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f956d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.357129:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f956d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.357137:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f956d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782216989.357533:0:6548:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:0.0:1782216989.357722:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121cc00/0x92b8e04cbf5f9574 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.357732:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121cc00/0x92b8e04cbf5f9574 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.357740:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121cc00/0x92b8e04cbf5f9574 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.357771:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e40030800/0x92b8e04cbf5f9566 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.357779:0:6548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e40030800/0x92b8e04cbf5f9566 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.357787:0:6548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e40030800/0x92b8e04cbf5f9566 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.357794:0:6548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e40030800 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782216989.357797:0:6548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e40030800/0x92b8e04cbf5f9566 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.357805:0:6548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e40030800/0x92b8e04cbf5f9566 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.357817:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff952d426a0500) 00010000:00010000:0.0:1782216989.357820:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782216989.357825:0:6548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e40030800/0x92b8e04cbf5f9566 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.357832:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e40030800/0x92b8e04cbf5f9566 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782216989.357856:0:6548:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ecbfcc08 reply state 00000000a3bcdb27 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f956d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.357868:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f956d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.357875:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xcdab4b64 (ffff952d426a0200) 00010000:00010000:0.0:1782216989.357878:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782216989.357880:0:6548:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782216989.357909:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e40030a00/0x92b8e04cbf5f955f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973357 expref: 10 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.357923:0:6548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121cc00/0x92b8e04cbf5f9574 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973357 expref: 9 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.357931:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff952d426a0d00) 00010000:00010000:0.0:1782216989.357933:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782216989.357935:0:6548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e4121cc00, rc 0) 00000100:00100000:0.0:1782216989.357996:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b302d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+10:10500:x1868789693045632:12345-192.168.203.30@tcp:101:touch.500 Request processed in 1101us (4838us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1782216989.358005:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 30 00000100:00100000:2.0:1782216989.376536:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216989.381544:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693045888 00000100:00100000:1.0:1782216989.381561:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693045888 00000100:00100000:1.0:1782216989.382831:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 31 00000100:00100000:1.0:1782216989.382847:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43dc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+10:10500:x1868789693045888:12345-192.168.203.30@tcp:36:touch.500 00010000:00010000:1.0:1782216989.382922:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782216989.382948:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121cc00/0x92b8e04cbf5f9574 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973357 expref: 10 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216989.382966:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff952d426a0d00) 00010000:00010000:1.0:1782216989.382988:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782216989.383043:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9582 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216989.383055:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9582 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216989.383064:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9582 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782216989.383193:0:6518:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008ecf3718 reply state 00000000d28bef11 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9582 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216989.383204:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9582 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216989.383210:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff952e72ec5700) 00010000:00010000:1.0:1782216989.383213:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782216989.383215:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782216989.383319:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43dc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+11:10500:x1868789693045888:12345-192.168.203.30@tcp:36:touch.500 Request processed in 476us (6790us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1782216989.383326:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 31 00000100:00100000:1.0:1782216989.386874:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216989.387165:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693046016 00000100:00100000:0.0:1782216989.387174:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693046016 00000100:00100000:0.0:1782216989.387461:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 32 00000100:00100000:0.0:1782216989.387474:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b303b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+11:10500:x1868789693046016:12345-192.168.203.30@tcp:101:touch.500 00010000:00010000:0.0:1782216989.387498:0:6548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782216989.387517:0:6548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c800/0x92b8e04cbf5f9589 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be97335e expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.387928:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c800/0x92b8e04cbf5f9589 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97335e expref: 12 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.387946:0:6548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c800/0x92b8e04cbf5f9589 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97335e expref: 12 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.387967:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff952e72ec5700) 00010000:00010000:0.0:1782216989.387970:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782216989.387974:0:6548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e4121c800, rc 0) 00000100:00100000:0.0:1782216989.388074:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b303b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+12:10500:x1868789693046016:12345-192.168.203.30@tcp:101:touch.500 Request processed in 602us (1207us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216989.388082:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 32 00000100:00100000:2.0:1782216989.391946:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216989.392030:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693046144 00000100:00100000:0.0:1782216989.392039:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693046144 00000100:00100000:0.0:1782216989.392117:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 24 00000100:00100000:0.0:1782216989.392124:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2401:x1868789693046144:12345-192.168.203.30@tcp:8:touch.500 00010000:00080000:0.0:1782216989.392154:0:8434:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 24a87249-c61f-41a1-85ec-9a313129e739@192.168.203.30@tcp t0 exp 0000000000000000 cur 352 last 0 00000020:00000080:0.0:1782216989.392192:0:8434:0:(genops.c:1406:class_connect()) connect: client 24a87249-c61f-41a1-85ec-9a313129e739, cookie 0x92b8e04cbf5f9590 00002000:00100000:0.0:1782216989.392202:0:8434:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 24a87249-c61f-41a1-85ec-9a313129e739/ffff952e7b353000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782216989.392212:0:8434:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1782216989.392284:0:8434:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1782216989.392317:0:8434:0:(import.c:65:import_set_state_nolock()) ffff952e7b356000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782216989.392376:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:24a87249-c61f-41a1-85ec-9a313129e739+6:2401:x1868789693046144:12345-192.168.203.30@tcp:8:touch.500 Request processed in 251us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216989.392405:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 24 00000100:00100000:3.0:1782216989.405000:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216989.405115:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693046272 00000100:00100000:0.0:1782216989.405124:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693046272 00000100:00100000:0.0:1782216989.405207:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 25 00000100:00100000:0.0:1782216989.405217:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42611880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:24a87249-c61f-41a1-85ec-9a313129e739+6:0:x1868789693046272:12345-192.168.203.30@tcp:2:touch.500 00000100:00080000:1.0:1782216989.405848:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1782216989.409739:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:3.0:1782216989.409754:0:8428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 24a87249-c61f-41a1-85ec-9a313129e739 00000100:00100000:0.0:1782216989.410247:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42611880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:24a87249-c61f-41a1-85ec-9a313129e739+5:0:x1868789693046272:12345-192.168.203.30@tcp:2:touch.500 Request processed in 5026us (5250us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1782216989.410258:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 25 00000100:00100000:1.0:1782216989.414096:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216989.414263:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693046528 00000100:00100000:2.0:1782216989.414272:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693046528 00000100:00100000:2.0:1782216989.414625:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2 00000100:00100000:2.0:1782216989.414636:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b302680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+12:10500:x1868789693046528:12345-192.168.203.30@tcp:35:touch.500 00000100:00100000:2.0:1782216989.414921:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b302680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+13:10500:x1868789693046528:12345-192.168.203.30@tcp:35:touch.500 Request processed in 286us (834us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1782216989.414929:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2 00000100:00100000:3.0:1782216989.442058:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216989.442265:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693046656 00000100:00100000:0.0:1782216989.442276:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693046656 00000100:00100000:0.0:1782216989.442407:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 33 00000100:00100000:0.0:1782216989.442417:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+13:10501:x1868789693046656:12345-192.168.203.30@tcp:101:rm.0 00010000:00010000:0.0:1782216989.442439:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782216989.442458:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d400/0x92b8e04cbf5f9597 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973365 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.442525:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c200/0x92b8e04cbf5f959e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.442539:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c200/0x92b8e04cbf5f959e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.442549:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c200/0x92b8e04cbf5f959e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782216989.442773:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1782216989.442778:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782216989.442811:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c200/0x92b8e04cbf5f959e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.442854:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d400/0x92b8e04cbf5f9597 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973365 expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.442872:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c200/0x92b8e04cbf5f959e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973365 expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.442880:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff952d426a0500) 00010000:00010000:0.0:1782216989.442884:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782216989.442887:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e4121c200, rc 0) 00000100:00100000:0.0:1782216989.442986:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+14:10501:x1868789693046656:12345-192.168.203.30@tcp:101:rm.0 Request processed in 569us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216989.442992:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 33 00000100:00100000:0.0:1782216989.453074:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216989.453158:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693046912 00000100:00100000:2.0:1782216989.453167:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693046912 00000100:00100000:2.0:1782216989.453228:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 34 00000100:00100000:2.0:1782216989.453237:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52f7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+14:10501:x1868789693046912:12345-192.168.203.30@tcp:101:rm.0 00010000:00010000:2.0:1782216989.453258:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782216989.453276:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2dc00/0x92b8e04cbf5f95a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be97336c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782216989.453378:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1782216989.453516:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2dc00/0x92b8e04cbf5f95a5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97336c expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.453541:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d410a7a00) 00010000:00010000:2.0:1782216989.453544:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782216989.453549:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2dc00/0x92b8e04cbf5f95a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97336c expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.453561:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2dc00, rc 0) 00000100:00100000:2.0:1782216989.453657:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52f7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+15:10501:x1868789693046912:12345-192.168.203.30@tcp:101:rm.0 Request processed in 420us (591us total) trans 4294967305 rc 301/301 00000100:00100000:2.0:1782216989.453665:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 34 00000100:00100000:2.0:1782216989.460618:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782216989.460708:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693047040 00000100:00100000:3.0:1782216989.460718:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693047040 00000100:00100000:3.0:1782216989.460800:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3 00000100:00100000:3.0:1782216989.460811:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43dcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24a87249-c61f-41a1-85ec-9a313129e739+15:10501:x1868789693047040:12345-192.168.203.30@tcp:37:rm.0 00000100:00100000:0.0:1782216989.467886:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43dcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24a87249-c61f-41a1-85ec-9a313129e739+15:10501:x1868789693047040:12345-192.168.203.30@tcp:37:rm.0 Request processed in 7066us (7295us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216989.467906:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3 00000100:00100000:0.0:1782216989.473695:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216989.473803:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693047296 00000100:00100000:2.0:1782216989.473813:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693047296 00000100:00100000:2.0:1782216989.473871:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 4 00000100:00100000:2.0:1782216989.473882:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e64f08850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+15:10501:x1868789693047296:12345-192.168.203.30@tcp:35:rm.0 00000100:00100000:2.0:1782216989.474126:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e64f08850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+16:10501:x1868789693047296:12345-192.168.203.30@tcp:35:rm.0 Request processed in 245us (439us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1782216989.474134:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 4 00000100:00100000:2.0:1782216989.480939:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216989.481024:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693047552 00000100:00100000:0.0:1782216989.481033:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693047552 00000100:00100000:0.0:1782216989.481110:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 35 00000100:00100000:0.0:1782216989.481121:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43dcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+16:10501:x1868789693047552:12345-192.168.203.30@tcp:101:rm.0 00010000:00010000:0.0:1782216989.481144:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782216989.481163:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c000/0x92b8e04cbf5f95b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973373 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.481264:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f95ba lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.481291:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f95ba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.481314:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f95ba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782216989.481326:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1782216989.481427:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c000/0x92b8e04cbf5f95b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973373 expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.481446:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f95ba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973373 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216989.481454:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff952d426a0500) 00010000:00010000:0.0:1782216989.481457:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1782216989.481460:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e4121c600, rc 0) 00000100:00100000:0.0:1782216989.481523:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43dcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+18:10501:x1868789693047552:12345-192.168.203.30@tcp:101:rm.0 Request processed in 401us (591us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1782216989.481529:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 35 00000100:00100000:3.0:1782216989.501127:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216989.501881:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693047680 00000100:00100000:2.0:1782216989.501894:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693047680 00000100:00100000:2.0:1782216989.501964:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 36 00000100:00100000:2.0:1782216989.501974:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+18:10501:x1868789693047680:12345-192.168.203.30@tcp:41:rm.0 00000004:00000024:2.0:1782216989.502027:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:2.0:1782216989.502132:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+18:10501:x1868789693047680:12345-192.168.203.30@tcp:41:rm.0 Request processed in 158us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216989.502152:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 36 00000100:00100000:0.0:1782216989.507217:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216989.507461:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693047808 00000100:00100000:2.0:1782216989.507472:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693047808 00000100:00100000:2.0:1782216989.507536:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 37 00000100:00100000:2.0:1782216989.507546:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52f7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+18:10501:x1868789693047808:12345-192.168.203.30@tcp:101:rm.0 00010000:00010000:2.0:1782216989.507570:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782216989.507628:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2dc00/0x92b8e04cbf5f95c8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be97337a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.507867:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f95cf lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.507882:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f95cf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.507892:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f95cf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.507902:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f95d6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.507909:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f95d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.507915:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f95d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.507999:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f95dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.508024:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f95dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.508031:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f95dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782216989.508146:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:2.0:1782216989.508150:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782216989.508227:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f95dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.508240:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f95dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.508249:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f95cf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.508255:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f95cf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.508262:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f95cf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.508268:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2cc00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782216989.508272:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f95cf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.508279:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f95cf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.508290:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff952d426a0500) 00010000:00010000:2.0:1782216989.508293:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782216989.508360:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f95cf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.508367:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f95cf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.508381:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f95d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.508387:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f95d6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.508393:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f95d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.508398:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2c800 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782216989.508401:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f95d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.508407:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f95d6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.508414:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xcdab4b64 (ffff952d426a0200) 00010000:00010000:2.0:1782216989.508416:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782216989.508418:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f95d6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.508423:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f95d6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.508447:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2dc00/0x92b8e04cbf5f95c8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97337a expref: 20 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.508469:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f95dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97337a expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.508477:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff952e72ec5700) 00010000:00010000:2.0:1782216989.508479:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782216989.508481:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2d200, rc 0) 00000100:00100000:2.0:1782216989.508548:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52f7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+19:10501:x1868789693047808:12345-192.168.203.30@tcp:101:rm.0 Request processed in 1003us (1340us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216989.508555:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 37 00000100:00100000:1.0:1782216989.517530:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216989.517634:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693048064 00000100:00100000:2.0:1782216989.517644:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693048064 00000100:00100000:2.0:1782216989.517708:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 38 00000100:00100000:2.0:1782216989.517718:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b301180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+19:10501:x1868789693048064:12345-192.168.203.30@tcp:36:rm.0 00010000:00010000:2.0:1782216989.517767:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1782216989.517792:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f95dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97337a expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.517813:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c800/0x92b8e04cbf5f9589 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97335e expref: 18 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.517825:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff952e72ec5700) 00010000:00010000:2.0:1782216989.517834:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c200/0x92b8e04cbf5f959e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973365 expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.517842:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff952d426a0500) 00010000:00010000:2.0:1782216989.517858:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782216989.517878:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2dc00/0x92b8e04cbf5f95e4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.517892:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2dc00/0x92b8e04cbf5f95e4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.517901:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2dc00/0x92b8e04cbf5f95e4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.517911:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f95eb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.517918:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f95eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.517924:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f95eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.518003:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f95f2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.518012:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f95f2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.518019:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f95f2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782216989.518892:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1782216989.518904:0:6519:0:(osp_sync.c:1862:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 352502320365ns, next at 353502318106ns, rc = 0 00010000:00010000:2.0:1782216989.518956:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f95f9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.518979:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f95f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.518988:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f95f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.518995:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f95f9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.519002:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f95f9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.519008:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f95f9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.519366:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782216989.519386:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f95f2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.519393:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f95f2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.519400:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f95f2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.519407:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2cc00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782216989.519411:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f95f2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.519420:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f95f2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.519443:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff952e72ec5700) 00010000:00010000:2.0:1782216989.519446:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782216989.519450:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f95f2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.519457:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f95f2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.519474:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2dc00/0x92b8e04cbf5f95e4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.519481:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2dc00/0x92b8e04cbf5f95e4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.519687:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2dc00/0x92b8e04cbf5f95e4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.519694:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2dc00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782216989.519697:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2dc00/0x92b8e04cbf5f95e4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.519703:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2dc00/0x92b8e04cbf5f95e4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.519711:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff952d426a0500) 00010000:00010000:2.0:1782216989.519713:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782216989.519715:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2dc00/0x92b8e04cbf5f95e4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.519720:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2dc00/0x92b8e04cbf5f95e4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782216989.519742:0:6519:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cd837f92 reply state 000000002182f1e0 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f95eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.519753:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f95eb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.519759:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xcdab4b64 (ffff952d426a0200) 00010000:00010000:2.0:1782216989.519761:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1782216989.519763:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782216989.519884:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b301180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+18:10501:x1868789693048064:12345-192.168.203.30@tcp:36:rm.0 Request processed in 2163us (2358us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1782216989.519897:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 38 00010000:00010000:3.0:1782216989.520793:0:10336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782216989.520802:0:10336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f95f9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216989.520822:0:10336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2d400 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:3.0:1782216989.520826:0:10336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f95f9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216989.520834:0:10336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f95f9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216989.520849:0:10336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff952e72ec5700) 00010000:00010000:3.0:1782216989.520851:0:10336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782216989.520854:0:10336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f95f9 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216989.520860:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f95f9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216989.520875:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216989.520877:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216989.520878:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782216989.532429:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216989.532547:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693048320 00000100:00100000:2.0:1782216989.532559:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693048320 00000100:00100000:2.0:1782216989.532658:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5 00000100:00100000:2.0:1782216989.532675:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+18:10501:x1868789693048320:12345-192.168.203.30@tcp:35:rm.0 00000100:00100000:2.0:1782216989.533020:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+19:10501:x1868789693048320:12345-192.168.203.30@tcp:35:rm.0 Request processed in 347us (606us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1782216989.533031:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5 00000100:00100000:0.0:1782216989.537368:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216989.537499:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693048576 00000100:00100000:1.0:1782216989.537512:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693048576 00000100:00100000:2.0:1782216989.537742:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 39 00000100:00100000:2.0:1782216989.537757:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52f7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+19:10501:x1868789693048576:12345-192.168.203.30@tcp:36:rm.0 00010000:00010000:2.0:1782216989.537834:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1782216989.537869:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f95ba lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973373 expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.537897:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e40030c00/0x92b8e04cbf5f9558 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973350 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.537929:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff952d426a0500) 00010000:00010000:2.0:1782216989.538119:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9519 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973342 expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.538133:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d410a7a00) 00010000:00010000:2.0:1782216989.538142:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782216989.538172:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2dc00/0x92b8e04cbf5f9600 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.538249:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2dc00/0x92b8e04cbf5f9600 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.538260:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2dc00/0x92b8e04cbf5f9600 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.538275:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9607 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.538283:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9607 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.538289:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9607 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.538387:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f960e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.538396:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f960e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.538416:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f960e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782216989.538930:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1782216989.538960:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f960e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.538969:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f960e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.538976:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f960e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.538983:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2d200 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782216989.538989:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f960e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.538996:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f960e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.539007:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff952d410a7200) 00010000:00010000:2.0:1782216989.539010:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782216989.539014:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f960e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.539019:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f960e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.539042:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2dc00/0x92b8e04cbf5f9600 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.539049:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2dc00/0x92b8e04cbf5f9600 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.539063:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2dc00/0x92b8e04cbf5f9600 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.539068:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2dc00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782216989.539072:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2dc00/0x92b8e04cbf5f9600 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.539078:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2dc00/0x92b8e04cbf5f9600 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.539087:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d410a7f00) 00010000:00010000:2.0:1782216989.539090:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782216989.539093:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2dc00/0x92b8e04cbf5f9600 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.539141:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2dc00/0x92b8e04cbf5f9600 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782216989.539155:0:6520:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002086927d reply state 0000000042d9d773 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9607 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.539167:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9607 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216989.539173:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff952d410a7500) 00010000:00010000:2.0:1782216989.539183:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1782216989.539186:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782216989.539285:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52f7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+18:10501:x1868789693048576:12345-192.168.203.30@tcp:36:rm.0 Request processed in 1528us (1927us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1782216989.539295:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 39 00000100:00100000:0.0:1782216989.753309:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782216989.753338:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42611180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713052800:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782216989.753454:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216989.755243:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713052800 00000100:00100000:2.0:1782216989.755261:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713052800 00000100:00100000:2.0:1782216989.755342:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1782216989.755352:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52f7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713052800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782216989.756830:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1782216989.757051:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52f7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713052800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1592us (3497us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216989.757064:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1782216989.757352:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42611180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713052800:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1782216990.200821:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782216991.225445:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216992.259743:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216993.276476:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1782216993.337127:0:8537:0:(osp_sync.c:1862:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 356320541997ns, next at 357320539395ns, rc = 0 00000100:00100000:0.0:1782216993.337164:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e52f7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713052928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782216993.337242:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216993.337449:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e52f7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1868789713053184:0@lo:400:kworker.0 00000100:00100000:0.0:1782216993.337479:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216993.337503:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e52f7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1868789713053696:0@lo:400:kworker.0 00000100:00100000:0.0:1782216993.337522:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216993.337536:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1868789713054208:0@lo:400:kworker.0 00000100:00100000:0.0:1782216993.337568:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216993.337602:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1782216993.337608:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e52f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713053312:0@lo:400:kworker.0 00000100:00100000:0.0:1782216993.337628:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216993.337643:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e52f7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1868789713053824:0@lo:400:kworker.0 00000100:00100000:0.0:1782216993.337660:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216993.337673:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713054336:0@lo:400:kworker.0 00000100:00100000:0.0:1782216993.337692:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216993.337722:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713053184 00000100:00100000:0.0:1782216993.337727:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713053184 00000100:00100000:0.0:1782216993.337759:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713053696 00000100:00100000:0.0:1782216993.337761:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713053696 00000100:00100000:0.0:1782216993.337776:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713054208 00000100:00100000:0.0:1782216993.337778:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713054208 00000100:00100000:0.0:1782216993.337787:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713053824 00000100:00100000:0.0:1782216993.337789:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713053824 00000100:00100000:0.0:1782216993.337802:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1782216993.337808:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1868789713053184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216993.337855:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1868789713053184:12345-0@lo:400:kworker.0 Request processed in 47us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216993.337870:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1782216993.337887:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1782216993.337893:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1868789713053696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216993.337922:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1868789713053696:12345-0@lo:400:kworker.0 Request processed in 29us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216993.337928:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1782216993.337939:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1782216993.337944:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1868789713054208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216993.337970:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1868789713054208:12345-0@lo:400:kworker.0 Request processed in 26us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216993.337976:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1782216993.337985:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1782216993.337991:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1868789713053824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216993.338015:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1868789713053824:12345-0@lo:400:kworker.0 Request processed in 25us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216993.338020:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1782216993.338038:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713053312 00000100:00100000:0.0:1782216993.338041:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713053312 00000100:00100000:0.0:1782216993.338063:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1782216993.338068:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713053312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216993.338108:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713053312:12345-0@lo:400:kworker.0 Request processed in 39us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216993.338113:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1782216993.338129:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e52f7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17bce19a-7a0f-4c9d-b31c-4e0155298487:3648:1868789713053056:0@lo:400:kworker.0 00000100:00100000:0.0:1782216993.338166:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216993.338192:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e52f7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713053568:0@lo:400:kworker.0 00000100:00100000:0.0:1782216993.338212:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216993.338228:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1868789713054080:0@lo:400:kworker.0 00000100:00100000:0.0:1782216993.338249:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216993.338265:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1782216993.338270:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e52f7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1868789713053440:0@lo:400:kworker.0 00000100:00100000:0.0:1782216993.338290:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216993.338300:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713053952:0@lo:400:kworker.0 00000100:00100000:0.0:1782216993.338318:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216993.338332:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713054464:0@lo:400:kworker.0 00000100:00100000:0.0:1782216993.338349:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216993.338372:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713054336 00000100:00100000:0.0:1782216993.338375:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713054336 00000100:00100000:0.0:1782216993.338397:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713053952 00000100:00100000:0.0:1782216993.338399:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713053952 00000100:00100000:0.0:1782216993.338408:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713054464 00000100:00100000:0.0:1782216993.338410:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713054464 00000100:00100000:0.0:1782216993.338422:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1782216993.338427:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c692d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713054336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216993.338455:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c692d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713054336:12345-0@lo:400:kworker.0 Request processed in 27us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216993.338461:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1782216993.338470:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1782216993.338475:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713053952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216993.338499:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713053952:12345-0@lo:400:kworker.0 Request processed in 25us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216993.338511:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1782216993.338522:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1782216993.338527:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c693480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713054464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216993.338552:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c693480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713054464:12345-0@lo:400:kworker.0 Request processed in 25us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216993.338557:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:0.0:1782216993.338622:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7c693800 x1868789713053952/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782217009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216993.338635:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713053952:0@lo:400:kworker.0 00010000:00080000:0.0:1782216993.338643:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7c691180 x1868789713054464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782217009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216993.338651:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713054464:0@lo:400:kworker.0 00000100:00100000:0.0:1782216993.338677:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e52f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713053312:0@lo:400:kworker.0 00010000:00080000:0.0:1782216993.338687:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e52f7dc00 x1868789713053824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216993.338694:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e52f7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1868789713053824:0@lo:400:kworker.0 00010000:00080000:0.0:1782216993.338701:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7c690000 x1868789713054336/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782217009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216993.338708:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713054336:0@lo:400:kworker.0 00000100:00100000:0.0:1782216993.338717:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e52f7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1868789713053184:0@lo:400:kworker.0 00000100:00100000:0.0:1782216993.338726:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e52f7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1868789713053696:0@lo:400:kworker.0 00010000:00080000:0.0:1782216993.338745:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7c691c00 x1868789713054208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216993.338753:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1868789713054208:0@lo:400:kworker.0 00000100:00100000:0.0:1782216993.338777:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713054080 00000100:00100000:0.0:1782216993.338780:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713054080 00000100:00100000:0.0:1782216993.338795:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713053440 00000100:00100000:0.0:1782216993.338797:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713053440 00000100:00100000:0.0:1782216993.338807:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1782216993.338812:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1868789713054080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216993.338843:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1868789713054080:12345-0@lo:400:kworker.0 Request processed in 30us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216993.338849:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1782216993.338859:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1782216993.338864:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1868789713053440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216993.338887:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1868789713053440:12345-0@lo:400:kworker.0 Request processed in 23us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216993.338893:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1782216993.338912:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e52f7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1868789713053440:0@lo:400:kworker.0 00000100:00100000:0.0:1782216993.338921:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1868789713054080:0@lo:400:kworker.0 00000100:00100000:0.0:1782216993.339054:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713053568 00000100:00100000:0.0:1782216993.339058:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713053568 00000100:00100000:0.0:1782216993.339097:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1782216993.339103:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713053568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216993.339139:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713053568:12345-0@lo:400:kworker.0 Request processed in 36us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216993.339155:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1782216993.339184:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e52f7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713053568:0@lo:400:kworker.0 00000100:00100000:0.0:1782216993.339208:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713053056 00000100:00100000:0.0:1782216993.339211:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713053056 00000100:00100000:0.0:1782216993.339236:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1782216993.339242:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52588850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3648:x1868789713053056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216993.339277:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52588850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3648:x1868789713053056:12345-0@lo:400:kworker.0 Request processed in 35us (1110us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216993.339283:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1782216993.339315:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e52f7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17bce19a-7a0f-4c9d-b31c-4e0155298487:3648:1868789713053056:0@lo:400:kworker.0 00000100:00100000:2.0:1782216993.339528:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782216993.339539:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43dc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713054592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782216993.339571:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216993.339617:0:10535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713052928 00000100:00100000:2.0:1782216993.339620:0:10535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713052928 00000100:00100000:2.0:1782216993.339647:0:10535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713054592 00000100:00100000:2.0:1782216993.339650:0:10535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713054592 00000100:00100000:2.0:1782216993.339663:0:10535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1782216993.339668:0:10535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52f7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713052928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782216993.339691:0:10535:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782216993.339727:0:10535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52f7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713052928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (2485us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216993.339733:0:10535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1782216993.339745:0:10535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1782216993.339752:0:10535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43dca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713054592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782216993.339765:0:10535:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782216993.339791:0:10535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43dca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713054592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216993.339797:0:10535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:2.0:1782216993.339833:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43dc8e00 x1868789713054592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782217009 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216993.339846:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43dc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713054592:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1782216993.339858:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e52f7e300 x1868789713052928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782217009 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216993.339869:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e52f7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713052928:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782216993.340254:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713054720:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782216993.340286:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216993.340359:0:10535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713054720 00000100:00100000:3.0:1782216993.340366:0:10535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713054720 00000100:00100000:0.0:1782216993.340472:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b301880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713054848:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782216993.340499:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216993.340525:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713054848 00000100:00100000:0.0:1782216993.340528:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713054848 00000100:00100000:3.0:1782216993.340670:0:10535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1782216993.340682:0:10535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43dc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713054720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782216993.340698:0:10535:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782216993.340803:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1782216993.340812:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713054848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782216993.340823:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782216993.340869:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713054848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216993.340876:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:0.0:1782216993.340908:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7b301880 x1868789713054848/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782217009 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782216993.340923:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b301880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713054848:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1782216993.340956:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782216993.340968:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782216993.340971:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782216993.340973:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782216993.351603:0:10535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43dc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713054720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 10904us (11297us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216993.351619:0:10535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00080000:2.0:1782216993.352328:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d42613800 x1868789713054720/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782217009 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216993.352355:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713054720:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782216993.726917:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216993.726952:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216993.726983:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216993.727012:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216993.727032:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216993.727056:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216993.727657:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693048960 00000100:00100000:1.0:1782216993.727667:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693048960 00000100:00100000:1.0:1782216993.727721:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693049216 00000100:00100000:1.0:1782216993.727724:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693049216 00000100:00100000:1.0:1782216993.727737:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693048832 00000100:00100000:1.0:1782216993.727740:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693048832 00000100:00100000:1.0:1782216993.727750:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693049344 00000100:00100000:1.0:1782216993.727753:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693049344 00000100:00100000:1.0:1782216993.727771:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 227 00000100:00100000:1.0:1782216993.727779:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b302300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+5:2403:x1868789693048960:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1782216993.727847:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b302300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+5:2403:x1868789693048960:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 68us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216993.727855:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 227 00000100:00100000:1.0:1782216993.727872:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 228 00000100:00100000:1.0:1782216993.727878:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b301880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a927f5f6-9735-45e0-abce-963bd125e020+5:2403:x1868789693049216:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1782216993.727902:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b301880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a927f5f6-9735-45e0-abce-963bd125e020+5:2403:x1868789693049216:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 24us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216993.727909:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 228 00000100:00100000:1.0:1782216993.727920:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 229 00000100:00100000:1.0:1782216993.727926:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b302680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+18:2403:x1868789693048832:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1782216993.727951:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b302680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+18:2403:x1868789693048832:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 26us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216993.727958:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 229 00000100:00100000:1.0:1782216993.727977:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 230 00000100:00100000:1.0:1782216993.727983:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a927f5f6-9735-45e0-abce-963bd125e020+5:2403:x1868789693049344:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1782216993.728006:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a927f5f6-9735-45e0-abce-963bd125e020+5:2403:x1868789693049344:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 23us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216993.728012:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 230 00000100:00100000:1.0:1782216993.729663:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693049088 00000100:00100000:1.0:1782216993.729674:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693049088 00000100:00100000:1.0:1782216993.729730:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 66 00000100:00100000:1.0:1782216993.729739:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:24a87249-c61f-41a1-85ec-9a313129e739+5:2403:x1868789693049088:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1782216993.729789:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:24a87249-c61f-41a1-85ec-9a313129e739+5:2403:x1868789693049088:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 51us (2755us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216993.729797:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 66 00000100:00080000:3.0:1782216993.729880:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782216993.729884:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782216993.729886:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782216993.730492:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693048704 00000100:00100000:2.0:1782216993.730498:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693048704 00000100:00100000:2.0:1782216993.730535:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 339 00000100:00100000:2.0:1782216993.730543:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:2403:x1868789693048704:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1782216993.733395:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:2403:x1868789693048704:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 2843us (6477us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216993.733410:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 339 00000100:00100000:3.0:1782216993.866314:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782216993.866337:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713054976:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782216993.866402:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216993.866462:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713054976 00000100:00100000:3.0:1782216993.866469:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713054976 00000100:00100000:3.0:1782216993.866510:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1782216993.866519:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42611c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713054976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1782216993.866552:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1782216993.866611:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42611c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713054976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216993.866618:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1782216993.866662:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713054976:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1782216994.234006:0:13681:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:0.0:1782216994.298230:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782216994.875716:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713055104:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782216994.875787:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216994.875862:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713055104 00000100:00100000:0.0:1782216994.875869:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713055104 00000100:00100000:0.0:1782216994.875910:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1782216994.875931:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713055104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782216994.875964:0:7938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1782216994.876004:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713055104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216994.876011:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1782216994.876050:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713055104:0@lo:41:osp-pre-0-1.0 00000004:00080000:1.0:1782216994.882019:0:6498:0:(osp_sync.c:1827:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:1.0:1782216994.882057:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:1.0:1782216994.882080:0:6498:0:(osp_sync.c:1827:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:0.0:1782216994.882134:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f956d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216994.882145:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f956d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216994.882153:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f956d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216994.882160:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121ca00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782216994.882164:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f956d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216994.882172:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f956d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216994.882199:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xcdab4b64 (ffff952d426a0200) 00010000:00010000:0.0:1782216994.882202:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782216994.882207:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f956d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216994.882213:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f956d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216994.882230:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9582 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216994.882237:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9582 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216994.882243:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9582 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216994.882248:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43072600 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782216994.882252:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9582 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216994.882258:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9582 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216994.882265:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff952e72ec5700) 00010000:00010000:0.0:1782216994.882268:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782216994.882270:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9582 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216994.882276:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9582 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216994.882304:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f95eb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216994.882311:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f95eb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216994.882317:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f95eb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216994.882321:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2c800 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782216994.882324:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f95eb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216994.882330:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f95eb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216994.882337:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xcdab4b64 (ffff952d426a0200) 00010000:00010000:0.0:1782216994.882340:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782216994.882343:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f95eb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216994.882348:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f95eb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216994.882362:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9607 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216994.882368:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9607 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216994.882374:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9607 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216994.882385:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2cc00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782216994.882388:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9607 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216994.882395:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9607 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216994.882403:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff952d410a7500) 00010000:00010000:0.0:1782216994.882405:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782216994.882408:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9607 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216994.882414:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9607 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216994.886431:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782216994.886451:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713055232:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782216994.886518:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216994.886647:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713055232 00000100:00100000:3.0:1782216994.886653:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713055232 00000100:00100000:3.0:1782216994.886696:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782216994.886705:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4379bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713055232:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1782216994.886729:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:3.0:1782216994.886758:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a3a791d, atime: 0x6a3a791d, ctime: 0x6a3a791d, blocks: 0x0 00010000:00010000:3.0:1782216994.886766:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d7576ff/0x92b8e04cbf5f9615 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216994.886780:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=357s v=(0 0) 00010000:00010000:3.0:1782216994.886784:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782216994.886790:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d7576ff/0x92b8e04cbf5f9615 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216994.886814:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d7576ff/0x92b8e04cbf5f9615 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216994.886824:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d7576ff/0x92b8e04cbf5f9615 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216994.886832:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d7576ff/0x92b8e04cbf5f9615 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216994.886850:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782216994.886982:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4379bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3650:x1868789713055232:12345-0@lo:6:osp-syn-0-0.0 Request processed in 277us (463us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1782216994.886990:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1782216994.887009:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782216994.887015:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d7576ff/0x92b8e04cbf5f9615 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216994.887022:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362000 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:3.0:1782216994.887027:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d7576ff/0x92b8e04cbf5f9615 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216994.887036:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d7576ff/0x92b8e04cbf5f9615 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216994.887052:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d7576ff/0x92b8e04cbf5f9615 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216994.887076:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d7576ff/0x92b8e04cbf5f9615 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216994.887092:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216994.887094:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216994.887096:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1782216994.887124:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff952d42611500/2, rc 0, transno 4294967301 00000100:00100000:3.0:1782216994.887130:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713055232:0@lo:6:osp-syn-0-0.0 00000020:00000080:1.0:1782216995.260174:0:13729:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe17419720 20000000:00000080:1.0:1782216995.260191:0:13729:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff952d43e1e000 uarg=0000000000000000 20000000:01000000:1.0:1782216995.260233:0:13729:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1782216995.260239:0:13729:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1782216995.260244:0:13729:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1782216995.263786:0:13730:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1782216995.263892:0:13729:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1782216995.272444:0:13729:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1782216995.272478:0:13729:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1782216995.272493:0:13729:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1782216995.272519:0:13729:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1782216995.272537:0:13729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff952d43072200/0x92b8e04cbf5f961c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216995.272556:0:13729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952e40031c00/0x92b8e04cbf5f94a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97332d expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216995.272564:0:13729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952d43072400/0x92b8e04cbf5f94a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973334 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216995.272572:0:13729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952e413fd800/0x92b8e04cbf5f94b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f94b0 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216995.272578:0:13729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952e413fd600/0x92b8e04cbf5f94c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f94be expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216995.282386:0:13729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952d43073600/0x92b8e04cbf5f94d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f94cc expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216995.282397:0:13729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952d43073e00/0x92b8e04cbf5f94e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f94da expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216995.282406:0:13729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff952d43072200/0x92b8e04cbf5f961c lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216995.282481:0:13729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952d43073e00/0x92b8e04cbf5f94e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5f94da expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216995.282499:0:13729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff952d43073e00/0x92b8e04cbf5f94e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5f94da expref: 23 pid: 6514 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216995.282512:0:13729:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4379b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1868789713055360:0@lo:104: 00000100:00100000:1.0:1782216995.282612:0:13729:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782216995.282669:0:13729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952d43073600/0x92b8e04cbf5f94d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5f94cc expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216995.282678:0:13729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff952d43073600/0x92b8e04cbf5f94d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5f94cc expref: 23 pid: 6514 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216995.282686:0:13729:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b09ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1868789713055488:0@lo:104: 00010000:00010000:1.0:1782216995.282711:0:13729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952e413fd600/0x92b8e04cbf5f94c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5f94be expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216995.282719:0:13729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff952e413fd600/0x92b8e04cbf5f94c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5f94be expref: 23 pid: 6511 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216995.282727:0:13729:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b09df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1868789713055616:0@lo:104: 00010000:00010000:1.0:1782216995.282748:0:13729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952e413fd800/0x92b8e04cbf5f94b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5f94b0 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216995.282755:0:13729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff952e413fd800/0x92b8e04cbf5f94b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5f94b0 expref: 23 pid: 6511 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216995.282764:0:13729:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b09fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1868789713055744:0@lo:104: 00010000:00010000:1.0:1782216995.282790:0:13729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952d43072400/0x92b8e04cbf5f94a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973334 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216995.282800:0:13729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff952d43072400/0x92b8e04cbf5f94a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973334 expref: 12 pid: 6514 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216995.282808:0:13729:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b09ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1868789713055872:192.168.203.30@tcp:104: 00010000:00010000:1.0:1782216995.282877:0:13729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952e40031c00/0x92b8e04cbf5f94a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97332d expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216995.282886:0:13729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff952e40031c00/0x92b8e04cbf5f94a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97332d expref: 12 pid: 6511 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216995.282895:0:13729:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b09f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1868789713056000:192.168.203.30@tcp:104: 00000100:00100000:1.0:1782216995.282918:0:13729:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43d1c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782216995.283142:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1782216995.283163:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216995.283190:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216995.283198:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216995.283206:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713055360 00000100:00100000:0.0:1782216995.283213:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713055360 00000100:00100000:0.0:1782216995.283251:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713055488 00000100:00100000:0.0:1782216995.283254:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713055488 00000100:00100000:0.0:1782216995.283264:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713055616 00000100:00100000:0.0:1782216995.283266:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713055616 00000100:00100000:0.0:1782216995.283274:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713055744 00000100:00100000:0.0:1782216995.283276:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713055744 00000100:00100000:0.0:1782216995.283288:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1782216995.283296:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+6:13729:x1868789713055360:12345-0@lo:104: 00010000:00010000:0.0:1782216995.283308:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff952e7c448a00/0x92b8e04cbf5f94da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f94e1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216995.283384:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782216995.283390:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+6:13729:x1868789713055360:12345-0@lo:104: Request processed in 95us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216995.283397:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1782216995.283431:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1782216995.283438:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c691c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+5:13729:x1868789713055488:12345-0@lo:104: 00010000:00010000:0.0:1782216995.283445:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff952e413fc400/0x92b8e04cbf5f94cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f94d3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216995.283450:0:10337:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782216995.283456:0:10337:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e7c448a00/0x92b8e04cbf5f94da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f94e1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216995.283464:0:10337:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7c448a00 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:2.0:1782216995.283468:0:10337:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e7c448a00/0x92b8e04cbf5f94da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5f94e1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216995.283473:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782216995.283478:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c691c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+5:13729:x1868789713055488:12345-0@lo:104: Request processed in 41us (315us total) trans 0 rc 0/0 00010000:00010000:2.0:1782216995.283483:0:10337:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e7c448a00/0x92b8e04cbf5f94da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5f94e1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216995.283483:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 10000000:00010000:2.0:1782216995.283490:0:10337:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e7c448a00/0x92b8e04cbf5f94da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5f94e1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216995.283494:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 10000000:01000000:2.0:1782216995.283496:0:10337:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1782216995.283499:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c691180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+4:13729:x1868789713055616:12345-0@lo:104: 00010000:00010000:0.0:1782216995.283504:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff952e413fda00/0x92b8e04cbf5f94be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f94c5 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216995.283523:0:10337:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e7c448a00/0x92b8e04cbf5f94da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f94e1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216995.283529:0:10337:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782216995.283533:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1782216995.283537:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c691180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+4:13729:x1868789713055616:12345-0@lo:104: Request processed in 39us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216995.283542:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:2.0:1782216995.283546:0:10337:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e7c448a00/0x92b8e04cbf5f94da lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f94e1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216995.283552:0:10337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e7c448a00/0x92b8e04cbf5f94da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f94e1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216995.283552:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1782216995.283557:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c693800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+3:13729:x1868789713055744:12345-0@lo:104: 00010000:00010000:0.0:1782216995.283563:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff952d43073000/0x92b8e04cbf5f94b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f94b7 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216995.283564:0:10337:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782216995.283567:0:10337:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e413fc400/0x92b8e04cbf5f94cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f94d3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216995.283573:0:10337:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e413fc400 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:2.0:1782216995.283576:0:10337:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e413fc400/0x92b8e04cbf5f94cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5f94d3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216995.283612:0:10337:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e413fc400/0x92b8e04cbf5f94cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5f94d3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216995.283616:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 10000000:00010000:2.0:1782216995.283620:0:10337:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e413fc400/0x92b8e04cbf5f94cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5f94d3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216995.283621:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c693800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+3:13729:x1868789713055744:12345-0@lo:104: Request processed in 63us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216995.283626:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 10000000:01000000:2.0:1782216995.283630:0:10337:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782216995.283641:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782216995.283644:0:10337:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e413fc400/0x92b8e04cbf5f94cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f94d3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216995.283645:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e413fda00/0x92b8e04cbf5f94be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f94c5 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216995.283651:0:10337:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782216995.283652:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e413fda00 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:0.0:1782216995.283655:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e413fda00/0x92b8e04cbf5f94be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5f94c5 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216995.283662:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e413fda00/0x92b8e04cbf5f94be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5f94c5 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216995.283666:0:10337:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e413fc400/0x92b8e04cbf5f94cc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f94d3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782216995.283668:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e413fda00/0x92b8e04cbf5f94be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5f94c5 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216995.283673:0:10337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e413fc400/0x92b8e04cbf5f94cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f94d3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782216995.283674:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782216995.283683:0:10337:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782216995.283686:0:10337:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952d43073000/0x92b8e04cbf5f94b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5f94b7 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216995.283686:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e413fda00/0x92b8e04cbf5f94be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f94c5 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216995.283692:0:10337:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43073000 already unused, calling callback (ffffffffc1157c20) 00010000:00010000:0.0:1782216995.283692:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:2.0:1782216995.283694:0:10337:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952d43073000/0x92b8e04cbf5f94b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5f94b7 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216995.283698:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e413fda00/0x92b8e04cbf5f94be lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f94c5 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216995.283701:0:10337:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952d43073000/0x92b8e04cbf5f94b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5f94b7 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216995.283704:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e413fda00/0x92b8e04cbf5f94be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f94c5 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782216995.283707:0:10337:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952d43073000/0x92b8e04cbf5f94b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5f94b7 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782216995.283712:0:10337:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782216995.283721:0:10337:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952d43073000/0x92b8e04cbf5f94b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f94b7 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216995.283723:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782216995.283725:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782216995.283726:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216995.283727:0:10337:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782216995.283737:0:10337:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952d43073000/0x92b8e04cbf5f94b0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f94b7 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216995.283744:0:10337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952d43073000/0x92b8e04cbf5f94b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5f94b7 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216995.283756:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216995.283757:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782216995.283759:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216995.283776:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43dc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789713056512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782216995.283804:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216995.283840:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782216995.283845:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43dcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789713056128:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782216995.283864:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216995.283887:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43dc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789713056256:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782216995.283894:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782216995.283903:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216995.283908:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216995.283926:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782216995.283930:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713056512 00000100:00100000:2.0:1782216995.283931:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789713056384:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782216995.283934:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713056512 00000100:00100000:2.0:1782216995.283949:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782216995.283954:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952e413fd800/0x92b8e04cbf5f94b7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f94b0 expref: 24 pid: 6511 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216995.283968:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713056128 00000100:00100000:3.0:1782216995.283970:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713056128 00000100:00100000:2.0:1782216995.283974:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713056256 00000100:00100000:2.0:1782216995.283976:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713056256 00010000:00010000:3.0:1782216995.283980:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952d43073e00/0x92b8e04cbf5f94e1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f94da expref: 26 pid: 6514 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216995.283989:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713056384 00000100:00100000:3.0:1782216995.283992:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713056384 00010000:00010000:3.0:1782216995.284001:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952e413fd600/0x92b8e04cbf5f94c5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f94be expref: 27 pid: 6511 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216995.284004:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952d43073600/0x92b8e04cbf5f94d3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f94cc expref: 27 pid: 6514 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782216995.284012:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1782216995.284016:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1782216995.284017:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43dc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+27:3649:x1868789713056512:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782216995.284020:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+27:3649:x1868789713056128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782216995.284030:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782216995.284031:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782216995.284035:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952d43073e00/0x92b8e04cbf5f94e1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f94da expref: 27 pid: 6514 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216995.284036:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952e413fd800/0x92b8e04cbf5f94b7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f94b0 expref: 27 pid: 6511 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216995.284044:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952e413fd800/0x92b8e04cbf5f94b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5f94b0 expref: 27 pid: 6511 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216995.284088:0:8449:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1782216995.284095:0:8449:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:1.0:1782216995.284143:0:13729:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4379b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1868789713055360:0@lo:104: 00000100:00100000:1.0:1782216995.284151:0:13729:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b09ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1868789713055488:0@lo:104: 00000100:00100000:1.0:1782216995.284158:0:13729:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b09df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1868789713055616:0@lo:104: 00000100:00100000:1.0:1782216995.284164:0:13729:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b09fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1868789713055744:0@lo:104: 00000100:00100000:0.0:1782216995.288879:0:13729:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b09ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1868789713055872:192.168.203.30@tcp:104: 00000100:00100000:0.0:1782216995.288897:0:13729:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b09f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1868789713056000:192.168.203.30@tcp:104: 00010000:00010000:2.0:1782216995.289104:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952d43073e00/0x92b8e04cbf5f94e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5f94da expref: 27 pid: 6514 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216995.289127:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952d43073e00/0x92b8e04cbf5f94e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5f94da expref: 27 pid: 6514 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216995.289143:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782216995.290155:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+26:3649:x1868789713056128:12345-0@lo:103:ldlm_bl.0 Request processed in 6130us (6286us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216995.290166:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1782216995.290200:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1782216995.290210:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43dcb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+25:3647:x1868789713056384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782216995.290227:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782216995.290234:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952e413fd600/0x92b8e04cbf5f94c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f94be expref: 25 pid: 6511 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216995.290246:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952e413fd600/0x92b8e04cbf5f94c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5f94be expref: 25 pid: 6511 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216995.290257:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e413fd600/0x92b8e04cbf5f94c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5f94be expref: 25 pid: 6511 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216995.290269:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782216995.290300:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43dcb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3647:x1868789713056384:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (6349us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216995.290307:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1782216995.290321:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1782216995.290329:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43dc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:3647:x1868789713056256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782216995.290353:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782216995.290358:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952d43073600/0x92b8e04cbf5f94d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5f94cc expref: 23 pid: 6514 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216995.290369:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952d43073600/0x92b8e04cbf5f94d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5f94cc expref: 23 pid: 6514 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216995.290380:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952d43073600/0x92b8e04cbf5f94d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5f94cc expref: 23 pid: 6514 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216995.290388:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782216995.290412:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43dc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+22:3647:x1868789713056256:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (6502us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216995.290418:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1782216995.290737:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43dcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789713056128:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782216995.290801:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789713056384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782216995.290813:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43dc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789713056256:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782216995.294139:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e413fd800/0x92b8e04cbf5f94b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5f94b0 expref: 21 pid: 6511 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216995.294159:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782216995.294239:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43dc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17bce19a-7a0f-4c9d-b31c-4e0155298487+20:3649:x1868789713056512:12345-0@lo:103:ldlm_bl.0 Request processed in 10220us (10433us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216995.294249:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1782216995.294382:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43dc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789713056512:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782216995.299702:0:13729:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff952d43072200/0x92b8e04cbf5f961c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216995.305319:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216995.305360:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216995.307423:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693049472 00000100:00100000:0.0:1782216995.307435:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693049472 00010000:00010000:0.0:1782216995.307475:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952d43072400/0x92b8e04cbf5f94a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973334 expref: 13 pid: 6514 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216995.307502:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693049600 00000100:00100000:0.0:1782216995.307504:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693049600 00010000:00010000:0.0:1782216995.307513:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952e40031c00/0x92b8e04cbf5f94a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97332d expref: 14 pid: 6511 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216995.307533:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 50 00000100:00100000:0.0:1782216995.307541:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43dc8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+14:2403:x1868789693049472:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782216995.307553:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782216995.307559:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952d43072400/0x92b8e04cbf5f94a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973334 expref: 14 pid: 6514 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216995.307570:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952d43072400/0x92b8e04cbf5f94a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973334 expref: 14 pid: 6514 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216995.307613:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952d43072400/0x92b8e04cbf5f94a9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973334 expref: 14 pid: 6514 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216995.307626:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782216995.307673:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43dc8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:2403:x1868789693049472:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 132us (2364us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216995.307681:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 50 00000100:00100000:0.0:1782216995.307696:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 51 00000100:00100000:0.0:1782216995.307702:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43dc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+12:2403:x1868789693049600:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782216995.307710:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782216995.307714:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952e40031c00/0x92b8e04cbf5f94a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97332d expref: 12 pid: 6511 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216995.307722:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952e40031c00/0x92b8e04cbf5f94a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97332d expref: 12 pid: 6511 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216995.307732:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e40031c00/0x92b8e04cbf5f94a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97332d expref: 12 pid: 6511 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216995.307743:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff952d43072200/0x92b8e04cbf5f961c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216995.307752:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952d43072200/0x92b8e04cbf5f961c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216995.307764:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff952d43072200/0x92b8e04cbf5f961c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216995.307781:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff952d43072200/0x92b8e04cbf5f961c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216995.307788:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff952d43072200/0x92b8e04cbf5f961c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216995.307795:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff952d43072200/0x92b8e04cbf5f961c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216995.307800:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43072200 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:0.0:1782216995.307804:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff952d43072200/0x92b8e04cbf5f961c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216995.307826:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff952d43072200/0x92b8e04cbf5f961c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216995.307840:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff952d43072200/0x92b8e04cbf5f961c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216995.307849:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782216995.307866:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43dc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+11:2403:x1868789693049600:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 164us (2506us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216995.307872:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 51 00010000:00010000:0.0:1782216995.307894:0:13729:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff952d43072200/0x92b8e04cbf5f961c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216995.307901:0:13729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff952d43072200/0x92b8e04cbf5f961c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216995.307907:0:13729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952d43072200/0x92b8e04cbf5f961c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216995.326040:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782216996.200005:0:13779:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeedcc2d30 20000000:00000080:1.0:1782216996.200025:0:13779:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff952d43e1c400 uarg=0000000000000000 20000000:01000000:1.0:1782216996.200088:0:13779:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1782216996.200095:0:13779:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1782216996.200101:0:13779:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:3.0:1782216996.203288:0:13780:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:1.0:1782216996.203808:0:13779:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:0.0:1782216996.203988:0:13779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:0.0:1782216996.204017:0:13779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:0.0:1782216996.204032:0:13779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:0.0:1782216996.204045:0:13779:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1782216996.204075:0:13779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff952e4121ca00/0x92b8e04cbf5f9623 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216996.204091:0:13779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e4121ca00/0x92b8e04cbf5f9623 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216996.204102:0:13779:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff952e4121ca00/0x92b8e04cbf5f9623 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216996.204109:0:13779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff952e4121ca00/0x92b8e04cbf5f9623 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216996.204116:0:13779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff952e4121ca00/0x92b8e04cbf5f9623 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216996.204124:0:13779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff952e4121ca00/0x92b8e04cbf5f9623 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216996.204140:0:13779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121ca00 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:0.0:1782216996.204144:0:13779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff952e4121ca00/0x92b8e04cbf5f9623 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216996.204151:0:13779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff952e4121ca00/0x92b8e04cbf5f9623 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216996.204165:0:13779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff952e4121ca00/0x92b8e04cbf5f9623 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216996.204183:0:13779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff952e4121ca00/0x92b8e04cbf5f9623 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216996.204189:0:13779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e4121ca00/0x92b8e04cbf5f9623 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782216996.359287:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782216996.605330:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216996.605512:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693049728 00000100:00100000:0.0:1782216996.605523:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693049728 00000100:00100000:0.0:1782216996.605575:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 340 00000100:00100000:0.0:1782216996.605614:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52589c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+11:6173:x1868789693049728:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782216996.605630:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782216996.605646:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e4121c200/0x92b8e04cbf5f962a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc65e7963be973381 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216996.605666:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e4121c200/0x92b8e04cbf5f962a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973381 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216996.605674:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e4121c200/0x92b8e04cbf5f962a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973381 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216996.605680:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e4121c200, rc 0) 00000100:00100000:0.0:1782216996.605996:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52589c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+12:6173:x1868789693049728:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 411us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216996.606003:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 340 00000100:00100000:0.0:1782216996.614336:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216996.617839:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693049856 00000100:00100000:2.0:1782216996.617854:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693049856 00000100:00100000:2.0:1782216996.617964:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 341 00000100:00100000:2.0:1782216996.617974:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+12:6173:x1868789693049856:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782216996.618245:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+12:6173:x1868789693049856:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 272us (3918us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216996.618252:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 341 00000100:00100000:2.0:1782216996.622679:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216996.622781:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693049984 00000100:00100000:0.0:1782216996.622796:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693049984 00000100:00100000:0.0:1782216996.622853:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 342 00000100:00100000:0.0:1782216996.622863:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+12:6173:x1868789693049984:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782216996.623231:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+12:6173:x1868789693049984:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 Request processed in 368us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216996.623239:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 342 00000100:00100000:1.0:1782216996.628270:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216996.628765:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693050112 00000100:00100000:2.0:1782216996.628775:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693050112 00000100:00100000:2.0:1782216996.628834:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 343 00000100:00100000:2.0:1782216996.628844:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52588450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+12:10785:x1868789693050112:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782216996.629162:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52588450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+12:10785:x1868789693050112:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 318us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216996.629170:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 343 00000100:00100000:3.0:1782216996.642804:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216996.645090:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693050240 00000100:00100000:0.0:1782216996.645106:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693050240 00000100:00100000:0.0:1782216996.645190:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 344 00000100:00100000:0.0:1782216996.645202:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e195450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+12:10785:x1868789693050240:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782216996.645382:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e195450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+12:10785:x1868789693050240:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 181us (2586us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216996.645390:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 344 00000100:00100000:3.0:1782216996.649113:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216996.649622:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693050368 00000100:00100000:0.0:1782216996.649633:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693050368 00000100:00100000:0.0:1782216996.649681:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 345 00000100:00100000:0.0:1782216996.649690:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e195050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+12:6173:x1868789693050368:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782216996.649709:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782216996.649727:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e4121c800/0x92b8e04cbf5f9631 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc65e7963be973388 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216996.649754:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e4121c800/0x92b8e04cbf5f9631 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973388 expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216996.649765:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e4121c800/0x92b8e04cbf5f9631 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973388 expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216996.649774:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e4121c800, rc 0) 00000100:00100000:0.0:1782216996.649840:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e195050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:6173:x1868789693050368:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 151us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216996.649849:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 345 00000100:00100000:3.0:1782216996.657203:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216996.657404:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693050496 00000100:00100000:2.0:1782216996.657414:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693050496 00000100:00100000:2.0:1782216996.657474:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 346 00000100:00100000:2.0:1782216996.657484:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e197c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:6173:x1868789693050496:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782216996.657675:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e197c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:6173:x1868789693050496:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 191us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216996.657684:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 346 00000100:00100000:3.0:1782216996.672789:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782216996.672951:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693050624 00000100:00100000:2.0:1782216996.672961:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693050624 00000100:00100000:2.0:1782216996.673021:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 347 00000100:00100000:2.0:1782216996.673030:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:6173:x1868789693050624:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782216996.673190:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:6173:x1868789693050624:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 Request processed in 160us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216996.673198:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 347 00000100:00100000:3.0:1782216996.677005:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216996.677159:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693050752 00000100:00100000:0.0:1782216996.677168:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693050752 00000100:00100000:0.0:1782216996.677227:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 348 00000100:00100000:0.0:1782216996.677235:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e196c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:10788:x1868789693050752:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782216996.677374:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e196c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:10788:x1868789693050752:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 139us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216996.677382:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 348 00000100:00100000:3.0:1782216996.680801:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216996.680910:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693050880 00000100:00100000:0.0:1782216996.680933:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693050880 00000100:00100000:0.0:1782216996.680991:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 349 00000100:00100000:0.0:1782216996.681000:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e197850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:10788:x1868789693050880:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782216996.681162:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e197850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:10788:x1868789693050880:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 163us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216996.681170:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 349 10000000:01000000:0.0:1782216997.113015:0:6516:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1782216997.113023:0:6516:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff952e7dbbd800 from 7 10000000:01000000:0.0:1782216997.113027:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782216997.113085:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e4121d400/0x92b8e04cbf5f9638 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216997.113097:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e4121d400/0x92b8e04cbf5f9638 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216997.113107:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e4121d400/0x92b8e04cbf5f9638 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782216997.113158:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c692680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713056640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782216997.113225:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216997.113289:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e50194780 going to sleep for 11 seconds 00000100:00100000:2.0:1782216997.113460:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713056640 00000100:00100000:2.0:1782216997.113468:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713056640 00000100:00100000:2.0:1782216997.113516:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1782216997.113524:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e194050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+20:6516:x1868789713056640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782216997.113546:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782216997.113558:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e72e2ce00/0x92b8e04cbf5f963f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f9638 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216997.113603:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e72e2ce00/0x92b8e04cbf5f963f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9638 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216997.113614:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e72e2ce00/0x92b8e04cbf5f963f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9638 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216997.113623:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2ce00, rc 0) 00000100:00100000:2.0:1782216997.113672:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e194050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:6516:x1868789713056640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216997.113683:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1782216997.113772:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c692680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713056640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782216997.113787:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e4121d400/0x92b8e04cbf5f9638 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f963f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216997.113806:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e4121d400/0x92b8e04cbf5f9638 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f963f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216997.113876:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b09ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713056768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782216997.113904:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216997.113932:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43d1c780 going to sleep for 11 seconds 00000100:00100000:3.0:1782216997.114053:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713056768 00000100:00100000:3.0:1782216997.114059:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713056768 00000100:00100000:3.0:1782216997.114095:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1782216997.114102:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e194850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:6516:x1868789713056768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782216997.114218:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e194850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:6516:x1868789713056768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216997.114234:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1782216997.114355:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b09ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713056768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782216997.114384:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b09ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713056896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782216997.114421:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216997.114444:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43d1c780 going to sleep for 11 seconds 00000100:00100000:3.0:1782216997.114496:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713056896 00000100:00100000:3.0:1782216997.114500:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713056896 00000100:00100000:3.0:1782216997.114518:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1782216997.114524:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e196450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:6516:x1868789713056896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782216997.114629:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e196450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:6516:x1868789713056896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 104us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216997.114636:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1782216997.114711:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b09ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713056896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782216997.115182:0:13792:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b09ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:13792:1868789713057024:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782216997.115218:0:13792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216997.115245:0:13792:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43d1c180 going to sleep for 11 seconds 00000100:00100000:3.0:1782216997.115351:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713057024 00000100:00100000:3.0:1782216997.115357:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713057024 00000100:00100000:3.0:1782216997.115389:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1782216997.115396:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e196850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:13792:x1868789713057024:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782216997.115480:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e196850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:13792:x1868789713057024:12345-0@lo:502:llog_process_th.0 Request processed in 84us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216997.115486:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1782216997.115561:0:13792:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b09ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:13792:1868789713057024:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782216997.115603:0:13792:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782216997.115612:0:13792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782216997.115614:0:13792:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1782216997.115620:0:13792:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff952e7dbbd800 00000020:00000080:1.0:1782216997.115623:0:13792:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782216997.115682:0:13792:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782216997.115686:0:13792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782216997.115687:0:13792:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1782216997.115690:0:13792:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782216997.115693:0:13792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782216997.115699:0:13792:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1782216997.115703:0:13792:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff952e7dbbd800 00000020:00000080:1.0:1782216997.115705:0:13792:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1782216997.115737:0:13792:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b09ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:13792:1868789713057152:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782216997.115768:0:13792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216997.115784:0:13792:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43d1c180 going to sleep for 11 seconds 00000100:00100000:0.0:1782216997.115838:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713057152 00000100:00100000:0.0:1782216997.115842:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713057152 00000100:00100000:0.0:1782216997.115874:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1782216997.115880:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e195c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:13792:x1868789713057152:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782216997.115956:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e195c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:13792:x1868789713057152:12345-0@lo:502:llog_process_th.0 Request processed in 75us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216997.115964:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1782216997.116153:0:13792:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b09ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:13792:1868789713057152:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782216997.116172:0:13792:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782216997.116176:0:13792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782216997.116178:0:13792:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1782216997.116181:0:13792:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1782216997.116376:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1782216997.116398:0:6516:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782216997.116407:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e4121d400/0x92b8e04cbf5f9638 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f963f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216997.116416:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e4121d400/0x92b8e04cbf5f9638 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f963f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782216997.116426:0:6516:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782216997.116428:0:6516:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff952e74b5e800 from 7 10000000:01000000:2.0:1782216997.116431:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782216997.116453:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e72e2da00/0x92b8e04cbf5f9646 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216997.116462:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e72e2da00/0x92b8e04cbf5f9646 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216997.116482:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e72e2da00/0x92b8e04cbf5f9646 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216997.116496:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43dcad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713057280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782216997.116525:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216997.116549:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e47c56840 going to sleep for 11 seconds 00000100:00100000:0.0:1782216997.117207:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713057280 00000100:00100000:0.0:1782216997.117213:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713057280 00000100:00100000:0.0:1782216997.117248:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1782216997.117255:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e197050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:6516:x1868789713057280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782216997.117266:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782216997.117276:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e4121d200/0x92b8e04cbf5f964d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f9646 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216997.117295:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e4121d200/0x92b8e04cbf5f964d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9646 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216997.117306:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e4121d200/0x92b8e04cbf5f964d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9646 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216997.117313:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e4121d200, rc 0) 00000100:00100000:0.0:1782216997.117347:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e197050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+22:6516:x1868789713057280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216997.117360:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1782216997.117453:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43dcad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713057280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782216997.117468:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e72e2da00/0x92b8e04cbf5f9646 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f964d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216997.117475:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e72e2da00/0x92b8e04cbf5f9646 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f964d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216997.117526:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43dcad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713057408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782216997.117551:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216997.117577:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e47c56840 going to sleep for 11 seconds 00000100:00100000:2.0:1782216997.117612:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713057408 00000100:00100000:2.0:1782216997.117616:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713057408 00000100:00100000:2.0:1782216997.117637:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1782216997.117643:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e196050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+22:6516:x1868789713057408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782216997.117727:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e196050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+22:6516:x1868789713057408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 83us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216997.117733:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1782216997.117757:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43dcad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713057408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782216997.117778:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43dcad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713057536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782216997.117814:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216997.117831:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e47c56840 going to sleep for 11 seconds 00000100:00100000:2.0:1782216997.117841:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713057536 00000100:00100000:2.0:1782216997.117844:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713057536 00000100:00100000:2.0:1782216997.118574:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1782216997.118612:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e197450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+22:6516:x1868789713057536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782216997.118713:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e197450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+22:6516:x1868789713057536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 130us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216997.118720:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1782216997.119230:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43dcad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713057536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782216997.120413:0:13793:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c692680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:13793:1868789713057664:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782216997.120471:0:13793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216997.120510:0:13793:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e501949c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782216997.120940:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713057664 00000100:00100000:2.0:1782216997.120947:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713057664 00000100:00100000:2.0:1782216997.120983:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1782216997.120990:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e195850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+22:13793:x1868789713057664:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782216997.121150:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e195850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+22:13793:x1868789713057664:12345-0@lo:502:llog_process_th.0 Request processed in 159us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216997.121157:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1782216997.132804:0:13793:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c692680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:13793:1868789713057664:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782216997.132918:0:13793:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782216997.132930:0:13793:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782216997.132932:0:13793:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1782216997.132939:0:13793:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff952e74b5e800 00000020:00000080:1.0:1782216997.132942:0:13793:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782216997.133004:0:13793:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782216997.133007:0:13793:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782216997.133009:0:13793:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1782216997.133011:0:13793:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782216997.133014:0:13793:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782216997.133015:0:13793:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1782216997.133018:0:13793:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff952e74b5e800 00000020:00000080:1.0:1782216997.133020:0:13793:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1782216997.133082:0:13793:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b09ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:13793:1868789713057792:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782216997.133828:0:13793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216997.133973:0:13793:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43d1c180 going to sleep for 11 seconds 00000100:00100000:2.0:1782216997.139771:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713057792 00000100:00100000:2.0:1782216997.139783:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713057792 00000100:00100000:2.0:1782216997.139831:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1782216997.139840:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e194450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+22:13793:x1868789713057792:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782216997.140101:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e194450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+22:13793:x1868789713057792:12345-0@lo:502:llog_process_th.0 Request processed in 261us (6275us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216997.140110:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1782216997.140180:0:13793:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b09ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:13793:1868789713057792:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782216997.140212:0:13793:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782216997.140219:0:13793:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782216997.140227:0:13793:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1782216997.140231:0:13793:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000040:00080000:1.0:1782216997.140328:0:13796:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000000:1.0:1782216997.140372:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1782216997.140399:0:6516:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782216997.140409:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e72e2da00/0x92b8e04cbf5f9646 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f964d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216997.140421:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e72e2da00/0x92b8e04cbf5f9646 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f964d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782216997.140432:0:6516:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782216997.140435:0:6516:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff952e7b38d800 from 7 10000000:01000000:1.0:1782216997.140438:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782216997.140467:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952d43072800/0x92b8e04cbf5f9654 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216997.140476:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952d43072800/0x92b8e04cbf5f9654 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216997.140485:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952d43072800/0x92b8e04cbf5f9654 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216997.140506:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b09c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713057920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782216997.140697:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216997.140796:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43d1cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1782216997.142198:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713057920 00000100:00100000:2.0:1782216997.142209:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713057920 00000100:00100000:2.0:1782216997.142261:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1782216997.142271:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e194c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+22:6516:x1868789713057920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782216997.142286:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782216997.142301:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e72e2d600/0x92b8e04cbf5f965b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f9654 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216997.142327:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e72e2d600/0x92b8e04cbf5f965b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9654 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216997.142338:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e72e2d600/0x92b8e04cbf5f965b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9654 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216997.142346:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2d600, rc 0) 00000100:00100000:2.0:1782216997.142406:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e194c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:6516:x1868789713057920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (1862us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216997.142413:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1782216997.142520:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b09c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713057920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782216997.142537:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952d43072800/0x92b8e04cbf5f9654 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f965b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216997.142698:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952d43072800/0x92b8e04cbf5f9654 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f965b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782216997.142786:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b09c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713058048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782216997.142821:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216997.142899:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43d1cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1782216997.145467:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713058048 00000100:00100000:2.0:1782216997.145479:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713058048 00000100:00100000:2.0:1782216997.145522:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1782216997.145531:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e190c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:6516:x1868789713058048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782216997.145690:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e190c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:6516:x1868789713058048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 159us (2868us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216997.145698:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1782216997.145747:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b09c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713058048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782216997.145809:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43dcad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713058176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782216997.145853:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216997.145893:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e411ca240 going to sleep for 11 seconds 00000100:00100000:0.0:1782216997.145929:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713058176 00000100:00100000:0.0:1782216997.145936:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713058176 00000100:00100000:0.0:1782216997.145970:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1782216997.145977:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:6516:x1868789713058176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782216997.146082:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:6516:x1868789713058176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 105us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216997.146089:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1782216997.146222:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43dcad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713058176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782216997.147771:0:13797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b09d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:13797:1868789713058304:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782216997.147837:0:13797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216997.147883:0:13797:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43d1c480 going to sleep for 11 seconds 00000100:00100000:2.0:1782216997.147913:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713058304 00000100:00100000:2.0:1782216997.147920:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713058304 00000100:00100000:0.0:1782216997.147990:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1782216997.148002:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e191050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:13797:x1868789713058304:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782216997.148135:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e191050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:13797:x1868789713058304:12345-0@lo:502:llog_process_th.0 Request processed in 134us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216997.148142:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1782216997.149056:0:13797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b09d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:13797:1868789713058304:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782216997.149090:0:13797:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782216997.149101:0:13797:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782216997.149103:0:13797:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1782216997.149109:0:13797:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff952e7b38d800 00000020:00000080:1.0:1782216997.149112:0:13797:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782216997.149233:0:13797:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782216997.149237:0:13797:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782216997.149239:0:13797:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1782216997.149241:0:13797:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782216997.149243:0:13797:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782216997.149244:0:13797:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1782216997.149247:0:13797:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff952e7b38d800 00000020:00000080:1.0:1782216997.149249:0:13797:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1782216997.149288:0:13797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b09d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:13797:1868789713058432:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782216997.149337:0:13797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216997.149362:0:13797:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43d1c480 going to sleep for 11 seconds 00000100:00100000:2.0:1782216997.152834:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713058432 00000100:00100000:2.0:1782216997.152849:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713058432 00000100:00100000:2.0:1782216997.152916:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1782216997.152927:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e193c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:13797:x1868789713058432:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782216997.153121:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e193c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:13797:x1868789713058432:12345-0@lo:502:llog_process_th.0 Request processed in 195us (3782us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216997.153129:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1782216997.153370:0:13797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b09d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:13797:1868789713058432:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782216997.153414:0:13797:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782216997.153421:0:13797:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782216997.153423:0:13797:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1782216997.153427:0:13797:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1782216997.154326:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1782216997.154352:0:6516:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782216997.154362:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952d43072800/0x92b8e04cbf5f9654 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f965b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216997.154373:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952d43072800/0x92b8e04cbf5f9654 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f965b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782216997.154384:0:6516:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782216997.154387:0:6516:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff952e70905800 from 7 10000000:01000000:2.0:1782216997.154390:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782216997.154423:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e72e2de00/0x92b8e04cbf5f9662 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216997.154430:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e72e2de00/0x92b8e04cbf5f9662 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216997.154449:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e72e2de00/0x92b8e04cbf5f9662 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216997.154471:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43dcad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713058560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782216997.154518:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216997.154557:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e54d78840 going to sleep for 11 seconds 00000100:00100000:1.0:1782216997.154619:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713058560 00000100:00100000:1.0:1782216997.154626:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713058560 00000100:00100000:1.0:1782216997.154668:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1782216997.154677:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:6516:x1868789713058560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782216997.154688:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782216997.154699:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952d43072a00/0x92b8e04cbf5f9669 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5f9662 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216997.154720:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952d43072a00/0x92b8e04cbf5f9669 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9662 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216997.154931:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952d43072a00/0x92b8e04cbf5f9669 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5f9662 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782216997.154940:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43072a00, rc 0) 00000100:00100000:1.0:1782216997.154974:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e193850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:6516:x1868789713058560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 299us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216997.154980:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1782216997.155795:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43dcad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713058560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782216997.155813:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e72e2de00/0x92b8e04cbf5f9662 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f9669 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782216997.155822:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e72e2de00/0x92b8e04cbf5f9662 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f9669 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782216997.155888:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43dcad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713058688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782216997.155922:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216997.155955:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e54d78840 going to sleep for 11 seconds 00000100:00100000:2.0:1782216997.155973:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713058688 00000100:00100000:2.0:1782216997.155977:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713058688 00000100:00100000:2.0:1782216997.156008:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1782216997.156015:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:6516:x1868789713058688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782216997.156151:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e192c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:6516:x1868789713058688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 135us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216997.156159:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1782216997.156214:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43dcad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713058688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782216997.156246:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c690700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713058816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782216997.156285:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782216997.156306:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e50194b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782216997.156329:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713058816 00000100:00100000:2.0:1782216997.156334:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713058816 00000100:00100000:2.0:1782216997.156385:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1782216997.156399:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:6516:x1868789713058816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782216997.156488:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e190050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:6516:x1868789713058816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1782216997.156495:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1782216997.156561:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c690700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:17bce19a-7a0f-4c9d-b31c-4e0155298487:6516:1868789713058816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782216997.156932:0:13799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43dcad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:13799:1868789713058944:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782216997.156959:0:13799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216997.156996:0:13799:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e5214ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1782216997.157018:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713058944 00000100:00100000:0.0:1782216997.157021:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713058944 00000100:00100000:0.0:1782216997.157052:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1782216997.157066:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e190850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:13799:x1868789713058944:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782216997.157174:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e190850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:13799:x1868789713058944:12345-0@lo:502:llog_process_th.0 Request processed in 108us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216997.157253:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1782216997.157313:0:13799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43dcad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:13799:1868789713058944:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782216997.157335:0:13799:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782216997.157344:0:13799:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782216997.157346:0:13799:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1782216997.157353:0:13799:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff952e70905800 00000020:00000080:2.0:1782216997.157355:0:13799:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1782216997.157443:0:13799:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782216997.157448:0:13799:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782216997.157449:0:13799:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1782216997.157452:0:13799:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782216997.157455:0:13799:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782216997.157457:0:13799:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1782216997.157465:0:13799:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff952e70905800 00000020:00000080:2.0:1782216997.157468:0:13799:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1782216997.157506:0:13799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43dcad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:13799:1868789713059072:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782216997.157540:0:13799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216997.157639:0:13799:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e5214ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1782216997.157739:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713059072 00000100:00100000:1.0:1782216997.157744:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713059072 00000100:00100000:1.0:1782216997.157807:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1782216997.157816:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:13799:x1868789713059072:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782216997.157889:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e192450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:13799:x1868789713059072:12345-0@lo:502:llog_process_th.0 Request processed in 75us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216997.157905:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1782216997.157957:0:13799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43dcad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:17bce19a-7a0f-4c9d-b31c-4e0155298487:13799:1868789713059072:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782216997.157976:0:13799:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782216997.157980:0:13799:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782216997.157991:0:13799:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1782216997.157994:0:13799:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1782216997.158134:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1782216997.158154:0:6516:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782216997.158164:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e72e2de00/0x92b8e04cbf5f9662 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f9669 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782216997.158172:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e72e2de00/0x92b8e04cbf5f9662 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f9669 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782216997.176005:0:13800:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1782216997.369228:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782216998.202515:0:13796:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1782216998.202888:0:13800:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1782216998.393225:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782216998.457086:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713059328:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782216998.457156:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216998.457217:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1868789713059840:0@lo:400:kworker.0 00000100:00100000:2.0:1782216998.457242:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216998.457263:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e52f7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713060352:0@lo:400:kworker.0 00000100:00100000:2.0:1782216998.457286:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216998.457299:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e52f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713060864:0@lo:400:kworker.0 00000100:00100000:2.0:1782216998.457326:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216998.457353:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1782216998.457359:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789713059456:0@lo:400:kworker.0 00000100:00100000:2.0:1782216998.457386:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216998.457403:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e52f7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713059968:0@lo:400:kworker.0 00000100:00100000:2.0:1782216998.457426:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216998.457441:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e52f7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713060480:0@lo:400:kworker.0 00000100:00100000:2.0:1782216998.457460:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216998.457461:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43dcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713059200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782216998.457475:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4368d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713060992:0@lo:400:kworker.0 00000100:00100000:3.0:1782216998.457593:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713059968 00000100:00100000:3.0:1782216998.457600:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713059968 00000100:00100000:3.0:1782216998.457640:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1782216998.457649:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713059968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782216998.457809:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713059328 00000100:00100000:0.0:1782216998.457813:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713059328 00000100:00100000:0.0:1782216998.457847:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1782216998.457854:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43313480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1868789713059328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782216998.457876:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782216998.463488:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216998.463548:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713059712:0@lo:400:kworker.0 00000100:00100000:1.0:1782216998.463612:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216998.463636:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e52f7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1868789713060224:0@lo:400:kworker.0 00000100:00100000:1.0:1782216998.463661:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216998.463679:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e52f7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1868789713060736:0@lo:400:kworker.0 00000100:00100000:1.0:1782216998.463700:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216998.463728:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713061248:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782216998.463750:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216998.463764:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1782216998.463771:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4379b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1868789713059584:0@lo:400:kworker.0 00000100:00100000:1.0:1782216998.463791:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216998.463808:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e52f7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1868789713060096:0@lo:400:kworker.0 00000100:00100000:1.0:1782216998.463828:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216998.463839:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e52f7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1868789713060608:0@lo:400:kworker.0 00000100:00100000:1.0:1782216998.463858:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216998.463867:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43310e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713061120:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782216998.463885:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782216998.463921:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713059840 00000100:00100000:1.0:1782216998.463929:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713059840 00000100:00100000:1.0:1782216998.463964:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713060224 00000100:00100000:1.0:1782216998.463980:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713060224 00000100:00100000:1.0:1782216998.464000:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713060736 00000100:00100000:1.0:1782216998.464003:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713060736 00000100:00100000:1.0:1782216998.464013:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713059584 00000100:00100000:1.0:1782216998.464016:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713059584 00000100:00100000:1.0:1782216998.464025:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713060096 00000100:00100000:1.0:1782216998.464027:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713060096 00000100:00100000:1.0:1782216998.464051:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713060608 00000100:00100000:1.0:1782216998.464053:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713060608 00000100:00100000:1.0:1782216998.464067:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1782216998.464074:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43311180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1868789713059840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216998.470341:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713059968:12345-0@lo:400:kworker.0 Request processed in 12683us (12904us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216998.470358:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1782216998.470392:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713059712 00000100:00100000:3.0:1782216998.470399:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713059712 00000100:00100000:3.0:1782216998.470448:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1782216998.470456:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b09c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713059712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216998.471065:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b09c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713059712:12345-0@lo:400:kworker.0 Request processed in 608us (7450us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216998.471073:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1782216998.471111:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713060352 00000100:00100000:3.0:1782216998.471116:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713060352 00000100:00100000:3.0:1782216998.471149:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713060864 00000100:00100000:3.0:1782216998.471152:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713060864 00000100:00100000:3.0:1782216998.471165:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713060480 00000100:00100000:3.0:1782216998.471168:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713060480 00000100:00100000:3.0:1782216998.471181:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1782216998.471187:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43310a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713060352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216998.471221:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43310a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713060352:12345-0@lo:400:kworker.0 Request processed in 34us (13934us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216998.471227:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1782216998.471239:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1782216998.471244:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713060864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216998.471271:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713060864:12345-0@lo:400:kworker.0 Request processed in 27us (13945us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216998.471277:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1782216998.471287:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1782216998.471292:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3647:x1868789713060480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216998.471315:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3647:x1868789713060480:12345-0@lo:400:kworker.0 Request processed in 23us (13856us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216998.471321:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:3.0:1782216998.471342:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782216998.471355:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782216998.471357:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782216998.471360:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782216998.471372:0:10535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713059200 00000100:00100000:3.0:1782216998.471376:0:10535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713059200 00000100:00100000:3.0:1782216998.471397:0:10535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713061248 00000100:00100000:3.0:1782216998.471399:0:10535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713061248 00000100:00100000:3.0:1782216998.471407:0:10535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713061120 00000100:00100000:3.0:1782216998.471409:0:10535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713061120 00000100:00100000:3.0:1782216998.471419:0:10535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1782216998.471425:0:10535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b09d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713059200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782216998.471444:0:10535:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782216998.471473:0:10535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b09d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713059200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (7992us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216998.471478:0:10535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1782216998.477286:0:10535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1782216998.477311:0:10535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b09c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713061248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782216998.477337:0:10535:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782216998.477410:0:10535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b09c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713061248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (13658us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216998.477417:0:10535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1782216998.477441:0:10535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1782216998.477448:0:10535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b09fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713061120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782216998.477457:0:10535:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782216998.477480:0:10535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b09fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713061120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (13594us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216998.477485:0:10535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:3.0:1782216998.480197:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782216998.480296:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1782216998.480311:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b09ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1868789713060224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216998.480391:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b09ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1868789713060224:12345-0@lo:400:kworker.0 Request processed in 85us (16727us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216998.480398:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1782216998.480415:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1782216998.480421:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b09e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1868789713060736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216998.480447:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b09e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1868789713060736:12345-0@lo:400:kworker.0 Request processed in 26us (16745us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216998.480452:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1782216998.480462:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1782216998.480468:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b09ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1868789713059584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216998.481264:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b09ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1868789713059584:12345-0@lo:400:kworker.0 Request processed in 792us (17468us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216998.481273:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1782216998.481292:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1782216998.481302:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b09f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1868789713060096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216998.481342:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b09f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1868789713060096:12345-0@lo:400:kworker.0 Request processed in 43us (17513us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216998.481347:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1782216998.481359:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1782216998.481365:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b09ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1868789713060608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216998.481392:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b09ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1868789713060608:12345-0@lo:400:kworker.0 Request processed in 27us (17533us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216998.481397:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1782216998.481495:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4379b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1868789713059584:0@lo:400:kworker.0 00000100:00100000:3.0:1782216998.481509:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e52f7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1868789713060096:0@lo:400:kworker.0 00000100:00100000:3.0:1782216998.481520:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e52f7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1868789713060608:0@lo:400:kworker.0 00010000:00080000:3.0:1782216998.481535:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43310e00 x1868789713061120/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782217014 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216998.481552:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43310e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713061120:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782216998.481570:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713061248:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1782216998.484916:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43dcad80 x1868789713059200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782217014 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216998.484947:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43dcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713059200:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782216998.484994:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713059712:0@lo:400:kworker.0 00010000:00080000:3.0:1782216998.485010:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e52f7f800 x1868789713060224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216998.485018:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e52f7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1868789713060224:0@lo:400:kworker.0 00010000:00080000:3.0:1782216998.485030:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e52f7dc00 x1868789713060736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782216998.485047:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e52f7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1868789713060736:0@lo:400:kworker.0 00000100:00100000:3.0:1782216998.485136:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713059456 00000100:00100000:3.0:1782216998.485142:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713059456 00000100:00100000:3.0:1782216998.485201:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1782216998.485209:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3647:x1868789713059456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216998.485296:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e192850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3647:x1868789713059456:12345-0@lo:400:kworker.0 Request processed in 88us (27909us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216998.485304:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1782216998.487344:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782216998.487429:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e52f7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713060352:0@lo:400:kworker.0 00010000:00080000:2.0:1782216998.487445:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e52f7c700 x1868789713060864/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782217014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216998.487454:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e52f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713060864:0@lo:400:kworker.0 00000100:00100000:2.0:1782216998.487479:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789713059456:0@lo:400:kworker.0 00000100:00100000:2.0:1782216998.487510:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e52f7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713059968:0@lo:400:kworker.0 00000100:00100000:2.0:1782216998.487522:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e52f7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713060480:0@lo:400:kworker.0 00000100:00100000:3.0:1782216998.488229:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713060992 00000100:00100000:3.0:1782216998.488238:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713060992 00000100:00100000:3.0:1782216998.488295:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1782216998.488305:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713060992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782216998.488371:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713060992:12345-0@lo:400:kworker.0 Request processed in 68us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216998.488378:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:2.0:1782216998.488473:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4368d880 x1868789713060992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782217014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782216998.488500:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4368d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713060992:0@lo:400:kworker.0 00000100:00100000:0.0:1782216998.491053:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43313480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1868789713059328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 33179us (33878us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216998.491068:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1782216998.494476:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713059328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782216998.498550:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43311180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1868789713059840:12345-0@lo:400:kworker.0 Request processed in 34466us (41296us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216998.498565:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1782216998.499616:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1868789713059840:0@lo:400:kworker.0 00000100:00100000:3.0:1782216998.850074:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782216998.850317:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782216998.850356:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782216998.850520:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782216998.850681:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693051008 00000100:00100000:1.0:1782216998.850694:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693051008 00000100:00100000:1.0:1782216998.850760:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 371 00000100:00100000:1.0:1782216998.850773:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:2403:x1868789693051008:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1782216998.850872:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e191c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:2403:x1868789693051008:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 101us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216998.850882:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 371 00000100:00100000:3.0:1782216998.856753:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782216998.856817:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782216998.860219:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693051136 00000100:00100000:0.0:1782216998.860241:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693051136 00000100:00100000:0.0:1782216998.860493:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693051264 00000100:00100000:0.0:1782216998.860498:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693051264 00000100:00100000:0.0:1782216998.860518:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693051520 00000100:00100000:0.0:1782216998.860522:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693051520 00000100:00100000:0.0:1782216998.860556:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 237 00000100:00100000:0.0:1782216998.860605:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42612680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+5:2403:x1868789693051136:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782216998.860726:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42612680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+5:2403:x1868789693051136:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 125us (10409us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216998.860735:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 237 00000100:00100000:0.0:1782216998.860754:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 238 00000100:00100000:0.0:1782216998.860760:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+5:2403:x1868789693051264:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782216998.860786:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+5:2403:x1868789693051264:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 26us (10430us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216998.860792:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 238 00000100:00100000:0.0:1782216998.860803:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 239 00000100:00100000:0.0:1782216998.860810:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a927f5f6-9735-45e0-abce-963bd125e020+5:2403:x1868789693051520:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782216998.860901:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a927f5f6-9735-45e0-abce-963bd125e020+5:2403:x1868789693051520:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 91us (10380us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216998.860908:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 239 00000100:00080000:0.0:1782216998.860937:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782216998.860942:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782216998.861044:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693051392 00000100:00100000:0.0:1782216998.861049:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693051392 00000100:00100000:0.0:1782216998.861089:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 71 00000100:00100000:0.0:1782216998.861095:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4268e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24a87249-c61f-41a1-85ec-9a313129e739+5:2402:x1868789693051392:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782216998.861125:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4268e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24a87249-c61f-41a1-85ec-9a313129e739+5:2402:x1868789693051392:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 30us (4388us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216998.861132:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 71 00000100:00080000:0.0:1782216998.861146:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782216998.865571:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693051648 00000100:00100000:1.0:1782216998.865608:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693051648 00000100:00080000:2.0:1782216998.865727:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782216998.865891:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 240 00000100:00100000:0.0:1782216998.865906:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4268d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a927f5f6-9735-45e0-abce-963bd125e020+5:2402:x1868789693051648:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782216998.866026:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4268d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a927f5f6-9735-45e0-abce-963bd125e020+5:2402:x1868789693051648:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 124us (9207us total) trans 0 rc 0/0 00000100:00100000:0.0:1782216998.866044:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 240 00000100:00100000:1.0:1782216998.975976:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782216998.976013:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43dcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713061376:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782216998.976131:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216998.984263:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713061376 00000100:00100000:3.0:1782216998.984540:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713061376 00000100:00100000:3.0:1782216998.984865:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1782216998.984880:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b09df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713061376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1782216998.984928:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1782216998.985117:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b09df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713061376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 240us (8986us total) trans 0 rc 0/0 00000100:00100000:1.0:1782216998.985232:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43dcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713061376:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782216998.985664:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00010000:00010000:0.0:1782216999.417182:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782216999.993219:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782216999.993255:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4368c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713061504:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782216999.993363:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782216999.993879:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713061504 00000100:00100000:3.0:1782216999.993895:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713061504 00000100:00100000:3.0:1782216999.993969:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1782216999.993998:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4368f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713061504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782216999.994060:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1782216999.994128:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4368f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713061504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 132us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1782216999.994136:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1782216999.994234:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4368c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713061504:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1782217000.441335:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782217001.020953:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00010000:00010000:3.0:1782217001.464958:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217002.493438:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217003.514093:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782217003.580987:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782217003.581030:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43dcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713061632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782217003.581133:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217003.581245:0:10535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713061632 00000100:00100000:3.0:1782217003.581254:0:10535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713061632 00000100:00100000:3.0:1782217003.581321:0:10535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1782217003.581332:0:10535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43310e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713061632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782217003.581370:0:10535:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782217003.581417:0:10535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43310e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713061632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217003.581425:0:10535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00010000:00080000:3.0:1782217003.581477:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43dcad80 x1868789713061632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782217019 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217003.581504:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43dcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713061632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782217003.581810:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782217003.581838:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4368c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713061760:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782217003.581878:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217003.581906:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782217003.581915:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b09ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713061888:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782217003.581939:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217003.581966:0:10535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713061760 00000100:00100000:1.0:1782217003.581970:0:10535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713061760 00000100:00100000:1.0:1782217003.582008:0:10535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713061888 00000100:00100000:1.0:1782217003.582011:0:10535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713061888 00000100:00100000:1.0:1782217003.582029:0:10535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1782217003.582036:0:10535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713061760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782217003.582051:0:10535:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782217003.582084:0:10535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713061760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217003.582091:0:10535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1782217003.582106:0:10535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1782217003.582113:0:10535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713061888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782217003.582132:0:10535:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782217003.582165:0:10535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713061888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217003.582171:0:10535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1782217003.582206:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b09ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713061888:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1782217003.582242:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4368c380 x1868789713061760/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782217019 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782217003.582256:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4368c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713061760:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1782217003.582905:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782217003.582911:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782217003.582921:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1868789713062144:0@lo:400:kworker.0 00000100:00100000:2.0:1782217003.582962:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217003.582988:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1868789713062656:0@lo:400:kworker.0 00000100:00100000:2.0:1782217003.583020:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217003.583035:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1868789713063168:0@lo:400:kworker.0 00000100:00100000:2.0:1782217003.583060:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217003.583079:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1782217003.583084:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713062272:0@lo:400:kworker.0 00000100:00100000:2.0:1782217003.583110:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217003.583129:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1868789713062784:0@lo:400:kworker.0 00000100:00100000:2.0:1782217003.583153:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217003.583196:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713062272 00000100:00100000:2.0:1782217003.583202:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713062272 00000100:00100000:0.0:1782217003.583358:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713062144 00000100:00100000:0.0:1782217003.583363:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713062144 00000100:00100000:0.0:1782217003.583393:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713062656 00000100:00100000:0.0:1782217003.583396:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713062656 00000100:00100000:0.0:1782217003.583418:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713063168 00000100:00100000:0.0:1782217003.583421:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713063168 00000100:00100000:0.0:1782217003.583432:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713062784 00000100:00100000:0.0:1782217003.583434:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713062784 00000100:00100000:0.0:1782217003.583448:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1782217003.583455:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1868789713062144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217003.583503:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1868789713062144:12345-0@lo:400:kworker.0 Request processed in 48us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217003.583511:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1782217003.583528:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1782217003.583534:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1868789713062656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217003.583561:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1868789713062656:12345-0@lo:400:kworker.0 Request processed in 27us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217003.583577:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1782217003.583615:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1782217003.583622:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1868789713063168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217003.583655:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1868789713063168:12345-0@lo:400:kworker.0 Request processed in 34us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217003.583661:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1782217003.583672:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1782217003.583677:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1868789713062784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217003.583702:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1868789713062784:12345-0@lo:400:kworker.0 Request processed in 25us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217003.583708:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:0.0:1782217003.583722:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782217003.583725:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782217003.583761:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1868789713062400:0@lo:400:kworker.0 00000100:00100000:0.0:1782217003.583790:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217003.583808:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713062400 00000100:00100000:0.0:1782217003.583812:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713062400 00000100:00100000:0.0:1782217003.583834:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1782217003.583840:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4368e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1868789713062400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217003.583870:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4368e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1868789713062400:12345-0@lo:400:kworker.0 Request processed in 29us (78us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217003.583876:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1782217003.583911:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1868789713062400:0@lo:400:kworker.0 00000100:00100000:0.0:1782217003.583918:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713062912:0@lo:400:kworker.0 00000100:00100000:0.0:1782217003.583958:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217003.583987:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1782217003.583993:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789713062016:0@lo:400:kworker.0 00000100:00100000:0.0:1782217003.584032:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217003.584056:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713062528:0@lo:400:kworker.0 00000100:00100000:0.0:1782217003.584077:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217003.584099:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713062528 00000100:00100000:0.0:1782217003.584102:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713062528 00000100:00100000:0.0:1782217003.584127:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1782217003.584134:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4368ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713062528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217003.584167:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4368ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713062528:12345-0@lo:400:kworker.0 Request processed in 33us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217003.584172:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1782217003.584197:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713062528:0@lo:400:kworker.0 00000100:00100000:0.0:1782217003.584205:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1868789713063040:0@lo:400:kworker.0 00000100:00100000:0.0:1782217003.584227:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217003.584336:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713063040 00000100:00100000:0.0:1782217003.584340:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713063040 00000100:00080000:0.0:1782217003.584356:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782217003.584379:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1782217003.584385:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4368dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1868789713063040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217003.584418:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4368dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1868789713063040:12345-0@lo:400:kworker.0 Request processed in 34us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217003.584424:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1782217003.584452:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1868789713063040:0@lo:400:kworker.0 00010000:00080000:0.0:1782217003.584504:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43df5880 x1868789713062784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782217003.584517:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1868789713062784:0@lo:400:kworker.0 00000100:00100000:0.0:1782217003.584530:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1868789713062144:0@lo:400:kworker.0 00000100:00100000:0.0:1782217003.584541:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1868789713062656:0@lo:400:kworker.0 00010000:00080000:0.0:1782217003.584550:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43df4700 x1868789713063168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782217003.584558:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1868789713063168:0@lo:400:kworker.0 00000100:00100000:0.0:1782217003.584576:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782217003.584611:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4368c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713063296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782217003.584639:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217003.584808:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1782217003.584817:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713062272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217003.584859:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713062272:12345-0@lo:400:kworker.0 Request processed in 43us (1748us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217003.584865:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1782217003.584892:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713062272:0@lo:400:kworker.0 00000100:00100000:3.0:1782217003.585860:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713062912 00000100:00100000:3.0:1782217003.585869:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713062912 00000100:00100000:3.0:1782217003.585945:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1782217003.585954:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4368f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713062912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217003.586043:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4368f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713062912:12345-0@lo:400:kworker.0 Request processed in 90us (2083us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217003.586050:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1782217003.586077:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713062016 00000100:00100000:3.0:1782217003.586081:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713062016 00000100:00100000:3.0:1782217003.586108:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1782217003.586115:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3647:x1868789713062016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217003.586149:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e193050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3647:x1868789713062016:12345-0@lo:400:kworker.0 Request processed in 34us (2115us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217003.586154:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1782217003.586446:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789713062016:0@lo:400:kworker.0 00000100:00100000:3.0:1782217003.586461:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1782217003.586467:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff952d42611500, transno 4294967301 00000100:00100000:3.0:1782217003.586480:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713062912:0@lo:400:kworker.0 00000100:00100000:1.0:1782217003.587577:0:10535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713063296 00000100:00100000:1.0:1782217003.587645:0:10535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713063296 00000100:00100000:1.0:1782217003.587706:0:10535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1782217003.587716:0:10535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4368c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713063296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782217003.587743:0:10535:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782217003.587820:0:10535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4368c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713063296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (3179us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217003.587827:0:10535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:2.0:1782217003.587927:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782217003.588568:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4368c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713063296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782217003.964671:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217003.964714:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217003.964738:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217003.964752:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217003.964765:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217003.964782:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217003.964807:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693052160 00000100:00100000:0.0:1782217003.964816:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693052160 00000100:00100000:0.0:1782217003.964867:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 73 00000100:00100000:0.0:1782217003.964876:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4368d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24a87249-c61f-41a1-85ec-9a313129e739+5:2402:x1868789693052160:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782217003.964939:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4368d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24a87249-c61f-41a1-85ec-9a313129e739+5:2402:x1868789693052160:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 64us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217003.964959:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 73 00000100:00100000:0.0:1782217003.964981:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693051904 00000100:00100000:0.0:1782217003.964984:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693051904 00000100:00100000:0.0:1782217003.965016:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693052032 00000100:00100000:0.0:1782217003.965018:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693052032 00000100:00100000:0.0:1782217003.965031:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693052416 00000100:00100000:0.0:1782217003.965033:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693052416 00000100:00100000:0.0:1782217003.965044:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693052288 00000100:00100000:0.0:1782217003.965046:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693052288 00000100:00100000:0.0:1782217003.965059:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 247 00000100:00100000:0.0:1782217003.965065:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4368c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+5:2402:x1868789693051904:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782217003.965163:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4368c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+5:2402:x1868789693051904:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 97us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217003.965169:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 247 00000100:00100000:0.0:1782217003.965181:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 248 00000100:00100000:0.0:1782217003.965187:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4368d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+5:2403:x1868789693052032:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782217003.965221:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4368d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+5:2403:x1868789693052032:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 34us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217003.965227:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 248 00000100:00100000:0.0:1782217003.965237:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 249 00000100:00100000:0.0:1782217003.965243:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4368fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a927f5f6-9735-45e0-abce-963bd125e020+5:2402:x1868789693052416:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782217003.965287:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4368fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a927f5f6-9735-45e0-abce-963bd125e020+5:2402:x1868789693052416:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 43us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217003.965293:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 249 00000100:00100000:0.0:1782217003.965304:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 250 00000100:00100000:0.0:1782217003.965316:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4368f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a927f5f6-9735-45e0-abce-963bd125e020+5:2403:x1868789693052288:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782217003.965339:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4368f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a927f5f6-9735-45e0-abce-963bd125e020+5:2403:x1868789693052288:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 24us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217003.965345:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 250 00000100:00100000:3.0:1782217003.965498:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693051776 00000100:00100000:3.0:1782217003.965503:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693051776 00000100:00100000:3.0:1782217003.965541:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 373 00000100:00100000:3.0:1782217003.965548:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e192050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:2403:x1868789693051776:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1782217003.965576:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e192050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:2403:x1868789693051776:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 29us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217003.965619:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 373 00000100:00080000:2.0:1782217003.966253:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782217003.966265:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782217003.966270:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782217004.089414:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782217004.089444:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713063424:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782217004.089522:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217004.089666:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713063424 00000100:00100000:3.0:1782217004.089679:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713063424 00000100:00100000:3.0:1782217004.089759:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1782217004.089770:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713063424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1782217004.089841:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1782217004.089951:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713063424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 183us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217004.089959:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1782217004.090198:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713063424:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1782217004.536931:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782217005.114295:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4368ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713063552:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782217005.118683:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217005.122523:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713063552 00000100:00100000:0.0:1782217005.122547:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713063552 00000100:00100000:0.0:1782217005.122747:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1782217005.122762:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713063552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782217005.122816:0:7938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1782217005.122948:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713063552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 190us (4274us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217005.122957:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1782217005.123091:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4368ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713063552:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1782217005.563438:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217006.589797:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217007.611146:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782217008.441371:0:13800:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1782217008.442237:0:13796:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1782217008.633180:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782217008.696833:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4273ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713063680:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782217008.696854:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713063808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782217008.696877:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782217008.696895:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4368df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713064064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782217008.697128:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4273ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713064448:0@lo:400:kworker.0 00000100:00100000:3.0:1782217008.697240:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217008.697325:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4273d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1868789713064320:0@lo:400:kworker.0 00000100:00100000:3.0:1782217008.697369:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217008.697391:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b09ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1868789713064832:0@lo:400:kworker.0 00000100:00100000:3.0:1782217008.697414:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217008.697432:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1868789713065344:0@lo:400:kworker.0 00000100:00100000:3.0:1782217008.697453:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217008.697469:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1782217008.697475:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4273c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17bce19a-7a0f-4c9d-b31c-4e0155298487:3650:1868789713064192:0@lo:400:kworker.0 00000100:00100000:3.0:1782217008.697503:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217008.697528:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4273ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713064704:0@lo:400:kworker.0 00000100:00100000:3.0:1782217008.697553:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217008.699072:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713065216:0@lo:400:kworker.0 00000100:00100000:3.0:1782217008.699140:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217008.699178:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713065728:0@lo:400:kworker.0 00000100:00100000:3.0:1782217008.699215:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217008.699270:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713063808 00000100:00100000:3.0:1782217008.699279:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713063808 00000100:00100000:3.0:1782217008.699361:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1782217008.699375:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43dcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713063808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782217008.699412:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782217008.699456:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43dcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713063808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (2218us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217008.699463:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1782217008.699488:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713064320 00000100:00100000:3.0:1782217008.699492:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713064320 00000100:00100000:3.0:1782217008.699519:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713064832 00000100:00100000:3.0:1782217008.699522:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713064832 00000100:00100000:3.0:1782217008.699535:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713065344 00000100:00100000:3.0:1782217008.699538:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713065344 00000100:00100000:3.0:1782217008.699551:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1782217008.699556:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52f7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1868789713064320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217008.699619:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52f7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1868789713064320:12345-0@lo:400:kworker.0 Request processed in 62us (2249us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217008.699625:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1782217008.699636:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1782217008.699640:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52f7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1868789713064832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217008.699663:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52f7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1868789713064832:12345-0@lo:400:kworker.0 Request processed in 23us (2249us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217008.699669:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1782217008.699866:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217008.699884:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1782217008.699894:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52f7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1868789713065344:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1782217008.699909:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782217008.699915:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782217008.699931:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52f7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1868789713065344:12345-0@lo:400:kworker.0 Request processed in 40us (2477us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217008.699936:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1782217008.699956:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217008.699991:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4273fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713063936:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782217008.700018:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217008.700031:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4273f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1868789713064576:0@lo:400:kworker.0 00000100:00100000:0.0:1782217008.700056:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217008.700084:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713065088:0@lo:400:kworker.0 00000100:00100000:0.0:1782217008.700106:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217008.700122:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713065600:0@lo:400:kworker.0 00000100:00100000:0.0:1782217008.700142:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217008.700170:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713065216 00000100:00100000:0.0:1782217008.700175:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713065216 00000100:00100000:0.0:1782217008.700205:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713065728 00000100:00100000:0.0:1782217008.700208:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713065728 00000100:00100000:0.0:1782217008.700219:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713065088 00000100:00100000:0.0:1782217008.700221:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713065088 00000100:00100000:0.0:1782217008.700232:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713065600 00000100:00100000:0.0:1782217008.700234:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713065600 00000100:00100000:0.0:1782217008.700250:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1782217008.700256:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52f7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713065216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217008.700288:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52f7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713065216:12345-0@lo:400:kworker.0 Request processed in 32us (1149us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217008.700295:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1782217008.700427:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713064576 00000100:00100000:3.0:1782217008.700432:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713064576 00000100:00100000:1.0:1782217008.700612:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217008.700663:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1868789713064960:0@lo:400:kworker.0 00000100:00100000:0.0:1782217008.700684:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1782217008.700698:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52f7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713065728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217008.700709:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217008.700730:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1868789713065472:0@lo:400:kworker.0 00000100:00100000:0.0:1782217008.700763:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52f7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713065728:12345-0@lo:400:kworker.0 Request processed in 68us (1543us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217008.700777:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217008.700783:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1782217008.700808:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1782217008.700819:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4368ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713065088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217008.700844:0:10535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713063680 00000100:00100000:1.0:1782217008.700854:0:10535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713063680 00000100:00100000:0.0:1782217008.700871:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4368ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3648:x1868789713065088:12345-0@lo:400:kworker.0 Request processed in 54us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217008.700879:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1782217008.700901:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1782217008.700908:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4368c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713065600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217008.700934:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4368c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713065600:12345-0@lo:400:kworker.0 Request processed in 28us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217008.700940:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1782217008.700968:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782217008.700972:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782217008.700980:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713064960 00000100:00100000:0.0:1782217008.700984:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713064960 00000100:00100000:0.0:1782217008.701009:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713065472 00000100:00100000:0.0:1782217008.701012:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713065472 00000100:00100000:0.0:1782217008.701024:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1782217008.701030:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4368e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1868789713064576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217008.701059:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4368e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1868789713064576:12345-0@lo:400:kworker.0 Request processed in 29us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217008.701065:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1782217008.701077:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1782217008.701082:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d410b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1868789713064960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217008.701115:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d410b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1868789713064960:12345-0@lo:400:kworker.0 Request processed in 33us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217008.701121:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1782217008.701132:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1782217008.701137:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d410b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1868789713065472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217008.701162:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d410b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1868789713065472:12345-0@lo:400:kworker.0 Request processed in 25us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217008.701168:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00080000:0.0:1782217008.701180:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782217008.701743:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4273f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1868789713064576:0@lo:400:kworker.0 00000100:00100000:0.0:1782217008.701758:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713065088:0@lo:400:kworker.0 00010000:00080000:0.0:1782217008.701775:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d410b3480 x1868789713065600/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782217024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782217008.701786:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713065600:0@lo:400:kworker.0 00000100:00100000:2.0:1782217008.701810:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713064704 00000100:00100000:2.0:1782217008.701818:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713064704 00000100:00100000:2.0:1782217008.701861:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713064448 00010000:00080000:0.0:1782217008.701862:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d410b2680 x1868789713064960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782217008.701866:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713064448 00000100:00100000:0.0:1782217008.701876:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1868789713064960:0@lo:400:kworker.0 00000100:00100000:2.0:1782217008.701885:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00010000:00080000:0.0:1782217008.701893:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d410b1500 x1868789713065472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782217008.701895:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52f7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713064704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217008.701909:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1868789713065472:0@lo:400:kworker.0 00000100:00100000:0.0:1782217008.701957:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1782217008.701976:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d410b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713064448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217008.702034:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d410b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713064448:12345-0@lo:400:kworker.0 Request processed in 60us (1429us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217008.702042:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52f7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713064704:12345-0@lo:400:kworker.0 Request processed in 148us (4485us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217008.702045:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1782217008.702056:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1782217008.702076:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713064064 00000100:00100000:0.0:1782217008.702081:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713064064 00000100:00100000:2.0:1782217008.702087:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713064192 00000100:00100000:2.0:1782217008.702093:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713064192 00000100:00100000:2.0:1782217008.702180:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1782217008.702187:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e190450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3650:x1868789713064192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217008.702232:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e190450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3650:x1868789713064192:12345-0@lo:400:kworker.0 Request processed in 46us (4727us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217008.702239:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1782217008.702633:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713063936 00000100:00100000:2.0:1782217008.702638:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713063936 00000100:00100000:3.0:1782217008.703502:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4273c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17bce19a-7a0f-4c9d-b31c-4e0155298487:3650:1868789713064192:0@lo:400:kworker.0 00000100:00100000:3.0:1782217008.703523:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4273ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713064704:0@lo:400:kworker.0 00000100:00100000:3.0:1782217008.703538:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713065216:0@lo:400:kworker.0 00010000:00080000:3.0:1782217008.703555:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d410b3800 x1868789713065728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782217024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217008.703745:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713065728:0@lo:400:kworker.0 00000100:00100000:3.0:1782217008.703765:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4273d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1868789713064320:0@lo:400:kworker.0 00000100:00100000:3.0:1782217008.703778:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b09ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1868789713064832:0@lo:400:kworker.0 00000100:00100000:3.0:1782217008.703791:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1868789713065344:0@lo:400:kworker.0 00010000:00080000:3.0:1782217008.703804:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d42611500 x1868789713063808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782217024 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217008.703823:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713063808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782217008.703925:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4273ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713064448:0@lo:400:kworker.0 00000100:00100000:1.0:1782217008.704272:0:10535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1782217008.704295:0:10535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c692680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713063680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782217008.704331:0:10535:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782217008.704690:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1782217008.704708:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4368ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713064064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782217008.704732:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782217008.704828:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4368ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713064064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (4870us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217008.704852:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1782217008.704894:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4368df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713064064:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782217008.704942:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1782217008.704955:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4368ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713063936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782217008.704983:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782217008.705146:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4273ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713063680:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1782217008.705193:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4273fb80 x1868789713063936/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782217024 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217008.705209:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4273fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713063936:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782217008.705270:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4368ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713063936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 318us (5250us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217008.705286:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1782217008.708595:0:10535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c692680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713063680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4290us (8708us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217008.708610:0:10535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1782217009.088522:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217009.088571:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217009.088670:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217009.088810:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693052544 00000100:00100000:0.0:1782217009.088825:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693052544 00000100:00100000:0.0:1782217009.088905:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 375 00000100:00100000:0.0:1782217009.088916:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e193450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:2405:x1868789693052544:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782217009.089005:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e193450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:2405:x1868789693052544:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 90us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217009.089013:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 375 00000100:00100000:2.0:1782217009.089073:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693052800 00000100:00100000:2.0:1782217009.089085:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693052800 00000100:00100000:2.0:1782217009.089166:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693052672 00000100:00100000:2.0:1782217009.089172:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693052672 00000100:00100000:2.0:1782217009.089202:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 257 00000100:00080000:0.0:1782217009.089208:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782217009.089216:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52f7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+5:2405:x1868789693052800:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1782217009.089287:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52f7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+5:2405:x1868789693052800:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 76us (714us total) trans 0 rc 0/0 00000100:00080000:0.0:1782217009.089289:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782217009.089300:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 257 00000100:00100000:2.0:1782217009.089323:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 258 00000100:00100000:2.0:1782217009.089330:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52f7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+5:2405:x1868789693052672:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1782217009.089982:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52f7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+5:2405:x1868789693052672:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 649us (1309us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217009.089990:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 258 00000100:00100000:0.0:1782217009.107352:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217009.107407:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217009.107439:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217009.107520:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693053056 00000100:00100000:3.0:1782217009.107530:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693053056 00000100:00100000:3.0:1782217009.107625:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693053184 00000100:00100000:3.0:1782217009.107629:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693053184 00000100:00100000:3.0:1782217009.107658:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 259 00000100:00100000:3.0:1782217009.107666:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4368df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a927f5f6-9735-45e0-abce-963bd125e020+5:2402:x1868789693053056:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1782217009.107745:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4368df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a927f5f6-9735-45e0-abce-963bd125e020+5:2402:x1868789693053056:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 79us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217009.107753:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 259 00000100:00100000:3.0:1782217009.107770:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 260 00000100:00100000:3.0:1782217009.107776:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a927f5f6-9735-45e0-abce-963bd125e020+5:2402:x1868789693053184:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1782217009.107802:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a927f5f6-9735-45e0-abce-963bd125e020+5:2402:x1868789693053184:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 25us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217009.107807:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 260 00000100:00080000:0.0:1782217009.108033:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782217009.108038:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782217009.108335:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693052928 00000100:00100000:2.0:1782217009.108341:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693052928 00000100:00100000:2.0:1782217009.108394:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 27 00000100:00100000:2.0:1782217009.108402:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4368d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24a87249-c61f-41a1-85ec-9a313129e739+5:2401:x1868789693052928:12345-192.168.203.30@tcp:9:kworker.0 00000020:00000080:2.0:1782217009.108422:0:8432:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f9590 00000100:00080000:2.0:1782217009.108430:0:8432:0:(import.c:65:import_set_state_nolock()) ffff952e7b356000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782217009.108474:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:2.0:1782217009.108627:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4368d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24a87249-c61f-41a1-85ec-9a313129e739+2:2401:x1868789693052928:12345-192.168.203.30@tcp:9:kworker.0 Request processed in 225us (1284us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217009.108634:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 27 00010000:00010000:3.0:1782217009.108812:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782217009.111343:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782217009.209103:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713065856:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782217009.209172:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217009.209402:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713065856 00000100:00100000:3.0:1782217009.209410:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713065856 00000100:00100000:3.0:1782217009.209461:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1782217009.209470:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713065856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1782217009.209502:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1782217009.209561:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713065856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217009.209569:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1782217009.209674:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713065856:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1782217009.657655:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782217010.232964:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782217010.232988:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4273ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713065984:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782217010.233056:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217010.233183:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713065984 00000100:00100000:2.0:1782217010.233191:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713065984 00000100:00100000:2.0:1782217010.233238:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1782217010.233248:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d410b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713065984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782217010.233280:0:7938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1782217010.233334:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d410b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713065984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217010.233342:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1782217010.233430:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4273ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713065984:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1782217010.680758:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217011.705358:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217012.729103:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217013.754180:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782217013.816794:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b09ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713066368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782217013.816794:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713066112:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782217013.816953:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713066240:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782217013.817143:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c696300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713066496:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782217013.819418:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217013.819495:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4273d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17bce19a-7a0f-4c9d-b31c-4e0155298487:3648:1868789713066624:0@lo:400:kworker.0 00000100:00100000:1.0:1782217013.819538:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217013.819733:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4273ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713067136:0@lo:400:kworker.0 00000100:00100000:1.0:1782217013.819763:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217013.822108:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713067648:0@lo:400:kworker.0 00000100:00100000:1.0:1782217013.822164:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217013.822194:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713068160:0@lo:400:kworker.0 00000100:00100000:1.0:1782217013.822457:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217013.822511:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713066624 00000100:00100000:1.0:1782217013.822518:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713066624 00000100:00100000:1.0:1782217013.822563:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1782217013.822601:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4e191850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3648:x1868789713066624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217013.822653:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4e191850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3648:x1868789713066624:12345-0@lo:400:kworker.0 Request processed in 82us (3115us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217013.822689:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1782217013.822725:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713067136 00000100:00100000:1.0:1782217013.822729:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713067136 00000100:00100000:1.0:1782217013.822755:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1782217013.822761:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d410b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713067136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217013.822812:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d410b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713067136:12345-0@lo:400:kworker.0 Request processed in 51us (3048us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217013.822818:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1782217013.822855:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4273d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17bce19a-7a0f-4c9d-b31c-4e0155298487:3648:1868789713066624:0@lo:400:kworker.0 00000100:00100000:1.0:1782217013.822867:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4273ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713067136:0@lo:400:kworker.0 00000100:00100000:1.0:1782217013.822906:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713066112 00000100:00100000:1.0:1782217013.822910:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713066112 00000100:00100000:1.0:1782217013.822955:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1782217013.822961:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d410b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713066112:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782217013.822980:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782217013.823094:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d410b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713066112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 132us (3680us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217013.823100:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:1.0:1782217013.823116:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1782217013.823140:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d410b2300 x1868789713066112/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782217029 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782217013.823155:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713066112:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782217013.823273:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713067648 00000100:00100000:1.0:1782217013.823277:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713067648 00000100:00100000:1.0:1782217013.823306:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713068160 00000100:00100000:1.0:1782217013.823318:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713068160 00000100:00100000:1.0:1782217013.823339:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1782217013.823789:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d410b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713067648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217013.823840:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d410b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713067648:12345-0@lo:400:kworker.0 Request processed in 494us (1675us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217013.823848:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1782217013.823862:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1782217013.823868:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d410b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713068160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217013.823894:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d410b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713068160:12345-0@lo:400:kworker.0 Request processed in 27us (1437us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217013.823899:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1782217013.823919:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782217013.823934:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782217013.823956:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713067648:0@lo:400:kworker.0 00010000:00080000:1.0:1782217013.823968:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43df7480 x1868789713068160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782217029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782217013.823978:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713068160:0@lo:400:kworker.0 00000100:00100000:2.0:1782217013.827041:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217013.827318:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4273ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1868789713066752:0@lo:400:kworker.0 00000100:00100000:2.0:1782217013.827363:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217013.827404:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713066752 00000100:00100000:2.0:1782217013.827411:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713066752 00000100:00100000:2.0:1782217013.827457:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1782217013.827465:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1868789713066752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217013.827532:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1868789713066752:12345-0@lo:400:kworker.0 Request processed in 67us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217013.827540:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1782217013.827597:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4273ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1868789713066752:0@lo:400:kworker.0 00000100:00100000:2.0:1782217013.827605:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1868789713067264:0@lo:400:kworker.0 00000100:00100000:2.0:1782217013.827628:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217013.827648:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713067264 00000100:00100000:2.0:1782217013.827651:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713067264 00000100:00100000:2.0:1782217013.827690:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1782217013.827697:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c697480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1868789713067264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217013.827725:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c697480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1868789713067264:12345-0@lo:400:kworker.0 Request processed in 29us (96us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217013.827730:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00080000:2.0:1782217013.827744:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782217013.827759:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1868789713067264:0@lo:400:kworker.0 00000100:00100000:2.0:1782217013.827765:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1868789713067776:0@lo:400:kworker.0 00000100:00100000:2.0:1782217013.827785:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217013.827800:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713067776 00000100:00100000:2.0:1782217013.827803:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713067776 00000100:00100000:2.0:1782217013.827825:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1782217013.827830:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1868789713067776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217013.827856:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1868789713067776:12345-0@lo:400:kworker.0 Request processed in 26us (70us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217013.827861:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00080000:2.0:1782217013.827875:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782217013.827897:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1868789713067776:0@lo:400:kworker.0 00000100:00100000:2.0:1782217013.827918:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1782217013.827937:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4273c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713066880:0@lo:400:kworker.0 00000100:00100000:2.0:1782217013.827962:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217013.827984:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713066880 00000100:00100000:2.0:1782217013.827987:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713066880 00000100:00100000:2.0:1782217013.828012:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1782217013.828019:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713066880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217013.828051:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713066880:12345-0@lo:400:kworker.0 Request processed in 32us (88us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217013.828128:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1782217013.828157:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4273c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713066880:0@lo:400:kworker.0 00000100:00100000:2.0:1782217013.828163:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1868789713067392:0@lo:400:kworker.0 00000100:00100000:2.0:1782217013.828185:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217013.828202:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713067392 00000100:00100000:2.0:1782217013.828204:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713067392 00000100:00100000:2.0:1782217013.828228:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1782217013.828234:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c697800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1868789713067392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217013.828262:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c697800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1868789713067392:12345-0@lo:400:kworker.0 Request processed in 28us (76us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217013.828268:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:2.0:1782217013.828282:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1782217013.828298:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43df7100 x1868789713067392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782217013.828308:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1868789713067392:0@lo:400:kworker.0 00000100:00100000:2.0:1782217013.828324:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1868789713067904:0@lo:400:kworker.0 00000100:00100000:1.0:1782217013.828394:0:10535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713066240 00000100:00100000:1.0:1782217013.828399:0:10535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713066240 00000100:00100000:1.0:1782217013.828434:0:10535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1782217013.828440:0:10535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c695880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713066240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782217013.828461:0:10535:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782217013.832669:0:10535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c695880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713066240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4219us (5624us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217013.832696:0:10535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:1.0:1782217013.832736:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782217013.833300:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217013.833378:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713066240:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782217013.836747:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217013.836814:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4273f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1868789713067008:0@lo:400:kworker.0 00000100:00100000:0.0:1782217013.837318:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217013.837350:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713067904 00000100:00100000:1.0:1782217013.837358:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713067904 00000100:00100000:1.0:1782217013.837411:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713067008 00000100:00100000:1.0:1782217013.837414:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713067008 00000100:00100000:1.0:1782217013.837431:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1782217013.837439:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1868789713067904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217013.837460:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713067520:0@lo:400:kworker.0 00000100:00100000:1.0:1782217013.837505:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1868789713067904:12345-0@lo:400:kworker.0 Request processed in 65us (4206us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217013.837506:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217013.837515:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1782217013.837537:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1782217013.837546:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1868789713067008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217013.837549:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713068032:0@lo:400:kworker.0 00000100:00100000:0.0:1782217013.837610:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217013.837617:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1868789713067008:12345-0@lo:400:kworker.0 Request processed in 72us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217013.837625:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:1.0:1782217013.837645:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782217013.837657:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4273f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1868789713067008:0@lo:400:kworker.0 00000100:00100000:1.0:1782217013.837676:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713067520 00000100:00100000:1.0:1782217013.837681:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713067520 00000100:00100000:1.0:1782217013.837703:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713068032 00000100:00100000:1.0:1782217013.837705:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713068032 00000100:00100000:1.0:1782217013.837720:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1782217013.837725:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713067520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217013.837759:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713067520:12345-0@lo:400:kworker.0 Request processed in 32us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217013.837766:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1782217013.837779:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1782217013.837785:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713066496 00000100:00100000:1.0:1782217013.837786:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713068032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217013.837792:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713066496 00000100:00100000:1.0:1782217013.837820:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713068032:12345-0@lo:400:kworker.0 Request processed in 34us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217013.837830:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1782217013.837843:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1782217013.837845:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713066496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782217013.837863:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782217013.837904:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713066496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (1162us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217013.837911:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00010000:00080000:2.0:1782217013.837953:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43df4e00 x1868789713067904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782217013.837964:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1868789713067904:0@lo:400:kworker.0 00000100:00100000:0.0:1782217013.838025:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713067520:0@lo:400:kworker.0 00010000:00080000:0.0:1782217013.838035:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43df5880 x1868789713068032/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782217029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782217013.838044:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713068032:0@lo:400:kworker.0 00000100:00100000:0.0:1782217013.838069:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c696300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713066496:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782217013.840198:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217013.840341:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713066368 00000100:00100000:1.0:1782217013.840349:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713066368 00000100:00100000:1.0:1782217013.840403:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1782217013.840411:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4379b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713066368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782217013.840431:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782217013.840497:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4379b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713066368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217013.840504:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:3.0:1782217013.840597:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7b09ed80 x1868789713066368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782217029 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217013.840616:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b09ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713066368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782217014.209484:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217014.209534:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217014.209565:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217014.209632:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217014.209665:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217014.209780:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693053312 00000100:00100000:0.0:1782217014.209790:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693053312 00000100:00100000:0.0:1782217014.209841:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 377 00000100:00100000:0.0:1782217014.209851:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e58053450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:2403:x1868789693053312:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782217014.209930:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e58053450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:2403:x1868789693053312:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 69us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217014.209938:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 377 00000100:00100000:3.0:1782217014.210320:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693053568 00000100:00100000:3.0:1782217014.210325:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693053568 00000100:00100000:3.0:1782217014.210366:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693053824 00000100:00100000:3.0:1782217014.210370:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693053824 00000100:00100000:3.0:1782217014.210383:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693053440 00000100:00100000:3.0:1782217014.210386:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693053440 00000100:00100000:3.0:1782217014.210397:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693053696 00000100:00100000:3.0:1782217014.210399:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693053696 00000100:00100000:3.0:1782217014.210414:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 267 00000100:00100000:3.0:1782217014.210421:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b09ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+5:2403:x1868789693053568:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1782217014.210463:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b09ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+5:2403:x1868789693053568:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 42us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217014.210470:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 267 00000100:00100000:3.0:1782217014.210483:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 268 00000100:00100000:3.0:1782217014.210491:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42738380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a927f5f6-9735-45e0-abce-963bd125e020+5:2403:x1868789693053824:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1782217014.210514:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42738380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a927f5f6-9735-45e0-abce-963bd125e020+5:2403:x1868789693053824:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 25us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217014.210532:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 268 00000100:00100000:3.0:1782217014.210545:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 269 00000100:00100000:3.0:1782217014.210551:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42739c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+5:2403:x1868789693053440:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1782217014.210693:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 270 00000100:00100000:1.0:1782217014.210702:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42739180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a927f5f6-9735-45e0-abce-963bd125e020+5:2403:x1868789693053696:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1782217014.210727:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42739180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a927f5f6-9735-45e0-abce-963bd125e020+5:2403:x1868789693053696:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 28us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217014.210733:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 270 00000100:00100000:3.0:1782217014.211472:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42739c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+5:2403:x1868789693053440:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 916us (1834us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217014.211480:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 269 00000100:00080000:0.0:1782217014.211777:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782217014.211782:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782217014.329287:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782217014.329312:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42738000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713068288:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782217014.329381:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217014.329421:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713068288 00000100:00100000:3.0:1782217014.329428:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713068288 00000100:00100000:3.0:1782217014.329558:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1782217014.329567:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42738e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713068288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1782217014.329622:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1782217014.329665:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42738e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713068288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217014.329672:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1782217014.329736:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42738000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713068288:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1782217014.776794:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1782217014.845841:0:8428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 24a87249-c61f-41a1-85ec-9a313129e739 00000020:00000080:3.0:1782217014.845860:0:8428:0:(genops.c:906:class_export_put()) final put ffff952e7b353000/24a87249-c61f-41a1-85ec-9a313129e739 00000020:00000080:0.0:1782217014.846850:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff952e7b353000/24a87249-c61f-41a1-85ec-9a313129e739 for lustre-OST0000 00000020:00000080:0.0:1782217014.846924:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff952e7b356000 for lustre-OST0000 00000100:00100000:3.0:1782217015.352946:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713068416:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782217015.353020:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217015.353165:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713068416 00000100:00100000:2.0:1782217015.353175:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713068416 00000100:00100000:2.0:1782217015.353233:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1782217015.353246:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42738000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713068416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782217015.353282:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1782217015.353548:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42738000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713068416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 304us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217015.353557:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1782217015.355749:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713068416:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1782217015.800848:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217016.841436:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217017.859026:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782217018.682613:0:13796:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1782217018.686998:0:13800:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1782217018.877137:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782217018.936682:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782217018.936704:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42739880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713068544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782217018.936766:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217018.936893:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713068544 00000100:00100000:2.0:1782217018.936909:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713068544 00000100:00100000:2.0:1782217018.936975:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1782217018.936984:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713068544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782217018.937022:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782217018.937069:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713068544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217018.937076:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1782217018.937092:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782217018.937101:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713068672:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1782217018.937112:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d42739880 x1868789713068544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782217034 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782217018.937127:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217018.937128:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42739880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713068544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782217018.937150:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713068672 00000100:00100000:1.0:1782217018.937153:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713068672 00000100:00100000:1.0:1782217018.937186:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1782217018.937202:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d410b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713068672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782217018.937213:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782217018.937243:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d410b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713068672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217018.937255:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00010000:00080000:1.0:1782217018.937282:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d410b2300 x1868789713068672/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782217034 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782217018.937293:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713068672:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782217018.937310:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4273ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713068800:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782217018.937336:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217018.937401:0:10535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713068800 00000100:00100000:2.0:1782217018.937404:0:10535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713068800 00000100:00100000:2.0:1782217018.937435:0:10535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1782217018.937441:0:10535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42738700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713068800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782217018.937456:0:10535:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782217018.937487:0:10535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42738700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713068800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 46us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217018.937492:0:10535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1782217018.937518:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4273ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713068800:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782217018.937941:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c695c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713068928:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782217018.937956:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782217018.937969:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217018.938007:0:10535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713068928 00000100:00100000:2.0:1782217018.938011:0:10535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713068928 00000100:00080000:0.0:1782217018.938045:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782217018.938153:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1868789713069440:0@lo:400:kworker.0 00000100:00100000:2.0:1782217018.938206:0:10535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1782217018.938213:0:10535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c694000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713068928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782217018.938224:0:10535:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782217018.938258:0:10535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c694000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713068928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217018.938264:0:10535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1782217018.938358:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217018.938430:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1868789713069952:0@lo:400:kworker.0 00000100:00100000:0.0:1782217018.938450:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217018.938478:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c695c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713068928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782217018.938490:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1782217018.938494:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713069312:0@lo:400:kworker.0 00000100:00100000:0.0:1782217018.938514:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217018.938537:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1868789713069824:0@lo:400:kworker.0 00000100:00100000:0.0:1782217018.938552:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217018.938573:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713069440 00000100:00100000:0.0:1782217018.938576:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713069440 00000100:00100000:2.0:1782217018.938617:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713069952 00000100:00100000:2.0:1782217018.938621:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713069952 00000100:00100000:0.0:1782217018.938628:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713069824 00000100:00100000:0.0:1782217018.938631:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713069824 00000100:00100000:2.0:1782217018.938639:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1782217018.938645:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1868789713069440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217018.938677:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713069312 00000100:00100000:3.0:1782217018.938681:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713069312 00000100:00100000:2.0:1782217018.938741:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1868789713069440:12345-0@lo:400:kworker.0 Request processed in 95us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217018.938781:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1782217018.938789:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713069312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217018.938824:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713069312:12345-0@lo:400:kworker.0 Request processed in 37us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217018.938829:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1782217018.939174:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1782217018.939182:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1868789713069952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217018.939224:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1868789713069952:12345-0@lo:400:kworker.0 Request processed in 43us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217018.939231:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1782217018.939379:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1782217018.939389:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1868789713069824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217018.939414:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1868789713069824:12345-0@lo:400:kworker.0 Request processed in 28us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217018.939419:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00080000:0.0:1782217018.939440:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782217018.939442:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782217018.939445:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782217018.939455:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789713069056:0@lo:400:kworker.0 00000100:00100000:0.0:1782217018.939490:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217018.939524:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713069568:0@lo:400:kworker.0 00000100:00100000:0.0:1782217018.939542:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217018.939557:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1868789713070080:0@lo:400:kworker.0 00000100:00100000:0.0:1782217018.939573:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217018.939610:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713069056 00000100:00100000:0.0:1782217018.939610:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1782217018.939615:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713069056 00000100:00100000:0.0:1782217018.939615:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1868789713069184:0@lo:400:kworker.0 00000100:00100000:0.0:1782217018.939635:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217018.939643:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1782217018.939648:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1868789713069696:0@lo:400:kworker.0 00000100:00100000:3.0:1782217018.939649:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e43998c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3647:x1868789713069056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217018.939667:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217018.939675:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e43998c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3647:x1868789713069056:12345-0@lo:400:kworker.0 Request processed in 27us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217018.939681:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1782217018.939682:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789713069056:0@lo:400:kworker.0 00000100:00100000:0.0:1782217018.940023:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713069568 00000100:00100000:0.0:1782217018.940028:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713069568 00000100:00100000:0.0:1782217018.940054:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1782217018.940060:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713069568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217018.940094:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713069568:12345-0@lo:400:kworker.0 Request processed in 34us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217018.940099:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1782217018.940118:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713070080 00000100:00100000:0.0:1782217018.940122:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713070080 00000100:00100000:0.0:1782217018.940142:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713069184 00000100:00100000:0.0:1782217018.940145:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713069184 00000100:00100000:0.0:1782217018.940154:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713069696 00000100:00100000:0.0:1782217018.940155:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713069696 00000100:00100000:0.0:1782217018.940168:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1782217018.940173:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1868789713070080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217018.940210:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1868789713070080:12345-0@lo:400:kworker.0 Request processed in 36us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217018.940216:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1782217018.940226:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1782217018.940231:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1868789713069184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217018.940253:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1868789713069184:12345-0@lo:400:kworker.0 Request processed in 22us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217018.940258:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1782217018.940268:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1782217018.940273:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1868789713069696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217018.940296:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1868789713069696:12345-0@lo:400:kworker.0 Request processed in 24us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217018.940302:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00080000:0.0:1782217018.940314:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782217018.940316:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782217018.940346:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713069312:0@lo:400:kworker.0 00010000:00080000:0.0:1782217018.940359:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43df2680 x1868789713069824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782217018.940370:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1868789713069824:0@lo:400:kworker.0 00000100:00100000:0.0:1782217018.940381:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1868789713069440:0@lo:400:kworker.0 00000100:00100000:0.0:1782217018.940390:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1868789713069952:0@lo:400:kworker.0 00000100:00100000:2.0:1782217018.941609:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1782217018.942843:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1868789713069184:0@lo:400:kworker.0 00000100:00100000:1.0:1782217018.942859:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1868789713069696:0@lo:400:kworker.0 00000100:00100000:1.0:1782217018.942869:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713069568:0@lo:400:kworker.0 00010000:00080000:1.0:1782217018.943621:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43df0a80 x1868789713070080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782217018.943633:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1868789713070080:0@lo:400:kworker.0 00000100:00100000:0.0:1782217019.331180:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217019.331312:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693053952 00000100:00100000:1.0:1782217019.331322:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693053952 00000100:00100000:1.0:1782217019.331383:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 379 00000100:00100000:1.0:1782217019.331394:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e4399b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:2402:x1868789693053952:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1782217019.331480:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e4399b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:2402:x1868789693053952:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 87us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217019.331488:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 379 00000100:00100000:2.0:1782217019.341000:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217019.341190:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693054080 00000100:00100000:0.0:1782217019.341200:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693054080 00000100:00100000:0.0:1782217019.341299:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 277 00000100:00100000:0.0:1782217019.341310:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+5:2402:x1868789693054080:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782217019.341398:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+5:2402:x1868789693054080:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 90us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217019.341405:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 277 00000100:00080000:2.0:1782217019.341471:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782217019.350700:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217019.350752:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217019.350771:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217019.351118:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693054336 00000100:00100000:3.0:1782217019.351128:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693054336 00000100:00100000:3.0:1782217019.351182:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693054208 00000100:00100000:3.0:1782217019.351185:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693054208 00000100:00100000:3.0:1782217019.351202:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 278 00000100:00100000:3.0:1782217019.351210:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c695500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a927f5f6-9735-45e0-abce-963bd125e020+5:2403:x1868789693054336:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1782217019.351285:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c695500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a927f5f6-9735-45e0-abce-963bd125e020+5:2403:x1868789693054336:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 75us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217019.351307:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 278 00000100:00100000:3.0:1782217019.351323:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693054464 00000100:00100000:3.0:1782217019.351327:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693054464 00000100:00100000:3.0:1782217019.351343:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 279 00000100:00100000:3.0:1782217019.351348:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+5:2403:x1868789693054208:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1782217019.351375:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+5:2403:x1868789693054208:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 27us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217019.351381:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 279 00000100:00100000:3.0:1782217019.351391:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 280 00000100:00100000:3.0:1782217019.351396:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a927f5f6-9735-45e0-abce-963bd125e020+5:2403:x1868789693054464:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1782217019.351413:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a927f5f6-9735-45e0-abce-963bd125e020+5:2403:x1868789693054464:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 17us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217019.351419:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 280 00000100:00080000:2.0:1782217019.352139:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782217019.352145:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782217019.448916:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4273b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713070208:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782217019.448994:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217019.449169:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713070208 00000100:00100000:3.0:1782217019.449177:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713070208 00000100:00100000:3.0:1782217019.449228:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1782217019.449237:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713070208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1782217019.449270:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1782217019.449318:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713070208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217019.449326:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1782217019.449522:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4273b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713070208:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1782217019.900272:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782217020.473737:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4273b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713070336:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782217020.473802:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217020.473864:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713070336 00000100:00100000:3.0:1782217020.473888:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713070336 00000100:00100000:3.0:1782217020.473931:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1782217020.473956:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713070336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782217020.473996:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1782217020.474040:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713070336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217020.474047:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1782217020.474090:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4273b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713070336:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1782217020.922326:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217021.945785:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782217022.276452:0:14060:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 08:17:00 (1782217020) 00000100:00100000:3.0:1782217022.409515:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217022.409556:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217022.409668:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693054592 00000100:00100000:0.0:1782217022.409678:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693054592 00000100:00100000:0.0:1782217022.409726:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 380 00000100:00100000:0.0:1782217022.409736:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e43999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:2404:x1868789693054592:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782217022.409799:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e43999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:2404:x1868789693054592:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 65us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217022.409807:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 380 00000100:00100000:3.0:1782217022.410007:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217022.416324:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217022.418027:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693054848 00000100:00100000:2.0:1782217022.418042:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693054848 00000100:00100000:2.0:1782217022.418114:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693055104 00000100:00100000:2.0:1782217022.418118:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693055104 00000100:00100000:2.0:1782217022.418152:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 281 00000100:00100000:2.0:1782217022.418162:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+5:2404:x1868789693054848:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1782217022.418246:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+5:2404:x1868789693054848:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 86us (8689us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217022.418255:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 281 00000100:00100000:2.0:1782217022.418285:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 282 00000100:00100000:2.0:1782217022.418294:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42739880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a927f5f6-9735-45e0-abce-963bd125e020+5:2404:x1868789693055104:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1782217022.418321:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42739880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a927f5f6-9735-45e0-abce-963bd125e020+5:2404:x1868789693055104:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 29us (8313us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217022.418328:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 282 00000100:00080000:2.0:1782217022.418345:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782217022.423898:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217022.423943:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693054720 00000100:00100000:3.0:1782217022.423953:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693054720 00000100:00100000:3.0:1782217022.424002:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693054976 00000100:00100000:3.0:1782217022.424005:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693054976 00000100:00100000:3.0:1782217022.424023:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 283 00000100:00100000:3.0:1782217022.424032:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c66ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+5:2404:x1868789693054720:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1782217022.424099:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c66ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+5:2404:x1868789693054720:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 67us (7784us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217022.424107:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 283 00000100:00100000:3.0:1782217022.424123:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 284 00000100:00100000:3.0:1782217022.424129:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c66e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a927f5f6-9735-45e0-abce-963bd125e020+5:2404:x1868789693054976:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1782217022.424162:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c66e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a927f5f6-9735-45e0-abce-963bd125e020+5:2404:x1868789693054976:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 33us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217022.424169:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 284 00000100:00080000:3.0:1782217022.424186:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782217022.970511:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782217023.730810:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217023.736241:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693055232 00000100:00100000:0.0:1782217023.736255:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693055232 00000100:00100000:0.0:1782217023.737995:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 40 00000100:00100000:0.0:1782217023.738012:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c66e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+5:11078:x1868789693055232:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782217023.738032:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217023.738064:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c000/0x92b8e04cbf5f9670 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be97338f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217023.738126:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f9677 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217023.738155:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f9677 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217023.738168:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f9677 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782217023.738213:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1782217023.738217:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782217023.738251:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f9677 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217023.738273:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c000/0x92b8e04cbf5f9670 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97338f expref: 7 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217023.738288:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f9677 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97338f expref: 6 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217023.738295:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d426a0f00) 00010000:00010000:0.0:1782217023.738298:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782217023.738301:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e4121ca00, rc 0) 00000100:00100000:0.0:1782217023.738360:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c66e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+6:11078:x1868789693055232:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 353us (7568us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217023.738367:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 40 00000100:00100000:3.0:1782217023.744710:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217023.745990:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693055360 00000100:00100000:2.0:1782217023.746002:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693055360 00000100:00100000:2.0:1782217023.746066:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 41 00000100:00100000:2.0:1782217023.746076:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c66ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+6:11079:x1868789693055360:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782217023.746096:0:6548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217023.746115:0:6548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f967e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973396 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.746178:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9685 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.746191:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9685 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.746201:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9685 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.746216:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f968c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.746223:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f968c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.746246:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f968c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.746304:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2dc00/0x92b8e04cbf5f9693 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.746312:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2dc00/0x92b8e04cbf5f9693 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.746318:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2dc00/0x92b8e04cbf5f9693 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217023.746352:0:6548:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1782217023.746356:0:6548:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782217023.746376:0:6548:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2dc00/0x92b8e04cbf5f9693 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.746386:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9685 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.746392:0:6548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9685 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.746399:0:6548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9685 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.746405:0:6548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2d800 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782217023.746409:0:6548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9685 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.746416:0:6548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9685 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.746435:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d426a0f00) 00010000:00010000:2.0:1782217023.746438:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217023.746442:0:6548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9685 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.746449:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9685 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.746463:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f968c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.746470:0:6548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f968c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.746476:0:6548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f968c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.746481:0:6548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2d200 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782217023.746483:0:6548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f968c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.746489:0:6548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f968c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.746496:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff952d410ab900) 00010000:00010000:2.0:1782217023.746498:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217023.746501:0:6548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f968c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.746506:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f968c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.746556:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f967e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973396 expref: 8 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.746570:0:6548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2dc00/0x92b8e04cbf5f9693 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973396 expref: 7 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217023.746576:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff952d410ab800) 00010000:00010000:2.0:1782217023.746578:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782217023.746580:0:6548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2dc00, rc 0) 00000100:00100000:2.0:1782217023.746696:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c66ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+7:11079:x1868789693055360:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 621us (1993us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217023.746703:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 41 00000100:00100000:1.0:1782217023.754674:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217023.754773:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693055488 00000100:00100000:2.0:1782217023.754782:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693055488 00000100:00100000:2.0:1782217023.754845:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:2.0:1782217023.754865:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d410b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:24a87249-c61f-41a1-85ec-9a313129e739+7:11079:x1868789693055488:12345-192.168.203.30@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1782217023.754947:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d410b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:24a87249-c61f-41a1-85ec-9a313129e739+7:11079:x1868789693055488:12345-192.168.203.30@tcp:900:lhsmtool_posix.0 Request processed in 85us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217023.754956:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:0.0:1782217023.763395:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217023.763510:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693055744 00000100:00100000:3.0:1782217023.763519:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693055744 00000100:00100000:3.0:1782217023.763612:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 42 00000100:00100000:3.0:1782217023.763624:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+7:11079:x1868789693055744:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782217023.763645:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217023.763665:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f969a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be97339d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.763736:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5f96a1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.763749:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5f96a1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.763759:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5f96a1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.763774:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f96a8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.763782:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f96a8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.763790:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f96a8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.763932:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362800/0x92b8e04cbf5f96af lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.763941:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362800/0x92b8e04cbf5f96af lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.763948:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362800/0x92b8e04cbf5f96af lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217023.764183:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1782217023.764272:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5f96a1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.764279:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5f96a1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.764286:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5f96a1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.764291:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b363a00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217023.764295:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5f96a1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.764303:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5f96a1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.764316:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff952d410ab800) 00010000:00010000:3.0:1782217023.764319:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217023.764324:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5f96a1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.764342:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5f96a1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.764357:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f96a8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.764363:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f96a8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.764369:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f96a8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.764374:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362e00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217023.764377:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f96a8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.764382:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f96a8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.764390:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff952e7b201400) 00010000:00010000:3.0:1782217023.764393:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217023.764395:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f96a8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.764401:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f96a8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.764781:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f969a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97339d expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.764879:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362800/0x92b8e04cbf5f96af lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97339d expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217023.764896:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff952e7b201600) 00010000:00010000:3.0:1782217023.764898:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217023.764900:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b362800, rc 0) 00000100:00100000:3.0:1782217023.765316:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+9:11079:x1868789693055744:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 1426us (1661us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1782217023.765326:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 42 00000100:00100000:3.0:1782217023.769448:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217023.769544:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693055872 00000100:00100000:0.0:1782217023.769554:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693055872 00000100:00100000:0.0:1782217023.769661:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 43 00000100:00100000:0.0:1782217023.769671:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c66ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+9:11079:x1868789693055872:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1782217023.769783:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c66ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+9:11079:x1868789693055872:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 Request processed in 113us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217023.769790:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 43 00000100:00100000:1.0:1782217023.785822:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217023.785907:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693056000 00000100:00100000:3.0:1782217023.785915:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693056000 00000100:00100000:3.0:1782217023.785985:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 44 00000100:00100000:3.0:1782217023.785995:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d410b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+5:11079:x1868789693056000:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1782217023.790264:0:6519:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 4222us 00000040:00080000:0.0:1782217023.801422:0:13796:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1782217023.821364:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d410b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+5:11079:x1868789693056000:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 Request processed in 35361us (35541us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217023.821379:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 44 00010000:00010000:2.0:1782217023.995389:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782217024.056994:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1868789713070848:0@lo:400:kworker.0 00000100:00100000:0.0:1782217024.057199:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217024.057267:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713071360:0@lo:400:kworker.0 00000100:00100000:0.0:1782217024.057315:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217024.057344:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713071872:0@lo:400:kworker.0 00000100:00100000:0.0:1782217024.057367:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217024.057395:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1782217024.057403:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789713070464:0@lo:400:kworker.0 00000100:00100000:0.0:1782217024.057436:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217024.057787:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782217024.057799:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c66c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713072384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782217024.057835:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217024.057913:0:10535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713072384 00000100:00100000:3.0:1782217024.057924:0:10535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713072384 00000100:00100000:3.0:1782217024.057989:0:10535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1782217024.058001:0:10535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c695f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713072384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782217024.058049:0:10535:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782217024.058437:0:10535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c695f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713072384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 437us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217024.058446:0:10535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:3.0:1782217024.058483:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782217024.058754:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713070976:0@lo:400:kworker.0 00000100:00100000:0.0:1782217024.058794:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217024.058872:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713071488:0@lo:400:kworker.0 00000100:00100000:0.0:1782217024.058898:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217024.058920:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713072000:0@lo:400:kworker.0 00000100:00100000:0.0:1782217024.058942:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217024.058977:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1868789713070592:0@lo:400:kworker.0 00000100:00100000:0.0:1782217024.059004:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217024.059058:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1868789713071104:0@lo:400:kworker.0 00000100:00100000:0.0:1782217024.059086:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217024.059105:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1868789713071616:0@lo:400:kworker.0 00000100:00100000:0.0:1782217024.059126:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217024.059141:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713072128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782217024.059163:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217024.059185:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1782217024.059192:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713070720:0@lo:400:kworker.0 00000100:00100000:0.0:1782217024.059214:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217024.061653:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1868789713071232:0@lo:400:kworker.0 00000100:00100000:0.0:1782217024.061728:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217024.061744:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1868789713071744:0@lo:400:kworker.0 00000100:00100000:0.0:1782217024.061764:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217024.061776:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c66c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713072256:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782217024.061799:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217024.061872:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713070848 00000100:00100000:0.0:1782217024.061881:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713070848 00000100:00100000:0.0:1782217024.061937:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713070592 00000100:00100000:0.0:1782217024.061940:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713070592 00000100:00100000:0.0:1782217024.061955:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713071104 00000100:00100000:0.0:1782217024.061958:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713071104 00000100:00100000:0.0:1782217024.061983:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713071616 00000100:00100000:0.0:1782217024.061987:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713071616 00000100:00100000:0.0:1782217024.062005:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713071232 00000100:00100000:0.0:1782217024.062008:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713071232 00000100:00100000:0.0:1782217024.062019:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713071744 00000100:00100000:0.0:1782217024.062022:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713071744 00000100:00100000:0.0:1782217024.062159:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1782217024.062181:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1868789713070848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217024.062244:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1868789713070848:12345-0@lo:400:kworker.0 Request processed in 63us (5046us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217024.062252:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1782217024.062273:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1782217024.062279:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4360f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1868789713070592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217024.062316:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4360f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1868789713070592:12345-0@lo:400:kworker.0 Request processed in 37us (3311us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217024.062322:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1782217024.062334:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1782217024.062340:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4360c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1868789713071104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217024.062367:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4360c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1868789713071104:12345-0@lo:400:kworker.0 Request processed in 28us (3280us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217024.062373:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1782217024.062384:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1782217024.062390:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4360e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1868789713071616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217024.062641:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4360e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1868789713071616:12345-0@lo:400:kworker.0 Request processed in 251us (3513us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217024.062648:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1782217024.062661:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1782217024.062668:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4360dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1868789713071232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217024.062696:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4360dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1868789713071232:12345-0@lo:400:kworker.0 Request processed in 29us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217024.062701:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1782217024.062712:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1782217024.062726:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4360c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1868789713071744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217024.062756:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4360c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1868789713071744:12345-0@lo:400:kworker.0 Request processed in 31us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217024.062761:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1782217024.062785:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713071360 00000100:00100000:0.0:1782217024.062790:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713071360 00000100:00100000:0.0:1782217024.062816:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713071872 00000100:00100000:0.0:1782217024.062819:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713071872 00000100:00100000:0.0:1782217024.062833:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713071488 00000100:00100000:0.0:1782217024.062836:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713071488 00000100:00100000:0.0:1782217024.062858:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713072000 00000100:00100000:0.0:1782217024.062862:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713072000 00000100:00100000:0.0:1782217024.062876:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1782217024.062882:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4360ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713071360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217024.062916:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4360ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713071360:12345-0@lo:400:kworker.0 Request processed in 34us (5601us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217024.062922:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1782217024.062933:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1782217024.062939:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4360ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713071872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217024.062967:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4360ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713071872:12345-0@lo:400:kworker.0 Request processed in 29us (5599us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217024.062974:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1782217024.062983:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1782217024.062989:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4360d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713071488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217024.063016:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4360d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713071488:12345-0@lo:400:kworker.0 Request processed in 28us (4118us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217024.063022:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1782217024.063113:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1782217024.063120:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4360c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713072000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217024.063151:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4360c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713072000:12345-0@lo:400:kworker.0 Request processed in 32us (4208us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217024.063157:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1782217024.063186:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713070464 00000100:00100000:0.0:1782217024.063190:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713070464 00000100:00100000:0.0:1782217024.063222:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1782217024.063228:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e43999c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3649:x1868789713070464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217024.063260:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e43999c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3649:x1868789713070464:12345-0@lo:400:kworker.0 Request processed in 32us (5823us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217024.063266:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1782217024.063324:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713072128 00000100:00100000:0.0:1782217024.063328:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713072128 00000100:00100000:0.0:1782217024.063354:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713072256 00000100:00100000:0.0:1782217024.063358:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713072256 00000100:00100000:0.0:1782217024.063370:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1782217024.063375:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4360f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713072128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782217024.063399:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782217024.063662:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4360f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713072128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 284us (4495us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217024.063669:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1782217024.063683:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1782217024.063690:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4360d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713072256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782217024.063701:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782217024.063726:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4360d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713072256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 37us (1925us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217024.063744:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:0.0:1782217024.063768:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782217024.063773:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782217024.063776:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782217024.063778:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1782217024.063823:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43df0700 x1868789713071232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217040 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782217024.063842:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1868789713071232:0@lo:400:kworker.0 00010000:00080000:0.0:1782217024.063873:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43df4380 x1868789713071744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217040 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782217024.063883:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1868789713071744:0@lo:400:kworker.0 00000100:00100000:0.0:1782217024.063902:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c66c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713072256:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782217024.063916:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1868789713070592:0@lo:400:kworker.0 00000100:00100000:0.0:1782217024.063929:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1868789713071104:0@lo:400:kworker.0 00000100:00100000:0.0:1782217024.063942:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1868789713071616:0@lo:400:kworker.0 00000100:00100000:0.0:1782217024.063958:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713072128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782217024.064014:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789713070464:0@lo:400:kworker.0 00000100:00100000:3.0:1782217024.064155:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713070976 00000100:00100000:3.0:1782217024.064162:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713070976 00000100:00100000:3.0:1782217024.064201:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713070720 00000100:00100000:3.0:1782217024.064204:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713070720 00000100:00100000:3.0:1782217024.064232:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1782217024.064238:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4360e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713070976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217024.064280:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4360e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713070976:12345-0@lo:400:kworker.0 Request processed in 43us (5486us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217024.064287:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1782217024.064299:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1782217024.064304:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4360ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713070720:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1782217024.064316:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7c66c380 x1868789713072384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782217040 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217024.064337:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4360ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713070720:12345-0@lo:400:kworker.0 Request processed in 34us (5123us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217024.064343:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1782217024.064344:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c66c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713072384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782217024.064365:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713072512:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782217024.064375:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713070720:0@lo:400:kworker.0 00000100:00100000:2.0:1782217024.064402:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217024.064433:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713072512 00000100:00100000:3.0:1782217024.064436:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713072512 00000100:00100000:3.0:1782217024.064458:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1782217024.064464:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c696d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713072512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782217024.064474:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782217024.064516:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713071488:0@lo:400:kworker.0 00010000:00080000:0.0:1782217024.064536:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43df7480 x1868789713072000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782217040 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782217024.064545:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713072000:0@lo:400:kworker.0 00000100:00100000:0.0:1782217024.064566:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1868789713070848:0@lo:400:kworker.0 00000100:00100000:0.0:1782217024.064575:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713071360:0@lo:400:kworker.0 00010000:00080000:0.0:1782217024.064604:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43df4700 x1868789713071872/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782217040 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782217024.064611:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713071872:0@lo:400:kworker.0 00000100:00100000:0.0:1782217024.064641:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713070976:0@lo:400:kworker.0 00000100:00100000:3.0:1782217024.065519:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c696d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713072512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1049us (1111us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217024.065532:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00010000:00080000:2.0:1782217024.065719:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d410b0700 x1868789713072512/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782217040 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782217024.065739:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713072512:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782217024.573561:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c66c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713072640:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782217024.573711:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217024.574192:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713072640 00000100:00100000:3.0:1782217024.574204:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713072640 00000100:00100000:3.0:1782217024.574271:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1782217024.574282:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4360d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713072640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1782217024.574328:0:7938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1782217024.574416:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4360d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713072640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 136us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217024.574442:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1782217024.576150:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c66c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713072640:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1782217024.827293:0:13800:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1782217025.017754:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782217025.596009:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782217025.596030:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c696a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713072768:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782217025.596092:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217025.596203:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713072768 00000100:00100000:2.0:1782217025.596210:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713072768 00000100:00100000:2.0:1782217025.596376:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1782217025.596385:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4360fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713072768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782217025.596417:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1782217025.596471:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4360fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713072768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217025.596478:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1782217025.596567:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c696a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713072768:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782217025.752516:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217025.752635:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693056128 00000100:00100000:1.0:1782217025.752644:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693056128 00000100:00080000:3.0:1782217025.752700:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782217025.752725:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 45 00000100:00100000:1.0:1782217025.752736:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c66d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+9:11121:x1868789693056128:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1782217025.752754:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217025.752773:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f96bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9733a4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.753034:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073c00/0x92b8e04cbf5f96c4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.753116:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073c00/0x92b8e04cbf5f96c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.753130:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073c00/0x92b8e04cbf5f96c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.753147:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f96cb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.753154:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f96cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.753160:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f96cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.753203:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073c00/0x92b8e04cbf5f96c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.753210:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073c00/0x92b8e04cbf5f96c4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.753216:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073c00/0x92b8e04cbf5f96c4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.753232:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43073c00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217025.753237:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073c00/0x92b8e04cbf5f96c4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.753244:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073c00/0x92b8e04cbf5f96c4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.753257:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d426a0f00) 00010000:00010000:1.0:1782217025.753260:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217025.753265:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073c00/0x92b8e04cbf5f96c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.753271:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073c00/0x92b8e04cbf5f96c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.753282:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f96cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.753288:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f96cb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.753294:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f96cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.753299:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43073400 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217025.753302:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f96cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.753308:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f96cb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.753326:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff952e6105c900) 00010000:00010000:1.0:1782217025.753328:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217025.753331:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f96cb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.753337:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f96cb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.753368:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f96bd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733a4 expref: 10 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.753377:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d426a0f00) 00010000:00010000:1.0:1782217025.753379:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217025.753383:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f96bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733a4 expref: 10 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.753392:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43072e00, rc 0) 00000100:00100000:1.0:1782217025.753540:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c66d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+9:11121:x1868789693056128:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 805us (1032us total) trans 0 rc 301/301 00000100:00100000:1.0:1782217025.753549:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 45 00000100:00100000:3.0:1782217025.758657:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217025.758690:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693056384 00000100:00100000:1.0:1782217025.758700:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693056384 00000100:00100000:1.0:1782217025.758763:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 46 00000100:00100000:1.0:1782217025.758773:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c66fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+9:11121:x1868789693056384:12345-192.168.203.30@tcp:36:lfs.0 00010000:00010000:1.0:1782217025.758856:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782217025.758883:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f9677 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97338f expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.758921:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d426a0f00) 00010000:00010000:1.0:1782217025.758933:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782217025.758991:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5f96d2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.759004:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5f96d2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.759014:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5f96d2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.759026:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f96d9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.759034:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f96d9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.759041:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f96d9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.759701:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f96e0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.759710:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f96e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.759718:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f96e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782217025.759732:0:6520:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000016ace5d5 reply state 0000000094bed6b0 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f96e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.759757:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f96e0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.759763:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff952e6105ce00) 00010000:00010000:1.0:1782217025.759766:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782217025.759769:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1782217025.759772:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1782217025.759898:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5f96d2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.759906:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5f96d2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.759912:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5f96d2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.759918:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43073800 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217025.759923:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5f96d2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.759930:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5f96d2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.759939:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952e6105c300) 00010000:00010000:1.0:1782217025.759942:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217025.759946:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5f96d2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.759952:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5f96d2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782217025.759978:0:6520:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000016ace5d5 reply state 0000000094bed6b0 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f96d9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.759987:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f96d9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217025.759993:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff952e6105cf00) 00010000:00010000:1.0:1782217025.759996:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782217025.759998:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1782217025.760240:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c66fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+10:11121:x1868789693056384:12345-192.168.203.30@tcp:36:lfs.0 Request processed in 1466us (1589us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1782217025.760249:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 46 00000100:00100000:3.0:1782217025.887196:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217025.891040:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693056512 00000100:00100000:2.0:1782217025.891059:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693056512 00000100:00100000:2.0:1782217025.891136:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 47 00000100:00100000:2.0:1782217025.891147:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c66ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+10:11129:x1868789693056512:12345-192.168.203.30@tcp:101:lctl.0 00010000:00010000:2.0:1782217025.891170:0:6548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217025.891190:0:6548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f96e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9733ab expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.891267:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5f96ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.891300:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5f96ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217025.891311:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5f96ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217025.891854:0:6548:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1782217025.891860:0:6548:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782217025.891900:0:6548:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5f96ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217025.891925:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f96e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733ab expref: 12 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217025.891946:0:6548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5f96ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733ab expref: 11 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217025.891955:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d410abd00) 00010000:00010000:3.0:1782217025.891958:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782217025.891961:0:6548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2ca00, rc 0) 00000100:00100000:3.0:1782217025.892032:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c66ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+11:11129:x1868789693056512:12345-192.168.203.30@tcp:101:lctl.0 Request processed in 886us (4843us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217025.892040:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 47 00000100:00100000:3.0:1782217026.013737:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217026.013990:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693056640 00000100:00100000:0.0:1782217026.014005:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693056640 00000100:00100000:0.0:1782217026.014092:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 48 00000100:00100000:0.0:1782217026.014103:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c66f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+11:11136:x1868789693056640:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:0.0:1782217026.014122:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217026.014143:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121de00/0x92b8e04cbf5f96f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9733b2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.014205:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f96fc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.014219:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f96fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.014246:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f96fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.014259:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9703 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.014266:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9703 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.014273:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9703 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.014351:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ce00/0x92b8e04cbf5f970a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.014359:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ce00/0x92b8e04cbf5f970a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.014366:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ce00/0x92b8e04cbf5f970a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782217026.014399:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1782217026.014403:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782217026.014436:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ce00/0x92b8e04cbf5f970a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.014448:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f96fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.014454:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f96fc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.014471:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f96fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.014477:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121d600 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782217026.014481:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f96fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.014489:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f96fc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.014500:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d410abd00) 00010000:00010000:0.0:1782217026.014503:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217026.014507:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f96fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.014513:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f96fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.014528:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9703 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.014534:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9703 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.014539:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9703 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.014543:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121da00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782217026.014545:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9703 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.014561:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9703 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.014569:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff952e6105cf00) 00010000:00010000:0.0:1782217026.014572:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217026.014575:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9703 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.014628:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9703 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.014655:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121de00/0x92b8e04cbf5f96f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733b2 expref: 13 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.014669:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ce00/0x92b8e04cbf5f970a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733b2 expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.014677:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff952e6105ce00) 00010000:00010000:0.0:1782217026.014680:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1782217026.014682:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e4121ce00, rc 0) 00000100:00100000:0.0:1782217026.014746:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c66f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+12:11136:x1868789693056640:12345-192.168.203.30@tcp:101:bash.0 Request processed in 645us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217026.014753:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 48 00000100:00100000:2.0:1782217026.022407:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217026.022529:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693056896 00000100:00100000:1.0:1782217026.022540:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693056896 00000100:00100000:1.0:1782217026.022623:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 49 00000100:00100000:1.0:1782217026.022634:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c696a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+12:11136:x1868789693056896:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:1.0:1782217026.022655:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217026.022676:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9711 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9733b9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.022783:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9718 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.022797:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9718 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.022810:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9718 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.022899:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073c00/0x92b8e04cbf5f971f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.022908:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073c00/0x92b8e04cbf5f971f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.022915:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073c00/0x92b8e04cbf5f971f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782217026.023242:0:6518:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:1.0:1782217026.023386:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9726 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.023395:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9726 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.023403:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9726 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.023436:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9718 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.023443:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9718 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.023450:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9718 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.023457:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43073400 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217026.023462:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9718 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.023482:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9718 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.023495:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff952e6105ce00) 00010000:00010000:1.0:1782217026.023499:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217026.023503:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9718 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.023510:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9718 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782217026.023525:0:6518:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000acfb3f7f reply state 00000000c53b8cd7 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073c00/0x92b8e04cbf5f971f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.023535:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073c00/0x92b8e04cbf5f971f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.023541:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff952e6105c300) 00010000:00010000:1.0:1782217026.023544:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782217026.023546:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782217026.023575:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9711 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733b9 expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.023627:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9726 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733b9 expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.023635:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e6105c900) 00010000:00010000:1.0:1782217026.023637:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782217026.023639:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43072200, rc 0) 00000100:00100000:1.0:1782217026.023713:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c696a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+15:11136:x1868789693056896:12345-192.168.203.30@tcp:101:bash.0 Request processed in 1081us (1314us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1782217026.023728:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 49 00000100:00100000:3.0:1782217026.029331:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217026.031312:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693057024 00000100:00100000:0.0:1782217026.031324:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693057024 00000100:00100000:0.0:1782217026.031383:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 28 00000100:00100000:0.0:1782217026.031392:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e74f8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2401:x1868789693057024:12345-192.168.203.30@tcp:8:bash.0 00010000:00080000:0.0:1782217026.031426:0:8434:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 24a87249-c61f-41a1-85ec-9a313129e739@192.168.203.30@tcp t0 exp 0000000000000000 cur 389 last 0 00000020:00000080:0.0:1782217026.031469:0:8434:0:(genops.c:1406:class_connect()) connect: client 24a87249-c61f-41a1-85ec-9a313129e739, cookie 0x92b8e04cbf5f9734 00002000:00100000:0.0:1782217026.031480:0:8434:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 24a87249-c61f-41a1-85ec-9a313129e739/ffff952d43719800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782217026.031497:0:8434:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1782217026.031570:0:8434:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1782217026.031630:0:8434:0:(import.c:65:import_set_state_nolock()) ffff952d4371e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782217026.031705:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e74f8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:24a87249-c61f-41a1-85ec-9a313129e739+6:2401:x1868789693057024:12345-192.168.203.30@tcp:8:bash.0 Request processed in 313us (2383us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217026.031713:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 28 00010000:00010000:3.0:1782217026.040818:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782217026.043472:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217026.043610:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693057152 00000100:00100000:1.0:1782217026.043619:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693057152 00000100:00100000:1.0:1782217026.043687:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 29 00000100:00100000:1.0:1782217026.043696:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4360ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24a87249-c61f-41a1-85ec-9a313129e739+6:0:x1868789693057152:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:1.0:1782217026.043711:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217026.043733:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f12237b9/0x92b8e04cbf5f973b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9733c0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782217026.043756:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782217026.043772:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=389s v=(0 0) 00010000:00010000:1.0:1782217026.043776:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217026.043785:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f12237b9/0x92b8e04cbf5f973b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733c0 expref: 7 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.043803:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f12237b9/0x92b8e04cbf5f973b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733c0 expref: 7 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.043816:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43072e00, rc 0) 00000100:00100000:1.0:1782217026.043891:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4360ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24a87249-c61f-41a1-85ec-9a313129e739+7:0:x1868789693057152:12345-192.168.203.30@tcp:101:bash.0 Request processed in 195us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217026.043898:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 29 00000100:00080000:3.0:1782217026.043958:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782217026.051365:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217026.051541:0:10025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693057280 00000100:00100000:1.0:1782217026.051553:0:10025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693057280 00000100:00100000:1.0:1782217026.051688:0:10025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 30 00000100:00100000:1.0:1782217026.051699:0:10025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c694e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:24a87249-c61f-41a1-85ec-9a313129e739+7:11136:x1868789693057280:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:1.0:1782217026.051727:0:10025:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217026.051745:0:10025:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080baf22b/0x92b8e04cbf5f9742 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9733c7 expref: -99 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.051777:0:10025:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f12237b9/0x92b8e04cbf5f973b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733c0 expref: 8 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.051786:0:10025:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217026.051790:0:10025:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217026.051795:0:10025:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080baf22b/0x92b8e04cbf5f9742 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733c7 expref: 8 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.051829:0:10025:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f12237b9/0x92b8e04cbf5f973b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733c0 expref: 8 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.051853:0:10025:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f12237b9/0x92b8e04cbf5f973b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733c0 expref: 8 pid: 8432 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217026.051869:0:10025:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10025:1868789713072896:192.168.203.30@tcp:104: 00000100:00100000:1.0:1782217026.051985:0:10025:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e42d44c00 going to sleep for 11 seconds 00000100:00100000:1.0:1782217026.058201:0:10025:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10025:1868789713072896:192.168.203.30@tcp:104: 00010000:00010000:1.0:1782217026.058242:0:10025:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000080baf22b/0x92b8e04cbf5f9742 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733c7 expref: 8 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.058270:0:10025:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43073400, rc 0) 00000100:00100000:1.0:1782217026.058341:0:10025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c694e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:24a87249-c61f-41a1-85ec-9a313129e739+8:11136:x1868789693057280:12345-192.168.203.30@tcp:101:bash.0 Request processed in 6643us (6985us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217026.058350:0:10025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 30 00000100:00100000:3.0:1782217026.062880:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217026.063040:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693057408 00000100:00100000:0.0:1782217026.063049:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693057408 00010000:00010000:0.0:1782217026.063091:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f12237b9/0x92b8e04cbf5f973b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733c0 expref: 8 pid: 8432 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217026.063138:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 52 00000100:00100000:0.0:1782217026.063147:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e6f92e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24a87249-c61f-41a1-85ec-9a313129e739+8:2403:x1868789693057408:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782217026.063163:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217026.063183:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f12237b9/0x92b8e04cbf5f973b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733c0 expref: 8 pid: 8432 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.063197:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f12237b9/0x92b8e04cbf5f973b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733c0 expref: 8 pid: 8432 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.063222:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f12237b9/0x92b8e04cbf5f973b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733c0 expref: 8 pid: 8432 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.063260:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217026.063264:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217026.063274:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000080baf22b/0x92b8e04cbf5f9742 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733c7 expref: 7 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.063284:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080baf22b/0x92b8e04cbf5f9742 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733c7 expref: 7 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.063323:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000080baf22b/0x92b8e04cbf5f9742 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733c7 expref: 7 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217026.063413:0:6505:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4360ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6505:1868789713073024:192.168.203.30@tcp:105: 00000100:00100000:0.0:1782217026.063499:0:6505:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43c99b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782217026.068038:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217026.068166:0:6505:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4360ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6505:1868789713073024:192.168.203.30@tcp:105: 00010000:00010000:0.0:1782217026.068192:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217026.068261:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e6f92e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24a87249-c61f-41a1-85ec-9a313129e739+7:2403:x1868789693057408:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 5114us (5389us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217026.068273:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 52 00000100:00100000:3.0:1782217026.068573:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693057664 00000100:00100000:3.0:1782217026.068618:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693057664 00000100:00100000:3.0:1782217026.068659:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6 00000100:00100000:3.0:1782217026.068668:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c695c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+15:11136:x1868789693057664:12345-192.168.203.30@tcp:35:bash.0 00000001:00080000:3.0:1782217026.068915:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967314 00000100:00100000:3.0:1782217026.069026:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c695c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+17:11136:x1868789693057664:12345-192.168.203.30@tcp:35:bash.0 Request processed in 358us (996us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1782217026.069035:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6 00000020:00080000:3.0:1782217026.069039:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1782217026.159406:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217026.159908:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693057920 00000100:00100000:0.0:1782217026.159988:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693057920 00000100:00100000:0.0:1782217026.160053:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 50 00000100:00100000:0.0:1782217026.160064:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c696300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+17:11146:x1868789693057920:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1782217026.160089:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217026.160172:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121de00/0x92b8e04cbf5f9749 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9733ce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782217026.160550:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1782217026.160697:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121de00/0x92b8e04cbf5f9749 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733ce expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.160711:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d410abd00) 00010000:00010000:0.0:1782217026.160715:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782217026.160720:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121de00/0x92b8e04cbf5f9749 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733ce expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.160735:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e4121de00, rc 0) 00000100:00100000:0.0:1782217026.160787:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c696300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+18:11146:x1868789693057920:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 725us (1390us total) trans 4294967316 rc 301/301 00000100:00100000:0.0:1782217026.160796:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 50 00000100:00100000:2.0:1782217026.163899:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217026.164026:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693058176 00000100:00100000:3.0:1782217026.164036:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693058176 00000100:00100000:3.0:1782217026.164084:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:3.0:1782217026.164094:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+18:11146:x1868789693058176:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:3.0:1782217026.164555:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+19:11146:x1868789693058176:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 460us (662us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1782217026.164564:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:1.0:1782217026.244715:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217026.245293:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693058304 00000100:00100000:0.0:1782217026.245303:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693058304 00000100:00100000:0.0:1782217026.245649:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 51 00000100:00100000:0.0:1782217026.245661:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d410b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+19:11152:x1868789693058304:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1782217026.245685:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217026.245704:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121de00/0x92b8e04cbf5f9757 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9733d5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.245771:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f975e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.245785:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f975e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.245813:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f975e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782217026.245871:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1782217026.245875:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782217026.245892:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f975e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.245917:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121de00/0x92b8e04cbf5f9757 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733d5 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.245935:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f975e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733d5 expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.245943:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff952e6105ce00) 00010000:00010000:0.0:1782217026.245946:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782217026.245949:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e4121da00, rc 0) 00000100:00100000:0.0:1782217026.246012:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d410b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+20:11152:x1868789693058304:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 355us (1306us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217026.246019:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 51 00000100:00100000:1.0:1782217026.249356:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217026.249501:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693058560 00000100:00100000:0.0:1782217026.249511:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693058560 00000100:00100000:0.0:1782217026.249655:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 52 00000100:00100000:0.0:1782217026.249667:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d410b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+20:11152:x1868789693058560:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1782217026.249687:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217026.249706:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9765 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9733dc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.249845:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121dc00/0x92b8e04cbf5f976c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.249859:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121dc00/0x92b8e04cbf5f976c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.249870:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121dc00/0x92b8e04cbf5f976c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782217026.249882:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1782217026.249995:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9765 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733dc expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.250017:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121dc00/0x92b8e04cbf5f976c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733dc expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.250027:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e6105c900) 00010000:00010000:0.0:1782217026.250030:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782217026.250034:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e4121dc00, rc 0) 00000100:00100000:0.0:1782217026.250083:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d410b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+22:11152:x1868789693058560:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 419us (736us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1782217026.250102:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 52 00000100:00100000:2.0:1782217026.252684:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217026.252847:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693058688 00000100:00100000:3.0:1782217026.252857:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693058688 00000100:00100000:3.0:1782217026.252920:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3 00000100:00100000:3.0:1782217026.252930:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42611500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24a87249-c61f-41a1-85ec-9a313129e739+22:2405:x1868789693058688:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782217026.252946:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217026.252968:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121dc00/0x92b8e04cbf5f976c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733dc expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.252988:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e6105c900) 00010000:00010000:3.0:1782217026.252993:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217026.253057:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42611500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24a87249-c61f-41a1-85ec-9a313129e739+21:2405:x1868789693058688:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 128us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217026.253065:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3 00000100:00100000:1.0:1782217026.253544:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217026.253817:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693058944 00000100:00100000:3.0:1782217026.253821:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693058944 00000100:00100000:3.0:1782217026.253898:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 53 00000100:00100000:3.0:1782217026.253906:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d410b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+21:11152:x1868789693058944:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1782217026.253926:0:6548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217026.253941:0:6548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f977a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9733e3 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.254035:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5f9781 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.254046:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5f9781 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.254053:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5f9781 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217026.254061:0:6548:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1782217026.254171:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f977a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733e3 expref: 24 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.254189:0:6548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5f9781 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733e3 expref: 23 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.254196:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e6105c900) 00010000:00010000:3.0:1782217026.254199:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1782217026.254302:0:6548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b363c00, rc 0) 00000100:00100000:3.0:1782217026.254336:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d410b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+23:11152:x1868789693058944:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 432us (794us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1782217026.254341:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 53 00000100:00100000:1.0:1782217026.260436:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217026.260525:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693059072 00000100:00100000:0.0:1782217026.260533:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693059072 00000100:00100000:0.0:1782217026.260729:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 31 00000100:00100000:0.0:1782217026.260741:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24a87249-c61f-41a1-85ec-9a313129e739+7:2402:x1868789693059072:12345-192.168.203.30@tcp:1:lfs.0 00010000:00010000:0.0:1782217026.260784:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000186f4659/0x92b8e04cbf5f978f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.260816:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000080baf22b/0x92b8e04cbf5f9742 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733c7 expref: 7 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.260825:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217026.260829:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782217026.260847:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000186f4659/0x92b8e04cbf5f978f lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.260883:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000080baf22b/0x92b8e04cbf5f9742 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733c7 expref: 7 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.260897:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000080baf22b/0x92b8e04cbf5f9742 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733c7 expref: 7 pid: 10025 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217026.260912:0:8432:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4360ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8432:1868789713073152:192.168.203.30@tcp:104: 00000100:00100000:0.0:1782217026.261009:0:8432:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43c99180 going to sleep for 11 seconds 00000100:00100000:0.0:1782217026.263392:0:8432:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4360ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8432:1868789713073152:192.168.203.30@tcp:104: 00010000:00010000:0.0:1782217026.263423:0:8432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000186f4659/0x92b8e04cbf5f978f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217026.264876:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217026.265098:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693059200 00000100:00100000:0.0:1782217026.265176:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693059200 00002000:00100000:0.0:1782217026.265225:0:8438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff952d4273c380 x1868789693059200/t0(0) o4->24a87249-c61f-41a1-85ec-9a313129e739@192.168.203.30@tcp:277/0 lens 504/0 e 0 to 0 dl 1782217037 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782217026.265254:0:8438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff952d4273c380 with x1868789693059200 ext(0->12) 00010000:00010000:0.0:1782217026.265265:0:8438:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000080baf22b/0x92b8e04cbf5f9742 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733c7 expref: 8 pid: 10025 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.265281:0:8438:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000080baf22b/0x92b8e04cbf5f9742 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733c7 expref: 8 pid: 10025 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782217026.265290:0:8438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff952d4273c380 00000100:00100000:0.0:1782217026.265322:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:0.0:1782217026.265331:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:24a87249-c61f-41a1-85ec-9a313129e739+8:2403:x1868789693059200:12345-192.168.203.30@tcp:4:lfs.0 00000001:00100000:3.0:1782217026.270111:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 24a87249-c61f-41a1-85ec-9a313129e739 00000100:00100000:0.0:1782217026.272302:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:24a87249-c61f-41a1-85ec-9a313129e739+9:2403:x1868789693059200:12345-192.168.203.30@tcp:4:lfs.0 Request processed in 6959us (7420us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1782217026.272318:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 0 00002000:00100000:0.0:1782217026.272332:0:8438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff952d4273c380 x1868789693059200/t4294967300(0) o4->24a87249-c61f-41a1-85ec-9a313129e739@192.168.203.30@tcp:277/0 lens 504/448 e 0 to 0 dl 1782217037 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782217026.272343:0:8438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff952d4273c380 with x1868789693059200 ext(0->12) 00010000:00010000:0.0:1782217026.272355:0:8438:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000080baf22b/0x92b8e04cbf5f9742 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733c7 expref: 9 pid: 10025 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.272375:0:8438:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000080baf22b/0x92b8e04cbf5f9742 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733c7 expref: 9 pid: 10025 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782217026.272384:0:8438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff952d4273c380 00000100:00100000:2.0:1782217026.288310:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217026.288403:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693059328 00000100:00100000:3.0:1782217026.288412:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693059328 00010000:00010000:3.0:1782217026.288452:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000080baf22b/0x92b8e04cbf5f9742 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733c7 expref: 9 pid: 10025 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217026.288495:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 53 00000100:00100000:3.0:1782217026.288504:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46db1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24a87249-c61f-41a1-85ec-9a313129e739+9:2405:x1868789693059328:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782217026.288518:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1782217026.288536:0:6504:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1782217026.288540:0:6504:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1782217026 00002000:00010000:3.0:1782217026.288542:0:6504:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1782217026 00002000:00010000:3.0:1782217026.288544:0:6504:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1782217026 00002000:00010000:3.0:1782217026.288546:0:6504:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1782217026.288553:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000080baf22b/0x92b8e04cbf5f9742 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733c7 expref: 9 pid: 10025 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.288567:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000080baf22b/0x92b8e04cbf5f9742 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733c7 expref: 9 pid: 10025 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.288632:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080baf22b/0x92b8e04cbf5f9742 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733c7 expref: 9 pid: 10025 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.288668:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782217026.288672:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782217026.288678:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000186f4659/0x92b8e04cbf5f978f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.288688:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000186f4659/0x92b8e04cbf5f978f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.288710:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217026.288786:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46db1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24a87249-c61f-41a1-85ec-9a313129e739+8:2405:x1868789693059328:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 274us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217026.288794:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 53 00010000:00010000:0.0:1782217026.288876:0:8432:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000186f4659/0x92b8e04cbf5f978f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.288894:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000186f4659/0x92b8e04cbf5f978f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.288925:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000186f4659/0x92b8e04cbf5f978f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.288935:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000186f4659/0x92b8e04cbf5f978f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.288943:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000186f4659/0x92b8e04cbf5f978f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.288950:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121d600 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:0.0:1782217026.288954:0:8432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000186f4659/0x92b8e04cbf5f978f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.288963:0:8432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000186f4659/0x92b8e04cbf5f978f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.288976:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000186f4659/0x92b8e04cbf5f978f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.288984:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000186f4659/0x92b8e04cbf5f978f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217026.289045:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24a87249-c61f-41a1-85ec-9a313129e739+7:2402:x1868789693059072:12345-192.168.203.30@tcp:1:lfs.0 Request processed in 28307us (28689us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217026.289054:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 31 00000100:00100000:1.0:1782217026.293168:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217026.293462:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693059584 00000100:00100000:3.0:1782217026.293471:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693059584 00000100:00100000:3.0:1782217026.293531:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 8 00000100:00100000:3.0:1782217026.293542:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+23:11152:x1868789693059584:12345-192.168.203.30@tcp:35:lfs.0 00000004:00010000:3.0:1782217026.293631:0:6521:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5f9781 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733e3 expref: 23 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782217026.294090:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1782217026.294128:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000001:00080000:3.0:1782217026.295107:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00010000:00010000:3.0:1782217026.295156:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f9796 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.295175:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9726 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733b9 expref: 27 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.295196:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f9796 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.295882:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9726 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733b9 expref: 27 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.297454:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9726 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733b9 expref: 27 pid: 6518 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217026.297485:0:6521:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c66c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1868789713073280:192.168.203.30@tcp:104: 00000100:00100000:3.0:1782217026.297630:0:6521:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d42661540 going to sleep for 11 seconds 00000100:00100000:0.0:1782217026.305475:0:6521:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c66c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1868789713073280:192.168.203.30@tcp:104: 00010000:00010000:0.0:1782217026.305507:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f9796 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217026.315117:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217026.315727:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693059712 00000100:00100000:0.0:1782217026.315737:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693059712 00010000:00010000:0.0:1782217026.315790:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9726 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733b9 expref: 28 pid: 6518 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217026.315870:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 54 00000100:00100000:0.0:1782217026.315880:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24a87249-c61f-41a1-85ec-9a313129e739+28:2403:x1868789693059712:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782217026.315894:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217026.315914:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9726 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733b9 expref: 28 pid: 6518 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.315928:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9726 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733b9 expref: 28 pid: 6518 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.315948:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9726 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733b9 expref: 28 pid: 6518 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.315964:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e6105c900) 00010000:00010000:0.0:1782217026.315982:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f9796 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.315991:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f9796 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.315999:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f9796 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.316030:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217026.316080:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24a87249-c61f-41a1-85ec-9a313129e739+27:2403:x1868789693059712:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 201us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217026.316087:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 54 00010000:00010000:1.0:1782217026.316138:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f9796 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.316146:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f9796 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782217026.317696:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000001:00080000:1.0:1782217026.317865:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:1.0:1782217026.317959:0:6521:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4273d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1868789713073408:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1782217026.318015:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217026.318200:0:6521:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e42d44240 going to sleep for 11 seconds 00000100:00100000:2.0:1782217026.318637:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713073408 00000100:00100000:2.0:1782217026.318645:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713073408 00000100:00100000:2.0:1782217026.318706:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1782217026.318715:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72e8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6521:x1868789713073408:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1782217026.318814:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72e8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6521:x1868789713073408:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 99us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217026.318821:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:1.0:1782217026.319244:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782217026.319282:0:6521:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4273d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1868789713073408:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1782217026.319661:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00000100:00100000:1.0:1782217026.319729:0:6521:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e72e8f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1868789713073536:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1782217026.320031:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217026.320132:0:6521:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e42d44cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782217026.320211:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713073536 00000100:00100000:2.0:1782217026.320217:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713073536 00000100:00100000:2.0:1782217026.320273:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1782217026.320282:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72e8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6521:x1868789713073536:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1782217026.320608:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72e8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6521:x1868789713073536:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 299us (550us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1782217026.320617:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1782217026.320762:0:6521:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e72e8f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1868789713073536:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1782217026.320822:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:1.0:1782217026.320869:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f9796 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.320878:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f9796 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.320885:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f9796 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.320891:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362000 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217026.320906:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f9796 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.321099:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f9796 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.321112:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e6105c900) 00010000:00010000:1.0:1782217026.321115:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1782217026.321118:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f9796 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.321122:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f9796 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782217026.321197:0:6521:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1782217026.321293:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1782217026.321302:0:6521:0:(osp_sync.c:1862:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 389304718970ns, next at 390304717263ns, rc = 0 00000001:00080000:1.0:1782217026.321309:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967327 00010000:00010000:1.0:1782217026.321331:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e6105c900) 00010000:00010000:1.0:1782217026.321402:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1782217026.321417:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5f9781 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733e3 expref: 31 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217026.321515:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+30:11152:x1868789693059584:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 27974us (28358us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1782217026.321527:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 8 00000020:00080000:1.0:1782217026.321531:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1782217026.326192:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217026.327493:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693059840 00000100:00100000:3.0:1782217026.327506:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693059840 00000100:00100000:3.0:1782217026.327576:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 54 00000100:00100000:3.0:1782217026.327623:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72e8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+30:11152:x1868789693059840:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1782217026.327647:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217026.327672:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f979d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9733ea expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.327730:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f979d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733ea expref: 31 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.327757:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f979d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733ea expref: 31 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.327777:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e46d74000) 00010000:00010000:3.0:1782217026.327794:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782217026.327798:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b362e00, rc 0) 00000100:00100000:3.0:1782217026.327873:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72e8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+31:11152:x1868789693059840:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 253us (1688us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217026.327881:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 54 00000100:00100000:2.0:1782217026.337281:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217026.337409:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693060096 00000100:00100000:0.0:1782217026.337418:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693060096 00000100:00100000:0.0:1782217026.337476:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:0.0:1782217026.337486:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e64f0a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24a87249-c61f-41a1-85ec-9a313129e739+31:11152:x1868789693060096:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:0.0:1782217026.337817:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e64f0a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24a87249-c61f-41a1-85ec-9a313129e739+32:11152:x1868789693060096:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 262us (473us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1782217026.337826:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:2.0:1782217026.434474:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217026.434885:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693060352 00000100:00100000:0.0:1782217026.434895:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693060352 00000100:00100000:0.0:1782217026.434960:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 55 00000100:00100000:0.0:1782217026.434979:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46db2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+32:11162:x1868789693060352:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1782217026.435002:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217026.435019:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121de00/0x92b8e04cbf5f97a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9733f1 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782217026.435394:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1782217026.435505:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121de00/0x92b8e04cbf5f97a4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733f1 expref: 34 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.435519:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d410abd00) 00010000:00010000:0.0:1782217026.435523:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782217026.435528:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121de00/0x92b8e04cbf5f97a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733f1 expref: 34 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.435542:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e4121de00, rc 0) 00000100:00100000:0.0:1782217026.435711:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46db2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+33:11162:x1868789693060352:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 741us (1244us total) trans 4294967330 rc 301/301 00000100:00100000:0.0:1782217026.435719:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 55 00000100:00100000:1.0:1782217026.446332:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217026.446428:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693060480 00000100:00100000:3.0:1782217026.446437:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693060480 00000100:00100000:3.0:1782217026.446494:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 56 00000100:00100000:3.0:1782217026.446505:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72e8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+33:11162:x1868789693060480:12345-192.168.203.30@tcp:34:lfs.0 00010000:00010000:3.0:1782217026.446577:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5f97b2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.446631:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5f97b2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.446643:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5f97b2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.446657:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5f97b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.446665:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5f97b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.446671:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5f97b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.446759:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f97c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.446767:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f97c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.446790:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f97c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782217026.446850:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f97c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.446864:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5f97b2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.446870:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5f97b2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.446877:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5f97b2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.446883:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b363a00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217026.446887:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5f97b2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.446894:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5f97b2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.446906:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff952e6105ce00) 00010000:00010000:3.0:1782217026.446909:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217026.447051:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5f97b2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.447059:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5f97b2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.447075:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5f97b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.447087:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5f97b9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.447093:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5f97b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.447098:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b363c00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217026.447101:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5f97b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.447107:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5f97b9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.447116:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff952e6105c300) 00010000:00010000:3.0:1782217026.447119:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217026.447122:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5f97b9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.447128:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5f97b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.447139:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f97c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.447144:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f97c0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.447149:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f97c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.447154:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362000 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217026.447162:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f97c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.447168:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f97c0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.447176:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e46d74000) 00010000:00010000:3.0:1782217026.447179:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217026.447181:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f97c0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.447187:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f97c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217026.447263:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72e8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+33:11162:x1868789693060480:12345-192.168.203.30@tcp:34:lfs.0 Request processed in 759us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217026.447271:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 56 00000100:00100000:3.0:1782217026.453049:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217026.455004:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693060736 00000100:00100000:1.0:1782217026.455017:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693060736 00000100:00100000:1.0:1782217026.455121:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00100000:1.0:1782217026.455132:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c66c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+33:11162:x1868789693060736:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:1.0:1782217026.455365:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c66c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+34:11162:x1868789693060736:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 233us (2324us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1782217026.455373:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00100000:2.0:1782217026.498156:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217026.498223:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693060992 00000100:00100000:3.0:1782217026.498234:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693060992 00000100:00100000:3.0:1782217026.498344:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 57 00000100:00100000:3.0:1782217026.498355:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d425f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+34:11165:x1868789693060992:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1782217026.498379:0:6548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217026.498398:0:6548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f97c7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9733f8 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.498472:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5f97ce lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.498485:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5f97ce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.498510:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5f97ce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.498523:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5f97d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.498530:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5f97d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.498537:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5f97d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.498681:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f97dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.498690:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f97dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.498697:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f97dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217026.498708:0:6548:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1782217026.498798:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5f97ce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.498805:0:6548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5f97ce lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.498816:0:6548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5f97ce lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.498822:0:6548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b363c00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217026.498842:0:6548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5f97ce lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.498850:0:6548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5f97ce lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.498862:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff952e6105ce00) 00010000:00010000:3.0:1782217026.498865:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217026.498869:0:6548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5f97ce lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.498875:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5f97ce lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.498887:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5f97d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.498892:0:6548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5f97d5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.498898:0:6548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5f97d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.498904:0:6548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b363a00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217026.498907:0:6548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5f97d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.498912:0:6548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5f97d5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.498918:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff952e6105c300) 00010000:00010000:3.0:1782217026.498920:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217026.498927:0:6548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5f97d5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.498933:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5f97d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.498965:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f97c7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733f8 expref: 37 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.498977:0:6548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f97dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733f8 expref: 36 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.498984:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e46d74000) 00010000:00010000:3.0:1782217026.498986:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782217026.498988:0:6548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b362400, rc 0) 00000100:00100000:3.0:1782217026.499051:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d425f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+36:11165:x1868789693060992:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 697us (904us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1782217026.499058:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 57 00000100:00100000:1.0:1782217026.502881:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217026.503264:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693061120 00000100:00100000:3.0:1782217026.503274:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693061120 00000100:00100000:3.0:1782217026.503326:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 58 00000100:00100000:3.0:1782217026.503336:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72e8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+36:11165:x1868789693061120:12345-192.168.203.30@tcp:54:lfs.0 00010000:00010000:3.0:1782217026.503408:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5f97ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.503425:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5f97ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.503437:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5f97ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.503486:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5f97ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.503493:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5f97ea lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.503499:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5f97ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.503505:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362c00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217026.503509:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5f97ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.503516:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5f97ea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.503528:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e46d74000) 00010000:00010000:3.0:1782217026.503531:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782217026.503535:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5f97ea lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.503540:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5f97ea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217026.503642:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72e8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+36:11165:x1868789693061120:12345-192.168.203.30@tcp:54:lfs.0 Request processed in 306us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217026.503650:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 58 00000100:00100000:2.0:1782217026.508181:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217026.508989:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693061376 00000100:00100000:0.0:1782217026.509001:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693061376 00000100:00100000:0.0:1782217026.509076:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 11 00000100:00100000:0.0:1782217026.509087:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d425f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24a87249-c61f-41a1-85ec-9a313129e739+36:11165:x1868789693061376:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:0.0:1782217026.509335:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d425f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24a87249-c61f-41a1-85ec-9a313129e739+37:11165:x1868789693061376:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 249us (1163us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1782217026.509343:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 11 00000100:00100000:2.0:1782217026.777743:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217026.777861:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693061632 00000100:00100000:0.0:1782217026.777871:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693061632 00000100:00100000:0.0:1782217026.777939:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 59 00000100:00100000:0.0:1782217026.777950:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d425f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+37:11196:x1868789693061632:12345-192.168.203.30@tcp:101:cat.0 00010000:00010000:0.0:1782217026.777973:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217026.777992:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121de00/0x92b8e04cbf5f97f1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9733ff expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.778121:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f97f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.778135:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f97f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.778146:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f97f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782217026.778156:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1782217026.778270:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121de00/0x92b8e04cbf5f97f1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733ff expref: 40 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.778289:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f97f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733ff expref: 39 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217026.778299:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e46d74000) 00010000:00010000:0.0:1782217026.778301:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782217026.778304:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e4121ca00, rc 0) 00000100:00100000:0.0:1782217026.778519:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d425f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+39:11196:x1868789693061632:12345-192.168.203.30@tcp:101:cat.0 Request processed in 569us (784us total) trans 4294967334 rc 0/0 00000100:00100000:0.0:1782217026.778527:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 59 00000100:00100000:2.0:1782217026.787335:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217026.787439:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217026.787627:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693061888 00000100:00100000:0.0:1782217026.787637:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693061888 00000100:00100000:0.0:1782217026.787749:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 12 00000100:00100000:0.0:1782217026.787759:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d425f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24a87249-c61f-41a1-85ec-9a313129e739+39:11196:x1868789693061888:12345-192.168.203.30@tcp:35:cat.0 00000100:00100000:0.0:1782217026.788003:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d425f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24a87249-c61f-41a1-85ec-9a313129e739+40:11196:x1868789693061888:12345-192.168.203.30@tcp:35:cat.0 Request processed in 245us (676us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1782217026.788024:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 12 00000100:00100000:3.0:1782217026.788074:0:13731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693062016 00000100:00100000:3.0:1782217026.788080:0:13731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693062016 00000100:00100000:3.0:1782217026.788116:0:13731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 4 00000100:00100000:3.0:1782217026.788132:0:13731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:24a87249-c61f-41a1-85ec-9a313129e739+40:2404:x1868789693062016:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782217026.788143:0:13731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217026.788165:0:13731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f97f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733ff expref: 40 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.788182:0:13731:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e46d74000) 00010000:00010000:3.0:1782217026.788187:0:13731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217026.788209:0:13731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:24a87249-c61f-41a1-85ec-9a313129e739+39:2404:x1868789693062016:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 78us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217026.788216:0:13731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 4 00000100:00100000:2.0:1782217026.856257:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217026.856746:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693062272 00000100:00100000:3.0:1782217026.856757:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693062272 00000100:00100000:3.0:1782217026.856823:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 60 00000100:00100000:3.0:1782217026.856841:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+39:11202:x1868789693062272:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:3.0:1782217026.856865:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217026.856868:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1782217026.857077:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f975e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733d5 expref: 39 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.857100:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff952e6105ce00) 00010000:00010000:3.0:1782217026.857105:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782217026.857119:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5f9806 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973406 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.857219:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5f980d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.857249:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f97dc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733f8 expref: 39 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.857258:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5f980d lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.857290:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f97dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733f8 expref: 39 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.857304:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f97dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733f8 expref: 39 pid: 6548 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217026.857317:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c66c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1868789713073664:192.168.203.30@tcp:104: 00000100:00100000:3.0:1782217026.857651:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d42661a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782217026.862955:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217026.863463:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693062400 00000100:00100000:1.0:1782217026.863483:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693062400 00010000:00010000:1.0:1782217026.863524:0:8449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f97dc lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733f8 expref: 40 pid: 6548 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217026.863567:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 55 00000100:00100000:1.0:1782217026.863575:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:24a87249-c61f-41a1-85ec-9a313129e739+40:2402:x1868789693062400:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782217026.863621:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782217026.863629:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f97dc lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733f8 expref: 40 pid: 6548 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.863661:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f97dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733f8 expref: 40 pid: 6548 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.863683:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e46d74000) 00010000:00010000:1.0:1782217026.863689:0:8449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5f980d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.863699:0:8449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5f980d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.863706:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5f980d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.863724:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782217026.863772:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:24a87249-c61f-41a1-85ec-9a313129e739+40:2402:x1868789693062400:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 197us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217026.863780:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 55 00010000:00010000:3.0:1782217026.863967:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f97dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733f8 expref: 39 pid: 6548 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217026.863982:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c66c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1868789713073664:192.168.203.30@tcp:104: 00010000:00010000:3.0:1782217026.864001:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5f980d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.864009:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5f980d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.864015:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5f980d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217026.864031:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1782217026.864166:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5f9806 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973406 expref: 40 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.864181:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5f980d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973406 expref: 39 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.864189:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e46d74000) 00010000:00010000:3.0:1782217026.864191:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1782217026.864194:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b362c00, rc 0) 00000100:00100000:3.0:1782217026.864219:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+39:11202:x1868789693062272:12345-192.168.203.30@tcp:101:dd.0 Request processed in 7380us (7969us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1782217026.864226:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 60 00000100:00100000:2.0:1782217026.867914:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217026.868058:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693062528 00000100:00100000:3.0:1782217026.868068:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693062528 00000100:00100000:3.0:1782217026.868129:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 61 00000100:00100000:3.0:1782217026.868139:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+39:11202:x1868789693062528:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:3.0:1782217026.868162:0:6548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217026.868181:0:6548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f981b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be97340d expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.868213:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5f9822 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.868227:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5f9822 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.868238:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5f9822 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.868361:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f981b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97340d expref: 41 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.868379:0:6548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5f9822 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97340d expref: 40 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217026.868388:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e46d74000) 00010000:00010000:3.0:1782217026.868391:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1782217026.868394:0:6548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b363a00, rc 0) 00000100:00100000:3.0:1782217026.868493:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+40:11202:x1868789693062528:12345-192.168.203.30@tcp:101:dd.0 Request processed in 355us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217026.868501:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 61 00000100:00100000:0.0:1782217026.886647:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217026.888844:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693062784 00000100:00100000:1.0:1782217026.888858:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693062784 00000100:00100000:1.0:1782217026.889138:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 62 00000100:00100000:1.0:1782217026.889149:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4360ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+40:11202:x1868789693062784:12345-192.168.203.30@tcp:36:dd.0 00010000:00010000:1.0:1782217026.889363:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5f9829 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.889380:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5f9829 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.889391:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5f9829 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782217026.889451:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1782217026.889669:0:6520:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b7ae0a8b reply state 00000000e81d90d2 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5f9829 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.889684:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5f9829 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217026.889692:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e46d74000) 00010000:00010000:1.0:1782217026.889695:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782217026.889698:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782217026.889787:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4360ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+43:11202:x1868789693062784:12345-192.168.203.30@tcp:36:dd.0 Request processed in 639us (3148us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1782217026.889795:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 62 00000020:00080000:1.0:1782217026.889800:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1782217027.066872:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782217027.239162:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217027.239268:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693062912 00000100:00100000:3.0:1782217027.239277:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693062912 00000100:00080000:1.0:1782217027.239418:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782217027.239848:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 63 00000100:00100000:3.0:1782217027.239860:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+43:11216:x1868789693062912:12345-192.168.203.30@tcp:101:stat.0 00010000:00010000:3.0:1782217027.239883:0:6548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217027.239902:0:6548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f9830 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973414 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217027.239967:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5f9837 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217027.239982:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5f9837 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217027.239994:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5f9837 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217027.240020:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f983e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217027.240028:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f983e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217027.240035:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f983e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217027.240173:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5f9845 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217027.240187:0:6548:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5f980d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973406 expref: 44 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217027.240196:0:6548:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5f9845 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217027.240230:0:6548:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5f980d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973406 expref: 44 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217027.240246:0:6548:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5f980d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973406 expref: 44 pid: 6519 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217027.240260:0:6548:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c66c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6548:1868789713073792:192.168.203.30@tcp:104: 00000100:00100000:3.0:1782217027.240643:0:6548:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d42661a80 going to sleep for 11 seconds 00000100:00100000:3.0:1782217027.243246:0:6548:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c66c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6548:1868789713073792:192.168.203.30@tcp:104: 00010000:00010000:3.0:1782217027.243277:0:6548:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5f9845 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217027.243344:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217027.243531:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693063168 00000100:00100000:1.0:1782217027.243538:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693063168 00000100:00100000:1.0:1782217027.243632:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 13 00000100:00100000:1.0:1782217027.243641:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+45:6171:x1868789693063168:12345-192.168.203.30@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1782217027.243918:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+46:6171:x1868789693063168:12345-192.168.203.30@tcp:35:ldlm_bl.0 Request processed in 277us (575us total) trans 4294967339 rc 0/0 00000100:00100000:1.0:1782217027.243926:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 13 00000100:00100000:2.0:1782217027.251873:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217027.251974:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693063296 00000100:00100000:0.0:1782217027.251983:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693063296 00010000:00010000:0.0:1782217027.252023:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5f980d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973406 expref: 46 pid: 6519 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217027.252065:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 56 00000100:00100000:0.0:1782217027.252074:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24a87249-c61f-41a1-85ec-9a313129e739+46:2402:x1868789693063296:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782217027.252090:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217027.252096:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5f980d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973406 expref: 46 pid: 6519 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.252119:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5f980d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973406 expref: 46 pid: 6519 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.252141:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5f980d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973406 expref: 46 pid: 6519 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.252156:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e46d74000) 00010000:00010000:0.0:1782217027.252161:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5f9845 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.252181:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5f9845 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.252187:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5f9845 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.252237:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217027.252304:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24a87249-c61f-41a1-85ec-9a313129e739+45:2402:x1868789693063296:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 223us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217027.252313:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 56 00010000:00010000:1.0:1782217027.252393:0:6548:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5f9845 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217027.252402:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5f9845 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782217027.252466:0:6548:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1782217027.252471:0:6548:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782217027.252506:0:6548:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5f9845 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217027.252518:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5f9845 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217027.252527:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5f9837 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217027.252533:0:6548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5f9837 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217027.252539:0:6548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5f9837 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217027.252545:0:6548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362a00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217027.252549:0:6548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5f9837 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217027.252557:0:6548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5f9837 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217027.252567:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff952e6105ce00) 00010000:00010000:1.0:1782217027.252569:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217027.252574:0:6548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5f9837 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217027.252605:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5f9837 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217027.252626:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f983e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217027.252632:0:6548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f983e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217027.252637:0:6548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f983e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217027.252642:0:6548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362400 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217027.252645:0:6548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f983e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217027.252650:0:6548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f983e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217027.252658:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff952e6105c300) 00010000:00010000:1.0:1782217027.252661:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217027.252663:0:6548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f983e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217027.252669:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f983e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217027.252697:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f9830 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973414 expref: 45 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217027.252711:0:6548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5f9845 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973414 expref: 44 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217027.252728:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e46d74000) 00010000:00010000:1.0:1782217027.252730:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782217027.252732:0:6548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b363c00, rc 0) 00000100:00100000:1.0:1782217027.252773:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+44:11216:x1868789693062912:12345-192.168.203.30@tcp:101:stat.0 Request processed in 12916us (13702us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217027.252779:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 63 00000100:00100000:2.0:1782217027.308474:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217027.308705:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693063552 00000100:00100000:3.0:1782217027.308714:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693063552 00000100:00100000:3.0:1782217027.308792:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 64 00000100:00100000:3.0:1782217027.308802:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43dcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+44:11222:x1868789693063552:12345-192.168.203.30@tcp:36:truncate.0 00010000:00010000:3.0:1782217027.308869:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217027.308911:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5f9845 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973414 expref: 44 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217027.308930:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e46d74000) 00010000:00010000:3.0:1782217027.308934:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782217027.309087:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5f984c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217027.309100:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5f984c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217027.309108:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5f984c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782217027.309148:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967340 00000004:00010000:3.0:1782217027.309169:0:6519:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ab0a8d70 reply state 00000000b062462d transno 4294967341 ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5f984c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217027.309180:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5f984c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217027.309185:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e46d74000) 00010000:00010000:3.0:1782217027.309188:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782217027.309203:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782217027.309307:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43dcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+46:11222:x1868789693063552:12345-192.168.203.30@tcp:36:truncate.0 Request processed in 506us (843us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1782217027.309314:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 64 00000020:00080000:3.0:1782217027.309319:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1782217027.489940:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217027.490068:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693063680 00000100:00100000:0.0:1782217027.490077:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693063680 00000100:00100000:0.0:1782217027.490136:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 65 00000100:00100000:0.0:1782217027.490145:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43dc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+46:11236:x1868789693063680:12345-192.168.203.30@tcp:101:stat.0 00010000:00010000:0.0:1782217027.490169:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217027.490189:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d000/0x92b8e04cbf5f9853 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be97341b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.490248:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c400/0x92b8e04cbf5f985a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.490262:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c400/0x92b8e04cbf5f985a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.490272:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c400/0x92b8e04cbf5f985a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.490282:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9861 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.490289:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9861 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.490294:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9861 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.490378:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c000/0x92b8e04cbf5f9868 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.490386:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c000/0x92b8e04cbf5f9868 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.490392:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c000/0x92b8e04cbf5f9868 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782217027.490428:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1782217027.490432:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782217027.490453:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c000/0x92b8e04cbf5f9868 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.490463:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c000/0x92b8e04cbf5f9868 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.490470:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c400/0x92b8e04cbf5f985a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.490477:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c400/0x92b8e04cbf5f985a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.490483:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c400/0x92b8e04cbf5f985a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.490489:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121c400 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782217027.490493:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c400/0x92b8e04cbf5f985a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.490501:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c400/0x92b8e04cbf5f985a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.490519:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff952e6105ce00) 00010000:00010000:0.0:1782217027.490522:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217027.490527:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c400/0x92b8e04cbf5f985a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.490533:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c400/0x92b8e04cbf5f985a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.490547:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9861 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.490553:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9861 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.490559:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9861 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.490564:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121c600 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782217027.490566:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9861 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.490572:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9861 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.490579:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff952e6105c300) 00010000:00010000:0.0:1782217027.490633:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217027.490637:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9861 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.490643:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9861 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.490683:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d000/0x92b8e04cbf5f9853 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97341b expref: 48 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.490695:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c000/0x92b8e04cbf5f9868 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97341b expref: 47 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.490701:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e46d74000) 00010000:00010000:0.0:1782217027.490703:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782217027.490705:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e4121c000, rc 0) 00000100:00100000:0.0:1782217027.490756:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43dc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+47:11236:x1868789693063680:12345-192.168.203.30@tcp:101:stat.0 Request processed in 611us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217027.490763:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 65 00000100:00100000:2.0:1782217027.527108:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217027.527155:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217027.527195:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217027.527224:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217027.527250:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217027.527280:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693064320 00000100:00100000:2.0:1782217027.527288:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693064320 00000100:00100000:1.0:1782217027.527333:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693064064 00000100:00100000:2.0:1782217027.527337:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693063936 00000100:00100000:1.0:1782217027.527338:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693064064 00000100:00100000:2.0:1782217027.527339:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693063936 00000100:00100000:2.0:1782217027.527352:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693064192 00000100:00100000:2.0:1782217027.527354:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693064192 00000100:00100000:1.0:1782217027.527367:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 86 00000100:00100000:2.0:1782217027.527368:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 291 00000100:00100000:2.0:1782217027.527376:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43dc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a927f5f6-9735-45e0-abce-963bd125e020+5:2403:x1868789693064320:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1782217027.527376:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43dc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:24a87249-c61f-41a1-85ec-9a313129e739+7:2403:x1868789693064064:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1782217027.527442:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43dc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:24a87249-c61f-41a1-85ec-9a313129e739+7:2403:x1868789693064064:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 67us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217027.527450:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 86 00000100:00100000:3.0:1782217027.527458:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 292 00000100:00100000:3.0:1782217027.527466:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43dc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+5:2403:x1868789693063936:12345-192.168.203.30@tcp:400:kworker.0 00000100:00080000:1.0:1782217027.527469:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782217027.527472:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782217027.527534:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693063808 00000100:00100000:0.0:1782217027.527538:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693063808 00000100:00100000:0.0:1782217027.527568:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 382 00000100:00100000:0.0:1782217027.527574:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e582c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:2403:x1868789693063808:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1782217027.530103:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43dc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a927f5f6-9735-45e0-abce-963bd125e020+5:2403:x1868789693064320:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 2718us (2897us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217027.530117:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 291 00000100:00100000:2.0:1782217027.530154:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 293 00000100:00100000:2.0:1782217027.530166:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a927f5f6-9735-45e0-abce-963bd125e020+5:2403:x1868789693064192:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1782217027.530217:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a927f5f6-9735-45e0-abce-963bd125e020+5:2403:x1868789693064192:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 54us (2965us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217027.530224:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 293 00000100:00100000:3.0:1782217027.530446:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43dc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+5:2403:x1868789693063936:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 2979us (3220us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217027.530454:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 292 00000100:00100000:0.0:1782217027.530553:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e582c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:2403:x1868789693063808:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 2977us (3451us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217027.530562:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 382 00000100:00100000:2.0:1782217027.585137:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217027.585236:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693064576 00000100:00100000:0.0:1782217027.585247:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693064576 00000100:00100000:0.0:1782217027.585310:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 66 00000100:00100000:0.0:1782217027.585321:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c692d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+47:11246:x1868789693064576:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1782217027.585343:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217027.585363:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d000/0x92b8e04cbf5f986f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973422 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782217027.585493:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1782217027.585796:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d000/0x92b8e04cbf5f986f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973422 expref: 49 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.585811:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d410abd00) 00010000:00010000:0.0:1782217027.585815:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782217027.585819:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d000/0x92b8e04cbf5f986f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973422 expref: 49 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.585843:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e4121d000, rc 0) 00000100:00100000:0.0:1782217027.585940:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c692d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+48:11246:x1868789693064576:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 621us (810us total) trans 4294967342 rc 301/301 00000100:00100000:0.0:1782217027.585948:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 66 00000100:00100000:1.0:1782217027.599417:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217027.599559:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693064832 00000100:00100000:2.0:1782217027.599569:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693064832 00000100:00100000:2.0:1782217027.599675:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 14 00000100:00100000:2.0:1782217027.599686:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72e8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+48:11246:x1868789693064832:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:2.0:1782217027.599934:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72e8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+49:11246:x1868789693064832:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 248us (525us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1782217027.599942:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 14 00000100:00100000:2.0:1782217027.677376:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217027.677487:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693065088 00000100:00100000:1.0:1782217027.677497:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693065088 00000100:00100000:1.0:1782217027.677563:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 67 00000100:00100000:1.0:1782217027.677575:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+49:11252:x1868789693065088:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:1.0:1782217027.677641:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217027.677664:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5f987d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973429 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217027.677789:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9884 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217027.677817:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c000/0x92b8e04cbf5f9868 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97341b expref: 50 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217027.677837:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9884 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217027.677875:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c000/0x92b8e04cbf5f9868 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97341b expref: 50 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217027.677887:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c000/0x92b8e04cbf5f9868 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97341b expref: 50 pid: 6518 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217027.677914:0:6520:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e72e8c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1868789713073920:192.168.203.30@tcp:104: 00000100:00100000:1.0:1782217027.678016:0:6520:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e42d440c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782217027.682940:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217027.683034:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693065216 00000100:00100000:3.0:1782217027.683043:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693065216 00010000:00010000:3.0:1782217027.683083:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c000/0x92b8e04cbf5f9868 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97341b expref: 51 pid: 6518 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217027.683124:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 57 00000100:00100000:3.0:1782217027.683135:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e6f92dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24a87249-c61f-41a1-85ec-9a313129e739+51:2403:x1868789693065216:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782217027.683150:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217027.683157:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c000/0x92b8e04cbf5f9868 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97341b expref: 51 pid: 6518 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217027.683170:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c000/0x92b8e04cbf5f9868 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97341b expref: 51 pid: 6518 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217027.683192:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e46d74000) 00010000:00010000:3.0:1782217027.683197:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9884 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217027.683237:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9884 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217027.683245:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9884 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217027.683264:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217027.683655:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e6f92dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24a87249-c61f-41a1-85ec-9a313129e739+51:2403:x1868789693065216:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 192us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217027.683664:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 57 00010000:00010000:2.0:1782217027.684751:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c000/0x92b8e04cbf5f9868 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97341b expref: 50 pid: 6518 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217027.684773:0:6520:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e72e8c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1868789713073920:192.168.203.30@tcp:104: 00010000:00010000:2.0:1782217027.684792:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9884 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.684801:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9884 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.684831:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9884 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217027.684851:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1782217027.684992:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5f987d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973429 expref: 51 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.685008:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9884 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973429 expref: 50 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.685015:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e46d74000) 00010000:00010000:2.0:1782217027.685018:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1782217027.685021:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43072e00, rc 0) 00000100:00100000:2.0:1782217027.685083:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+50:11252:x1868789693065088:12345-192.168.203.30@tcp:101:bash.0 Request processed in 7510us (7716us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1782217027.685091:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 67 00000100:00100000:1.0:1782217027.687868:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217027.687971:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693065472 00000100:00100000:2.0:1782217027.687980:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693065472 00000100:00100000:2.0:1782217027.688040:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 68 00000100:00100000:2.0:1782217027.688050:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72e8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+50:11252:x1868789693065472:12345-192.168.203.30@tcp:36:bash.0 00010000:00010000:2.0:1782217027.688287:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9892 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.688304:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9892 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.688314:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9892 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782217027.688498:0:6548:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967345 00000004:00010000:2.0:1782217027.688520:0:6548:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000052953550 reply state 0000000007582ffb transno 4294967346 ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9892 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.688532:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9892 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.688539:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e46d74000) 00010000:00010000:2.0:1782217027.688542:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1782217027.688545:0:6548:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782217027.688696:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72e8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+53:11252:x1868789693065472:12345-192.168.203.30@tcp:36:bash.0 Request processed in 647us (837us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1782217027.688705:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 68 00000020:00080000:2.0:1782217027.688709:0:6548:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1782217027.705505:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217027.705999:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693065600 00000100:00100000:3.0:1782217027.706010:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693065600 00000100:00100000:3.0:1782217027.706121:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 69 00000100:00100000:3.0:1782217027.706132:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+53:11252:x1868789693065600:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:3.0:1782217027.706154:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217027.706173:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5f9899 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973430 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217027.706295:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f98a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217027.706311:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9884 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973429 expref: 54 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217027.706322:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f98a0 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217027.706366:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9884 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973429 expref: 54 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217027.706388:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9884 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973429 expref: 54 pid: 6520 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217027.706402:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c66c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1868789713074048:192.168.203.30@tcp:104: 00000100:00100000:3.0:1782217027.706481:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d426616c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782217027.709767:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217027.709883:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693065728 00000100:00100000:0.0:1782217027.709892:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693065728 00010000:00010000:0.0:1782217027.709936:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9884 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973429 expref: 55 pid: 6520 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217027.709976:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 58 00000100:00100000:0.0:1782217027.709986:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24a87249-c61f-41a1-85ec-9a313129e739+55:2403:x1868789693065728:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782217027.710000:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217027.710007:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9884 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973429 expref: 55 pid: 6520 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.710020:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9884 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973429 expref: 55 pid: 6520 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.710054:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e46d74000) 00010000:00010000:0.0:1782217027.710059:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f98a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.710070:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f98a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.710077:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f98a0 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217027.710096:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217027.710146:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24a87249-c61f-41a1-85ec-9a313129e739+55:2403:x1868789693065728:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 160us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217027.710154:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 58 00010000:00010000:3.0:1782217027.710672:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9884 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973429 expref: 54 pid: 6520 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217027.710692:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c66c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1868789713074048:192.168.203.30@tcp:104: 00010000:00010000:3.0:1782217027.710712:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f98a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217027.710722:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f98a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217027.710729:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f98a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217027.710791:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1782217027.710796:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782217027.710813:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f98a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217027.710852:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5f9899 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973430 expref: 54 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217027.710866:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f98a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973430 expref: 53 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217027.710884:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e46d74000) 00010000:00010000:3.0:1782217027.710887:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782217027.710891:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b362000, rc 0) 00000100:00100000:3.0:1782217027.710942:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+53:11252:x1868789693065600:12345-192.168.203.30@tcp:101:bash.0 Request processed in 4811us (5446us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217027.710950:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 69 00000100:00100000:1.0:1782217027.721744:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217027.723503:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693065984 00000100:00100000:2.0:1782217027.723518:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693065984 00000100:00100000:0.0:1782217027.723995:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 15 00000100:00100000:0.0:1782217027.724007:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e64f0a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+53:11252:x1868789693065984:12345-192.168.203.30@tcp:35:bash.0 00000100:00100000:0.0:1782217027.724243:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e64f0a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+54:11252:x1868789693065984:12345-192.168.203.30@tcp:35:bash.0 Request processed in 238us (2522us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1782217027.724251:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 15 00000100:00100000:0.0:1782217027.830785:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217027.830936:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693066240 00000100:00100000:2.0:1782217027.830946:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693066240 00000100:00100000:2.0:1782217027.831009:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 70 00000100:00100000:2.0:1782217027.831020:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4360d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+54:11262:x1868789693066240:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1782217027.831045:0:6548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217027.831066:0:6548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f98a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973437 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217027.831166:0:6548:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1782217027.831261:0:6548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f98a7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973437 expref: 56 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.831294:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d410abd00) 00010000:00010000:2.0:1782217027.831297:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782217027.831302:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f98a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973437 expref: 56 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.831315:0:6548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2c800, rc 0) 00000100:00100000:2.0:1782217027.831379:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4360d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+55:11262:x1868789693066240:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 360us (602us total) trans 4294967348 rc 301/301 00000100:00100000:2.0:1782217027.831386:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 70 00000100:00100000:1.0:1782217027.834704:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217027.835517:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693066368 00000100:00100000:2.0:1782217027.835528:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693066368 00000100:00100000:2.0:1782217027.835626:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 71 00000100:00100000:2.0:1782217027.835636:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+55:11262:x1868789693066368:12345-192.168.203.30@tcp:34:lfs.0 00010000:00010000:2.0:1782217027.835707:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f98b5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.835733:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f98b5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.835744:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f98b5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.835754:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f98bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.835761:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f98bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.835784:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f98bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.835868:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f98c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.835877:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f98c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.835884:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f98c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782217027.835926:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f98c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.835937:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f98b5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.835944:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f98b5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.835951:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f98b5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.835957:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2cc00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782217027.835961:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f98b5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.835967:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f98b5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.835978:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff952e6105ce00) 00010000:00010000:2.0:1782217027.835988:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217027.835993:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f98b5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.835999:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f98b5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.836012:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f98bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.836019:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f98bc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.836025:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f98bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.836030:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2d200 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782217027.836033:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f98bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.836038:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f98bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.836045:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff952e6105c300) 00010000:00010000:2.0:1782217027.836047:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217027.836050:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f98bc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.836055:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f98bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.836063:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f98c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.836073:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f98c3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.836078:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f98c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.836083:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2d800 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782217027.836086:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f98c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.836092:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f98c3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.836098:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e46d74000) 00010000:00010000:2.0:1782217027.836100:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217027.836103:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f98c3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.836108:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f98c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217027.836187:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+55:11262:x1868789693066368:12345-192.168.203.30@tcp:34:lfs.0 Request processed in 545us (1484us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217027.836195:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 71 00000100:00100000:1.0:1782217027.839746:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217027.842907:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693066624 00000100:00100000:3.0:1782217027.842921:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693066624 00000100:00100000:1.0:1782217027.843078:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:1.0:1782217027.843089:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43605880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24a87249-c61f-41a1-85ec-9a313129e739+55:11262:x1868789693066624:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:1.0:1782217027.843317:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43605880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24a87249-c61f-41a1-85ec-9a313129e739+56:11262:x1868789693066624:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 228us (3581us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1782217027.843326:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:1.0:1782217027.889271:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217027.889369:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693066880 00000100:00100000:2.0:1782217027.889379:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693066880 00000100:00100000:2.0:1782217027.889438:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 72 00000100:00100000:2.0:1782217027.889448:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+56:11265:x1868789693066880:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1782217027.889472:0:6548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217027.889501:0:6548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f98ca lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be97343e expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.889572:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f98d1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.889616:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f98d1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.889628:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f98d1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.889639:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f98d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.889646:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f98d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.889652:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f98d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.889755:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f98df lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.889765:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f98df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.889772:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f98df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217027.889782:0:6548:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1782217027.889866:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f98d1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.889884:0:6548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f98d1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.889892:0:6548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f98d1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.889899:0:6548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2d200 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782217027.889904:0:6548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f98d1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.889912:0:6548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f98d1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.889924:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff952e6105ce00) 00010000:00010000:2.0:1782217027.889928:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217027.889932:0:6548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f98d1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.889939:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f98d1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.889953:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f98d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.889959:0:6548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f98d8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.889965:0:6548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f98d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.889970:0:6548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2cc00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782217027.889979:0:6548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f98d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.889986:0:6548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f98d8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.889994:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff952e6105c300) 00010000:00010000:2.0:1782217027.889997:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217027.890000:0:6548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f98d8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.890006:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f98d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.890041:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f98ca lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97343e expref: 59 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.890054:0:6548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f98df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97343e expref: 58 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217027.890062:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e46d74000) 00010000:00010000:2.0:1782217027.890064:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782217027.890067:0:6548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2c600, rc 0) 00000100:00100000:2.0:1782217027.890130:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+58:11265:x1868789693066880:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 683us (867us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1782217027.890137:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 72 00000100:00100000:2.0:1782217027.897373:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217027.897459:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693067008 00000100:00100000:1.0:1782217027.897477:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693067008 00000100:00100000:1.0:1782217027.897534:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 73 00000100:00100000:1.0:1782217027.897542:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+58:11265:x1868789693067008:12345-192.168.203.30@tcp:54:lfs.0 00010000:00010000:1.0:1782217027.897631:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f98ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217027.897649:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f98ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217027.897659:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f98ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217027.897692:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f98ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217027.897699:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f98ed lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217027.897705:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f98ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217027.897724:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43073400 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217027.897728:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f98ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217027.897736:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f98ed lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217027.897747:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e46d74000) 00010000:00010000:1.0:1782217027.897750:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782217027.897768:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f98ed lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217027.897774:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f98ed lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217027.897854:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+58:11265:x1868789693067008:12345-192.168.203.30@tcp:54:lfs.0 Request processed in 311us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217027.897862:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 73 00000100:00100000:1.0:1782217027.898958:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217027.899051:0:13731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693067136 00000100:00100000:3.0:1782217027.899059:0:13731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693067136 00000100:00100000:3.0:1782217027.899120:0:13731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5 00000100:00100000:3.0:1782217027.899133:0:13731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43606a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:24a87249-c61f-41a1-85ec-9a313129e739+58:2403:x1868789693067136:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782217027.899148:0:13731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217027.899168:0:13731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f98df lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97343e expref: 58 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217027.899184:0:13731:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e46d74000) 00010000:00010000:3.0:1782217027.899188:0:13731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217027.899234:0:13731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43606a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:24a87249-c61f-41a1-85ec-9a313129e739+57:2403:x1868789693067136:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 106us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217027.899241:0:13731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5 00000100:00100000:2.0:1782217027.902633:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217027.902725:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693067392 00000100:00100000:1.0:1782217027.902735:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693067392 00000100:00100000:1.0:1782217027.902799:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:1.0:1782217027.902809:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24a87249-c61f-41a1-85ec-9a313129e739+57:11265:x1868789693067392:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:1.0:1782217027.903034:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24a87249-c61f-41a1-85ec-9a313129e739+58:11265:x1868789693067392:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 225us (408us total) trans 4294967351 rc 0/0 00000100:00100000:1.0:1782217027.903042:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 17 00010000:00010000:2.0:1782217028.089083:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782217028.095615:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217028.097794:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693067648 00000100:00100000:2.0:1782217028.097829:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693067648 00000100:00100000:2.0:1782217028.097947:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 74 00000100:00100000:2.0:1782217028.097958:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4360c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+58:11283:x1868789693067648:12345-192.168.203.30@tcp:101:cat.0 00010000:00010000:2.0:1782217028.097991:0:6548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217028.098010:0:6548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f98f4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973445 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217028.098114:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f98fb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217028.098128:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f98fb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217028.098139:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f98fb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217028.098150:0:6548:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1782217028.098255:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f98f4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973445 expref: 61 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217028.098274:0:6548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f98fb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973445 expref: 60 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217028.098283:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e46d74000) 00010000:00010000:2.0:1782217028.098285:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1782217028.098288:0:6548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2cc00, rc 0) 00000100:00100000:2.0:1782217028.098361:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4360c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+60:11283:x1868789693067648:12345-192.168.203.30@tcp:101:cat.0 Request processed in 404us (2780us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1782217028.098368:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 74 00000100:00100000:0.0:1782217028.128429:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217028.128525:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693067776 00000100:00100000:1.0:1782217028.128535:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693067776 00000100:00100000:3.0:1782217028.128621:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 75 00000100:00100000:3.0:1782217028.128633:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4360f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+60:11284:x1868789693067776:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1782217028.128659:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217028.128679:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5f9909 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be97344c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.128758:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f9910 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.128772:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f9910 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.128784:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f9910 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217028.128840:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1782217028.128844:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782217028.129402:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f9910 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.129431:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5f9909 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97344c expref: 62 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.129449:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f9910 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97344c expref: 61 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.129457:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff952e6105ce00) 00010000:00010000:3.0:1782217028.129460:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782217028.129463:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b362400, rc 0) 00000100:00100000:3.0:1782217028.129533:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4360f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+61:11284:x1868789693067776:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 903us (1113us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217028.129540:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 75 00000100:00100000:1.0:1782217028.136463:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217028.136619:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693068160 00000100:00100000:2.0:1782217028.136628:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693068160 00000100:00100000:2.0:1782217028.136723:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 18 00000100:00100000:2.0:1782217028.136733:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+61:11284:x1868789693068160:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:2.0:1782217028.137034:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+62:11284:x1868789693068160:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 301us (578us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1782217028.137042:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 18 00000100:00100000:0.0:1782217028.140180:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217028.140266:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693068288 00000100:00100000:3.0:1782217028.140275:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693068288 00000100:00100000:3.0:1782217028.140353:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6 00000100:00100000:3.0:1782217028.140364:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4360ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24a87249-c61f-41a1-85ec-9a313129e739+62:11284:x1868789693068288:12345-192.168.203.30@tcp:103:lfs.0 00010000:00010000:3.0:1782217028.140381:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1782217028.140405:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f98a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973430 expref: 62 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.140428:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f98fb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973445 expref: 61 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.140440:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f979d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733ea expref: 60 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.140450:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e46d74000) 00010000:00010000:3.0:1782217028.140454:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217028.140524:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4360ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24a87249-c61f-41a1-85ec-9a313129e739+59:11284:x1868789693068288:12345-192.168.203.30@tcp:103:lfs.0 Request processed in 161us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217028.140532:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6 00000100:00100000:0.0:1782217028.142779:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217028.143211:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693068416 00000100:00100000:2.0:1782217028.143221:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693068416 00000100:00100000:2.0:1782217028.143280:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 76 00000100:00100000:2.0:1782217028.143290:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4360df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+59:11284:x1868789693068416:12345-192.168.203.30@tcp:58:lfs.0 00010000:00010000:2.0:1782217028.143418:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9917 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217028.143435:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9917 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217028.143447:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9917 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782217028.143768:0:6518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782217028.143968:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1782217028.144045:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1782217028.144168:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4360df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+59:11284:x1868789693068416:12345-192.168.203.30@tcp:58:lfs.0 Request processed in 877us (1391us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217028.144178:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 76 00000100:00100000:1.0:1782217028.174028:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217028.174142:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693068544 00000100:00100000:2.0:1782217028.174153:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693068544 00000100:00100000:2.0:1782217028.174218:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 77 00000100:00100000:2.0:1782217028.174242:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43605f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+59:11286:x1868789693068544:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1782217028.174263:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217028.174282:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f991e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973453 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217028.174349:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9925 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217028.174363:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9925 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217028.174375:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9925 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217028.174386:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f992c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217028.174392:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f992c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217028.174399:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f992c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217028.174477:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9933 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217028.174487:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9933 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217028.174494:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9933 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217028.174552:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1782217028.174557:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782217028.174575:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9933 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217028.174619:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9933 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217028.174628:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9925 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217028.174634:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9925 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217028.174641:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9925 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217028.174647:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2c400 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782217028.174651:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9925 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217028.174658:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9925 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217028.174670:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff952e6105ce00) 00010000:00010000:2.0:1782217028.174674:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217028.174678:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9925 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217028.174685:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9925 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217028.174710:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f992c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217028.174716:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f992c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217028.174722:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f992c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217028.174728:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2d000 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782217028.174731:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f992c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217028.174736:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f992c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217028.174744:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff952e6105c300) 00010000:00010000:2.0:1782217028.174746:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217028.174750:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f992c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217028.174755:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f992c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217028.174783:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f991e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973453 expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217028.174798:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9933 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973453 expref: 60 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217028.174826:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e46d74000) 00010000:00010000:2.0:1782217028.174828:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782217028.174831:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2cc00, rc 0) 00000100:00100000:2.0:1782217028.174895:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43605f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+60:11286:x1868789693068544:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 654us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217028.174903:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 77 00000040:00080000:3.0:1782217028.921013:0:13796:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782217028.921023:0:13796:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782217028.921062:0:13796:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1782217028.921071:0:13796:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782217028.921199:0:13796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c66c700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13796:1868789713074176:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1782217028.921298:0:13796:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d426cc9c0 going to sleep for 11 seconds 00000040:00080000:3.0:1782217028.923656:0:13800:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1782217028.927236:0:13796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c66c700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13796:1868789713074176:192.168.203.30@tcp:107:hsm_cdtr.0 00000001:00080000:0.0:1782217028.929363:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:0.0:1782217028.929426:0:6498:0:(osp_sync.c:1827:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:0.0:1782217028.929461:0:6498:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff952e42d44240 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1782217028.929467:0:6498:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff952e7c54d300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff952e42d44780 00000020:00080000:0.0:1782217028.929470:0:6498:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff952e7c54da00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff952e7c69ba00 00000100:00100000:2.0:1782217028.929645:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782217028.929665:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713074304:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782217028.929732:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217028.929774:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713074304 00000100:00100000:2.0:1782217028.929781:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713074304 00000100:00100000:2.0:1782217028.929845:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1782217028.929855:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4379ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3650:x1868789713074304:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1782217028.929883:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:2.0:1782217028.929927:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a3a7942, atime: 0x6a3a7942, ctime: 0x6a3a7942, blocks: 0x8 00010000:00010000:2.0:1782217028.929935:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec49ad75/0x92b8e04cbf5f993a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217028.929951:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=391s v=(0 0) 00010000:00010000:2.0:1782217028.929955:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782217028.929961:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec49ad75/0x92b8e04cbf5f993a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217028.929976:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec49ad75/0x92b8e04cbf5f993a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217028.929999:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec49ad75/0x92b8e04cbf5f993a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217028.930006:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec49ad75/0x92b8e04cbf5f993a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217028.930021:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782217028.930155:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4379ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3650:x1868789713074304:12345-0@lo:6:osp-syn-1-0.0 Request processed in 301us (423us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1782217028.930163:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1782217028.930185:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1782217028.930214:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff952d43799f80/2, rc 0, transno 4294967302 00000100:00100000:2.0:1782217028.930220:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713074304:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1782217028.930291:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f96d9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.930307:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f96d9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.930314:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f96d9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.930320:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43072600 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217028.930324:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f96d9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.930332:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f96d9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.930346:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff952e6105cf00) 00010000:00010000:3.0:1782217028.930349:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217028.930354:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f96d9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.930360:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f96d9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.930379:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f96e0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.930384:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f96e0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.930389:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f96e0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.930393:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43073a00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217028.930402:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f96e0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.930408:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f96e0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.930416:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff952e6105ce00) 00010000:00010000:3.0:1782217028.930419:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217028.930421:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f96e0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.930426:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f96e0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.930438:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073c00/0x92b8e04cbf5f971f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.930444:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073c00/0x92b8e04cbf5f971f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.930450:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073c00/0x92b8e04cbf5f971f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.930455:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43073c00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217028.930457:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073c00/0x92b8e04cbf5f971f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.930462:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073c00/0x92b8e04cbf5f971f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.930469:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff952e6105c300) 00010000:00010000:3.0:1782217028.930471:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217028.930480:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073c00/0x92b8e04cbf5f971f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.930486:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073c00/0x92b8e04cbf5f971f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.930503:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5f9829 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.930510:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5f9829 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.930515:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5f9829 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.930520:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43073600 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217028.930523:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5f9829 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.930529:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5f9829 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.930537:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e46d74000) 00010000:00010000:3.0:1782217028.930539:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217028.930542:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5f9829 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.930547:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5f9829 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.930557:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5f984c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.930563:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5f984c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.930576:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5f984c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.930605:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b363e00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217028.930609:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5f984c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.930616:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5f984c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.930625:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e46d74000) 00010000:00010000:3.0:1782217028.930627:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217028.930630:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5f984c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.930635:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5f984c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.930647:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9892 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.930653:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9892 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.930659:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9892 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.930663:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2c200 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217028.930665:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9892 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.930681:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9892 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.930690:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e46d74000) 00010000:00010000:3.0:1782217028.930692:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217028.930695:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9892 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.930700:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9892 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1782217028.930718:0:6551:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1782217028.930864:0:6551:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:3.0:1782217028.930875:0:10336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782217028.930881:0:10336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec49ad75/0x92b8e04cbf5f993a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.930889:0:10336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2c400 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:3.0:1782217028.930893:0:10336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec49ad75/0x92b8e04cbf5f993a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.930900:0:10336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec49ad75/0x92b8e04cbf5f993a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.930911:0:10336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec49ad75/0x92b8e04cbf5f993a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.930918:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec49ad75/0x92b8e04cbf5f993a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.930939:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217028.930941:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217028.930943:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782217028.931512:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217028.931577:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693068672 00000100:00100000:2.0:1782217028.931666:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693068672 00000100:00100000:2.0:1782217028.934152:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 78 00000100:00100000:2.0:1782217028.934169:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c66c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+12:11297:x1868789693068672:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1782217028.934207:0:6548:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1782217028.934348:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c66c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+12:11297:x1868789693068672:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 184us (2840us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217028.934357:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 78 00000100:00100000:3.0:1782217028.938844:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217028.939340:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693068800 00000100:00100000:0.0:1782217028.939350:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693068800 00000100:00100000:0.0:1782217028.939395:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 79 00000100:00100000:0.0:1782217028.939405:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c66c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+12:11297:x1868789693068800:12345-192.168.203.30@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1782217028.939472:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9941 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.939489:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9941 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.939501:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9941 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.939515:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f9948 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.939521:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f9948 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.939527:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f9948 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.939553:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f994f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.939561:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f994f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.939579:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f994f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782217028.939643:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1782217028.939647:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782217028.939659:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f994f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.939671:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9941 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.939678:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9941 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.939686:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9941 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.939691:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121da00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782217028.939696:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9941 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.939702:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9941 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.939714:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff952e7b201600) 00010000:00010000:0.0:1782217028.939717:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217028.939721:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9941 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.939727:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9941 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.939749:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f9948 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.939755:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f9948 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.939762:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f9948 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.939767:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121ca00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782217028.939770:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f9948 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.939775:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f9948 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.939782:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff952d426a0900) 00010000:00010000:0.0:1782217028.939785:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217028.939788:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f9948 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.939793:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f9948 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.939807:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f994f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.939829:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f994f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.939835:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f994f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.939846:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121d600 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782217028.939849:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f994f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.939855:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f994f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.939864:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e46d74000) 00010000:00010000:0.0:1782217028.939866:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217028.939868:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f994f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.939873:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f994f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217028.939942:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c66c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+12:11297:x1868789693068800:12345-192.168.203.30@tcp:34:lhsmtool_posix.0 Request processed in 537us (1107us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217028.939950:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 79 00000100:00100000:3.0:1782217028.944176:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217028.944210:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693069056 00000100:00100000:3.0:1782217028.944219:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693069056 00000100:00100000:3.0:1782217028.944269:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 80 00000100:00100000:3.0:1782217028.944278:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c66c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+12:11297:x1868789693069056:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782217028.944298:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217028.944316:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5f9956 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be97345a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.944420:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f995d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.944435:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f995d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.944446:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f995d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217028.944457:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1782217028.944538:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f995d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.944546:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f995d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.944560:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f995d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.944566:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362e00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217028.944570:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f995d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.944578:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f995d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.944610:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e46d74000) 00010000:00010000:3.0:1782217028.944614:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782217028.944619:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f995d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.944625:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f995d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.944661:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5f9956 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97345a expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.944672:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff952e7b201600) 00010000:00010000:3.0:1782217028.944674:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782217028.944678:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5f9956 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97345a expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.944687:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b363e00, rc 0) 00000100:00100000:3.0:1782217028.944740:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c66c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+13:11297:x1868789693069056:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 462us (572us total) trans 4294967354 rc 301/301 00000100:00100000:3.0:1782217028.944756:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 80 00000100:00100000:3.0:1782217028.947456:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217028.949643:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693069184 00000100:00100000:1.0:1782217028.949657:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693069184 00000100:00100000:1.0:1782217028.949713:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 81 00000100:00100000:1.0:1782217028.949723:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46db1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+13:11297:x1868789693069184:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1782217028.949756:0:6520:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1782217028.950355:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46db1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+13:11297:x1868789693069184:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 165us (2438us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217028.950376:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 81 00000100:00100000:3.0:1782217028.952724:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217028.952919:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693069440 00000100:00100000:0.0:1782217028.952929:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693069440 00000100:00100000:0.0:1782217028.952985:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 82 00000100:00100000:0.0:1782217028.952996:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+13:11297:x1868789693069440:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782217028.953017:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217028.953021:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1782217028.953048:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f9910 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97344c expref: 13 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.953064:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff952e6105ce00) 00010000:00010000:0.0:1782217028.953080:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782217028.953094:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f996b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973461 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782217028.953459:0:6518:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:0.0:1782217028.953622:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f9972 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.953636:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f9972 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.953645:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f9972 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.953696:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f996b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973461 expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.953711:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f9972 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973461 expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.953719:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff952d426a0900) 00010000:00010000:0.0:1782217028.953721:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782217028.953723:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e4121ca00, rc 0) 00000100:00100000:0.0:1782217028.953781:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+14:11297:x1868789693069440:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 786us (1062us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1782217028.953788:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 82 00000100:00100000:3.0:1782217028.966184:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217028.966252:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693069696 00000100:00100000:0.0:1782217028.966262:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693069696 00000100:00100000:0.0:1782217028.966317:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 83 00000100:00100000:0.0:1782217028.966327:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+14:11297:x1868789693069696:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1782217028.966388:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217028.966415:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f9972 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973461 expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.966432:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff952d426a0900) 00010000:00010000:0.0:1782217028.966441:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782217028.966460:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9980 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.966473:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9980 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.966483:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9980 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.966495:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9987 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x827e427f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.966503:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9987 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x827e427f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.966510:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9987 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x827e427f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.966552:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9980 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.966559:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9980 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.966565:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9980 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.966578:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121d600 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782217028.966611:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9980 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.966619:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9980 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.966628:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff952e6105ce00) 00010000:00010000:0.0:1782217028.966631:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217028.966635:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9980 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.966640:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9980 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.966649:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9987 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x827e427f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.966654:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9987 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x827e427f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.966659:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9987 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x827e427f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.966664:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121da00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782217028.966667:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9987 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x827e427f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.966672:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9987 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x827e427f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.966688:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x827e427f (ffff952d426a0800) 00010000:00010000:0.0:1782217028.966690:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217028.966693:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9987 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x827e427f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.966699:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9987 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x827e427f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217028.966832:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+13:11297:x1868789693069696:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 506us (655us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782217028.966839:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 83 00000100:00100000:0.0:1782217028.978397:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217028.978523:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693069824 00000100:00100000:1.0:1782217028.978532:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693069824 00000100:00100000:1.0:1782217028.978613:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 84 00000100:00100000:1.0:1782217028.978623:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d425f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+13:11297:x1868789693069824:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782217028.978645:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217028.978668:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072000/0x92b8e04cbf5f998e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973468 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217028.978703:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5f9995 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217028.978717:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5f9995 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217028.978729:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5f9995 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217028.978843:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072000/0x92b8e04cbf5f998e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973468 expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217028.978860:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5f9995 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973468 expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217028.978869:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff952e6105c800) 00010000:00010000:1.0:1782217028.978872:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782217028.978876:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43073e00, rc 0) 00000100:00100000:1.0:1782217028.979159:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d425f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+14:11297:x1868789693069824:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 536us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217028.979173:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 84 00000100:00100000:3.0:1782217028.987122:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217028.987154:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693070080 00000100:00100000:3.0:1782217028.987163:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693070080 00000100:00100000:3.0:1782217028.987211:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 85 00000100:00100000:3.0:1782217028.987220:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+14:11297:x1868789693070080:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1782217028.987299:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5f999c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.987327:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5f999c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.987338:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5f999c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782217028.987404:0:14208:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782217028.987410:0:14208:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782217028.987446:0:14208:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1782217028.987453:0:14208:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1782217028.987503:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1782217028.987514:0:6519:0:(osp_sync.c:1862:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 391970931065ns, next at 392970928800ns, rc = 0 00000004:00010000:3.0:1782217028.987563:0:6519:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a5217c14 reply state 00000000a8eb6aa5 transno 4294967356 ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5f999c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.987576:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5f999c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217028.987611:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff952e6105c800) 00010000:00010000:3.0:1782217028.987614:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1782217028.987624:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782217028.987718:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+16:11297:x1868789693070080:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 498us (603us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1782217028.987725:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 85 00000100:00100000:2.0:1782217028.995481:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217028.998451:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693070208 00000100:00100000:0.0:1782217028.998464:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693070208 00000100:00100000:0.0:1782217028.998528:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 86 00000100:00100000:0.0:1782217028.998538:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+16:11297:x1868789693070208:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782217028.998562:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217028.998605:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f99a3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be97346f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.998662:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f99a3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97346f expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.998676:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f99a3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97346f expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217028.998695:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff952e6105c800) 00010000:00010000:0.0:1782217028.998708:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782217028.998712:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e4121da00, rc 0) 00000100:00100000:0.0:1782217028.998779:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+17:11297:x1868789693070208:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 242us (3306us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217028.998786:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 86 00000100:00100000:1.0:1782217029.017076:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217029.017113:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693070336 00000100:00100000:1.0:1782217029.017123:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693070336 00000100:00100000:1.0:1782217029.017160:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 33 00000100:00100000:1.0:1782217029.017168:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43607800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2401:x1868789693070336:12345-192.168.203.30@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1782217029.017209:0:8434:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 24a87249-c61f-41a1-85ec-9a313129e739@192.168.203.30@tcp t0 exp 0000000000000000 cur 391 last 0 00000020:00000080:1.0:1782217029.017237:0:8434:0:(genops.c:1406:class_connect()) connect: client 24a87249-c61f-41a1-85ec-9a313129e739, cookie 0x92b8e04cbf5f99aa 00002000:00100000:1.0:1782217029.017249:0:8434:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 24a87249-c61f-41a1-85ec-9a313129e739/ffff952e481cd000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782217029.017267:0:8434:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1782217029.017357:0:8434:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1782217029.017390:0:8434:0:(import.c:65:import_set_state_nolock()) ffff952e481cc000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782217029.017460:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43607800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:24a87249-c61f-41a1-85ec-9a313129e739+6:2401:x1868789693070336:12345-192.168.203.30@tcp:8:lhsmtool_posix.0 Request processed in 291us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217029.017468:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 33 00000100:00100000:3.0:1782217029.026547:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217029.026603:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693070464 00000100:00100000:3.0:1782217029.026613:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693070464 00000100:00100000:3.0:1782217029.026675:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 34 00000100:00100000:3.0:1782217029.026686:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4263c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:24a87249-c61f-41a1-85ec-9a313129e739+6:0:x1868789693070464:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1782217029.026855:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1782217029.034639:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:3.0:1782217029.034651:0:8428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 24a87249-c61f-41a1-85ec-9a313129e739 00000100:00100000:2.0:1782217029.035073:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4263c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:24a87249-c61f-41a1-85ec-9a313129e739+5:0:x1868789693070464:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 Request processed in 8383us (8530us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1782217029.035084:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 34 00000100:00100000:3.0:1782217029.038115:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217029.038191:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693070720 00000100:00100000:0.0:1782217029.038200:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693070720 00000100:00100000:0.0:1782217029.038271:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:0.0:1782217029.038282:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4263e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24a87249-c61f-41a1-85ec-9a313129e739+17:11297:x1868789693070720:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1782217029.038496:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4263e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24a87249-c61f-41a1-85ec-9a313129e739+18:11297:x1868789693070720:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 214us (389us total) trans 4294967357 rc 0/0 00000100:00100000:0.0:1782217029.038504:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00080000:3.0:1782217029.038708:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782217029.054059:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217029.054258:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693070976 00000100:00100000:0.0:1782217029.054269:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693070976 00000100:00100000:0.0:1782217029.054339:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 87 00000100:00100000:0.0:1782217029.054350:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43604700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+18:11297:x1868789693070976:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1782217029.054456:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43604700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+18:11297:x1868789693070976:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 108us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217029.054465:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 87 00000100:00100000:0.0:1782217029.059562:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217029.063125:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693071104 00000100:00100000:3.0:1782217029.063140:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693071104 00000100:00100000:3.0:1782217029.063208:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 88 00000100:00100000:3.0:1782217029.063219:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d425f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+18:11297:x1868789693071104:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782217029.063240:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217029.063260:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f99b1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973476 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217029.063341:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f99b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217029.063356:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f99b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217029.063369:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f99b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217029.063424:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782217029.063446:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f99b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217029.063473:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f99b1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973476 expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217029.063490:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f99b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973476 expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217029.063499:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff952e6105c800) 00010000:00010000:3.0:1782217029.063502:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1782217029.063506:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b362000, rc 0) 00000100:00100000:3.0:1782217029.063577:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d425f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+19:11297:x1868789693071104:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 360us (4021us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217029.063605:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 88 00000100:00100000:0.0:1782217029.070849:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217029.071873:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693071232 00000100:00100000:1.0:1782217029.071885:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693071232 00000100:00100000:1.0:1782217029.071959:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 35 00000100:00100000:1.0:1782217029.071979:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:24a87249-c61f-41a1-85ec-9a313129e739+5:2403:x1868789693071232:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782217029.071997:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217029.072020:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eaecfe3e/0x92b8e04cbf5f99bf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be97347d expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782217029.072045:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a3a7944, blocks: 0x0 00010000:00010000:1.0:1782217029.072070:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=392s v=(0 0) 00010000:00010000:1.0:1782217029.072075:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217029.072084:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eaecfe3e/0x92b8e04cbf5f99bf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97347d expref: 6 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.072103:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eaecfe3e/0x92b8e04cbf5f99bf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97347d expref: 6 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.072115:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43072000, rc 0) 00000100:00100000:1.0:1782217029.072169:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:24a87249-c61f-41a1-85ec-9a313129e739+6:2403:x1868789693071232:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 201us (1330us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217029.072176:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 35 00000100:00100000:1.0:1782217029.085041:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217029.085398:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693071488 00000100:00100000:3.0:1782217029.085409:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693071488 00000100:00100000:3.0:1782217029.085464:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 89 00000100:00100000:3.0:1782217029.085475:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+19:11297:x1868789693071488:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1782217029.086136:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+19:11297:x1868789693071488:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 661us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217029.086146:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 89 00000100:00100000:3.0:1782217029.088906:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217029.088978:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693071616 00000100:00100000:1.0:1782217029.088989:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693071616 00000100:00100000:1.0:1782217029.089041:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 36 00000100:00100000:1.0:1782217029.089050:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4263ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24a87249-c61f-41a1-85ec-9a313129e739+6:11297:x1868789693071616:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782217029.089066:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217029.089081:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091802ae6/0x92b8e04cbf5f99c6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973484 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.089109:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eaecfe3e/0x92b8e04cbf5f99bf lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97347d expref: 7 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.089118:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217029.089123:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217029.089136:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091802ae6/0x92b8e04cbf5f99c6 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973484 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.089165:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eaecfe3e/0x92b8e04cbf5f99bf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97347d expref: 7 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.089178:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eaecfe3e/0x92b8e04cbf5f99bf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97347d expref: 7 pid: 8434 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217029.089192:0:8432:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43605180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8432:1868789713074432:192.168.203.30@tcp:104: 00000100:00100000:1.0:1782217029.089270:0:8432:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e529a2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1782217029.098197:0:8432:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43605180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8432:1868789713074432:192.168.203.30@tcp:104: 00010000:00010000:3.0:1782217029.098244:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000091802ae6/0x92b8e04cbf5f99c6 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973484 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217029.098279:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43072200, rc 0) 00000100:00100000:3.0:1782217029.098342:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4263ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24a87249-c61f-41a1-85ec-9a313129e739+7:11297:x1868789693071616:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 9292us (9444us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217029.098351:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 36 00000100:00100000:3.0:1782217029.101727:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217029.101859:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693071744 00000100:00100000:1.0:1782217029.101870:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693071744 00010000:00010000:1.0:1782217029.101919:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eaecfe3e/0x92b8e04cbf5f99bf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97347d expref: 7 pid: 8434 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217029.101953:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 59 00000100:00100000:1.0:1782217029.101962:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4263e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24a87249-c61f-41a1-85ec-9a313129e739+7:2402:x1868789693071744:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782217029.101990:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782217029.102014:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eaecfe3e/0x92b8e04cbf5f99bf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97347d expref: 7 pid: 8434 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.102029:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eaecfe3e/0x92b8e04cbf5f99bf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97347d expref: 7 pid: 8434 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.102053:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eaecfe3e/0x92b8e04cbf5f99bf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97347d expref: 7 pid: 8434 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.102080:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217029.102085:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217029.102094:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000091802ae6/0x92b8e04cbf5f99c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973484 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.102105:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091802ae6/0x92b8e04cbf5f99c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973484 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.102143:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000091802ae6/0x92b8e04cbf5f99c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973484 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217029.102158:0:6505:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43607b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6505:1868789713074560:192.168.203.30@tcp:105: 00000100:00100000:1.0:1782217029.102550:0:6505:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e529a2480 going to sleep for 11 seconds 00010000:00010000:3.0:1782217029.113166:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782217029.113484:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217029.113647:0:6505:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43607b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6505:1868789713074560:192.168.203.30@tcp:105: 00010000:00010000:0.0:1782217029.113668:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217029.113758:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693071872 00000100:00100000:3.0:1782217029.113765:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693071872 00002000:00100000:3.0:1782217029.113818:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff952d4379a680 x1868789693071872/t0(0) o4->24a87249-c61f-41a1-85ec-9a313129e739@192.168.203.30@tcp:280/0 lens 504/0 e 0 to 0 dl 1782217040 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782217029.113828:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff952d4379a680 with x1868789693071872 ext(0->8) 00002000:00010000:3.0:1782217029.113833:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff952d4379a680 00000100:00100000:3.0:1782217029.113859:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:3.0:1782217029.113868:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4379a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:24a87249-c61f-41a1-85ec-9a313129e739+7:2402:x1868789693071872:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1782217029.114902:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4263e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24a87249-c61f-41a1-85ec-9a313129e739+9:2402:x1868789693071744:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 12926us (13169us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217029.114915:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 59 00000100:00100000:3.0:1782217029.115133:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4379a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:24a87249-c61f-41a1-85ec-9a313129e739+8:2402:x1868789693071872:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 Request processed in 1265us (1653us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1782217029.115142:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 0 00002000:00100000:3.0:1782217029.115150:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff952d4379a680 x1868789693071872/t4294967303(0) o4->24a87249-c61f-41a1-85ec-9a313129e739@192.168.203.30@tcp:280/0 lens 504/448 e 0 to 0 dl 1782217040 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782217029.115160:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff952d4379a680 with x1868789693071872 ext(0->8) 00002000:00010000:3.0:1782217029.115165:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff952d4379a680 00000100:00100000:1.0:1782217029.117170:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217029.117486:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693072000 00000100:00100000:2.0:1782217029.117495:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693072000 00000100:00100000:2.0:1782217029.117577:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 90 00000100:00100000:2.0:1782217029.117617:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+19:11297:x1868789693072000:12345-192.168.203.30@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1782217029.120905:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967357 is committed 00000004:00080000:3.0:1782217029.120922:0:6498:0:(osp_sync.c:1827:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1782217029.120943:0:6498:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:3.0:1782217029.121048:0:6551:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1782217029.121058:0:6551:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1782217029.121073:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4263fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713074688:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1782217029.121135:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217029.121184:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713074688 00000100:00100000:3.0:1782217029.121191:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713074688 00000100:00100000:3.0:1782217029.121242:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1782217029.121251:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4263f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713074688:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1782217029.121409:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5f999c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217029.121420:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5f999c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217029.121428:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5f999c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217029.121434:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b363e00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782217029.121438:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5f999c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217029.121445:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5f999c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217029.121461:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff952e6105c800) 00010000:00010000:0.0:1782217029.121464:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782217029.121469:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5f999c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217029.121475:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5f999c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782217029.121650:0:8434:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1782217029.121654:0:8434:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1782217029 00002000:00010000:3.0:1782217029.121657:0:8434:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1782217029.121659:0:8434:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1782217028 -> 1782217029 00002000:00010000:3.0:1782217029.121662:0:8434:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1782217029.121703:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4263f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1868789713074688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 453us (567us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1782217029.121711:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1782217029.121731:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782217029.121833:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+14:11297:x1868789693072000:12345-192.168.203.30@tcp:44:lhsmtool_posix.0 Request processed in 4217us (4668us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217029.121842:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 90 00000004:00080000:0.0:1782217029.122017:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff952d4263fb80/2, rc 0, transno 4294967304 00000100:00100000:0.0:1782217029.122023:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4263fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713074688:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1782217029.123924:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217029.124190:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693072128 00000100:00100000:0.0:1782217029.124199:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693072128 00000100:00100000:0.0:1782217029.124279:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 38 00000100:00100000:0.0:1782217029.124288:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4263ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:24a87249-c61f-41a1-85ec-9a313129e739+8:2403:x1868789693072128:12345-192.168.203.30@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1782217029.126674:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:1.0:1782217029.126686:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:2.0:1782217029.126926:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4263ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:24a87249-c61f-41a1-85ec-9a313129e739+6:2403:x1868789693072128:12345-192.168.203.30@tcp:16:lhsmtool_posix.0 Request processed in 2632us (3002us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217029.126936:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 38 00000100:00100000:3.0:1782217029.130412:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217029.130515:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693072384 00000100:00100000:1.0:1782217029.130524:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693072384 00000100:00100000:1.0:1782217029.130619:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 91 00000100:00100000:1.0:1782217029.130629:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4263d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+14:11297:x1868789693072384:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1782217029.130687:0:6548:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782217029.130800:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f99b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973476 expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.130828:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff952e6105c800) 00010000:00010000:1.0:1782217029.130840:0:6548:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782217029.130878:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5f99cd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.130902:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5f99cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.130913:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5f99cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782217029.131137:0:6548:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009b756aa1 reply state 00000000213f8dea transno 4294967358 ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5f99cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.131151:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5f99cd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.131157:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff952e6105c800) 00010000:00010000:1.0:1782217029.131160:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782217029.131163:0:6548:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782217029.131268:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4263d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+15:11297:x1868789693072384:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 639us (862us total) trans 4294967358 rc 0/0 00000100:00100000:1.0:1782217029.131276:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 91 00000100:00100000:1.0:1782217029.136224:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217029.136303:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693072512 00000100:00100000:3.0:1782217029.136313:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693072512 00000100:00100000:3.0:1782217029.136372:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 39 00000100:00100000:3.0:1782217029.136381:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:24a87249-c61f-41a1-85ec-9a313129e739+6:2404:x1868789693072512:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1782217029.136540:0:8434:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1782217029.136544:0:8434:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1782217029 -> 1782217027 00002000:00010000:3.0:1782217029.136547:0:8434:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1782217026 00002000:00010000:3.0:1782217029.136550:0:8434:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1782217029 -> 1782217027 00002000:00010000:3.0:1782217029.136552:0:8434:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1782217029.136633:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:24a87249-c61f-41a1-85ec-9a313129e739+7:2404:x1868789693072512:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 Request processed in 252us (415us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1782217029.136641:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 39 00000100:00100000:0.0:1782217029.145937:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217029.146048:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693072768 00000100:00100000:3.0:1782217029.146058:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693072768 00000100:00100000:3.0:1782217029.146117:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 92 00000100:00100000:3.0:1782217029.146127:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72e8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+15:11297:x1868789693072768:12345-192.168.203.30@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1782217029.146203:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f99d4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217029.146221:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5f9995 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973468 expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217029.146231:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f99d4 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217029.146264:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5f9995 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973468 expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217029.146278:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5f9995 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973468 expref: 15 pid: 6518 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217029.146306:0:6520:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c794380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1868789713074816:192.168.203.30@tcp:104: 00000100:00100000:3.0:1782217029.146386:0:6520:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d426cc240 going to sleep for 11 seconds 00000100:00100000:2.0:1782217029.151040:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217029.151079:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693072896 00000100:00100000:2.0:1782217029.151087:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693072896 00010000:00010000:2.0:1782217029.151126:0:8449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5f9995 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973468 expref: 16 pid: 6518 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217029.151163:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 60 00000100:00100000:2.0:1782217029.151172:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4379bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:24a87249-c61f-41a1-85ec-9a313129e739+16:2402:x1868789693072896:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782217029.152913:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217029.152934:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5f9995 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973468 expref: 16 pid: 6518 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217029.152953:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5f9995 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973468 expref: 16 pid: 6518 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217029.152990:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff952e6105c800) 00010000:00010000:2.0:1782217029.152996:0:8449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f99d4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217029.153005:0:8449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f99d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217029.153012:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f99d4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217029.153031:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217029.153092:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4379bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:24a87249-c61f-41a1-85ec-9a313129e739+16:2402:x1868789693072896:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 1920us (2060us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217029.153103:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 60 00010000:00010000:3.0:1782217029.154060:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5f9995 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973468 expref: 15 pid: 6518 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217029.154078:0:6520:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c794380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1868789713074816:192.168.203.30@tcp:104: 00010000:00010000:3.0:1782217029.154098:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f99d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217029.154107:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f99d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217029.154113:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f99d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217029.154152:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f99d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217029.154161:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f99d4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217029.154168:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f99d4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217029.154174:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362e00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217029.155072:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f99d4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217029.155098:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f99d4 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217029.155115:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff952e6105c800) 00010000:00010000:3.0:1782217029.155118:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1782217029.155122:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f99d4 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217029.155128:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f99d4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217029.155219:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72e8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+14:11297:x1868789693072768:12345-192.168.203.30@tcp:55:lhsmtool_posix.0 Request processed in 9081us (9282us total) trans 0 rc -22/-22 00000100:00100000:3.0:1782217029.155229:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 92 00000100:00100000:0.0:1782217029.172789:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217029.173205:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693073024 00000100:00100000:2.0:1782217029.173215:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693073024 00000100:00100000:2.0:1782217029.173268:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 40 00000100:00100000:2.0:1782217029.173279:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c695c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24a87249-c61f-41a1-85ec-9a313129e739+7:2402:x1868789693073024:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1782217029.173336:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000052671b85/0x92b8e04cbf5f99db lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217029.173355:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000091802ae6/0x92b8e04cbf5f99c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973484 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217029.173365:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782217029.173369:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782217029.173373:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052671b85/0x92b8e04cbf5f99db lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217029.173416:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000091802ae6/0x92b8e04cbf5f99c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973484 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217029.173430:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000091802ae6/0x92b8e04cbf5f99c6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973484 expref: 7 pid: 8432 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217029.173444:0:8432:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41bf9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8432:1868789713074944:192.168.203.30@tcp:104: 00000100:00100000:2.0:1782217029.173527:0:8432:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e7c722b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782217029.177772:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c794380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713075072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782217029.177850:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217029.178000:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713075072 00000100:00100000:3.0:1782217029.178008:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713075072 00000100:00100000:3.0:1782217029.178062:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1782217029.178072:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1868789713075072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782217029.178099:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782217029.178144:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1868789713075072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217029.178151:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1782217029.178194:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c794380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713075072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782217029.178846:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782217029.178860:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713075200:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782217029.178914:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217029.178947:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713075200 00000100:00100000:0.0:1782217029.178952:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713075200 00000100:00100000:0.0:1782217029.179005:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1782217029.179011:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42610a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713075200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782217029.179026:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782217029.179059:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42610a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713075200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217029.179066:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:0.0:1782217029.179082:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782217029.179108:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713075200:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782217029.179205:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789713075328:0@lo:400:kworker.0 00000100:00100000:0.0:1782217029.179234:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217029.179259:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43695c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713075840:0@lo:400:kworker.0 00000100:00100000:0.0:1782217029.179282:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217029.179298:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4330d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1868789713076352:0@lo:400:kworker.0 00000100:00100000:0.0:1782217029.179650:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217029.179674:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1782217029.179680:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42611880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1868789713075456:0@lo:400:kworker.0 00000100:00100000:0.0:1782217029.179703:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217029.179721:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c671180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1868789713075968:0@lo:400:kworker.0 00000100:00100000:0.0:1782217029.179741:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217029.179772:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4330d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1868789713076480:0@lo:400:kworker.0 00000100:00100000:0.0:1782217029.179796:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217029.179841:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713075328 00000100:00100000:0.0:1782217029.179845:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713075328 00000100:00100000:0.0:1782217029.179877:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1782217029.179939:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e582c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3649:x1868789713075328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217029.179996:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e582c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3649:x1868789713075328:12345-0@lo:400:kworker.0 Request processed in 112us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217029.180003:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1782217029.180030:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713075840 00000100:00100000:0.0:1782217029.180034:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713075840 00000100:00100000:0.0:1782217029.180056:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1782217029.180062:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4330f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713075840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217029.180091:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4330f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713075840:12345-0@lo:400:kworker.0 Request processed in 29us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217029.180097:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1782217029.180117:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713075584:0@lo:400:kworker.0 00000100:00100000:0.0:1782217029.180141:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217029.180159:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c673800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1868789713076096:0@lo:400:kworker.0 00000100:00100000:0.0:1782217029.180181:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217029.180193:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782217029.180199:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43694380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1868789713075712:0@lo:400:kworker.0 00000100:00100000:0.0:1782217029.180219:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217029.180230:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43c4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713076224:0@lo:400:kworker.0 00000100:00100000:0.0:1782217029.180247:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217029.180273:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713076352 00000100:00100000:0.0:1782217029.180283:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713076352 00000100:00100000:0.0:1782217029.180310:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713075456 00000100:00100000:0.0:1782217029.180552:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713075456 00000100:00100000:0.0:1782217029.180574:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713075968 00000100:00100000:0.0:1782217029.180577:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713075968 00000100:00100000:0.0:1782217029.180618:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713076480 00000100:00100000:0.0:1782217029.180621:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713076480 00000100:00100000:0.0:1782217029.180633:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713076096 00000100:00100000:0.0:1782217029.180635:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713076096 00000100:00100000:0.0:1782217029.180646:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713075712 00000100:00100000:0.0:1782217029.180649:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713075712 00000100:00100000:0.0:1782217029.180662:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1782217029.180669:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4330dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1868789713076352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217029.180703:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4330dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1868789713076352:12345-0@lo:400:kworker.0 Request processed in 35us (1053us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217029.180709:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1782217029.180723:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1782217029.180729:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43315f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1868789713075456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217029.180756:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43315f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1868789713075456:12345-0@lo:400:kworker.0 Request processed in 26us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217029.180761:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1782217029.180772:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1782217029.180778:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43316d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1868789713075968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217029.180804:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43316d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1868789713075968:12345-0@lo:400:kworker.0 Request processed in 26us (1062us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217029.180819:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1782217029.180831:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1782217029.180837:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43310a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1868789713076480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217029.180873:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43310a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1868789713076480:12345-0@lo:400:kworker.0 Request processed in 37us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217029.180879:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1782217029.181070:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c794380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713076608:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782217029.181102:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217029.181139:0:10535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713076608 00000100:00100000:3.0:1782217029.181144:0:10535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713076608 00000100:00100000:3.0:1782217029.181182:0:10535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1782217029.181188:0:10535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c796680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713076608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782217029.181205:0:10535:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:3.0:1782217029.181236:0:10535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c796680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713076608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217029.181242:0:10535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1782217029.181280:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c794380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713076608:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782217029.181469:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1782217029.181480:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52f7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1868789713076096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217029.181525:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52f7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1868789713076096:12345-0@lo:400:kworker.0 Request processed in 49us (1343us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217029.181532:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1782217029.181568:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1782217029.181577:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4268f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1868789713075712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217029.181650:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4268f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1868789713075712:12345-0@lo:400:kworker.0 Request processed in 74us (1429us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217029.181657:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1782217029.181682:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713075584 00000100:00100000:1.0:1782217029.181686:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713075584 00000100:00100000:1.0:1782217029.181721:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1782217029.181725:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42611880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1868789713075456:0@lo:400:kworker.0 00000100:00100000:1.0:1782217029.181733:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52f7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713075584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217029.181743:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c671180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1868789713075968:0@lo:400:kworker.0 00010000:00080000:3.0:1782217029.181758:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4330d180 x1868789713076480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217045 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217029.181771:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4330d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1868789713076480:0@lo:400:kworker.0 00000100:00100000:1.0:1782217029.181773:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52f7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713075584:12345-0@lo:400:kworker.0 Request processed in 42us (1628us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217029.181784:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1782217029.181791:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789713075328:0@lo:400:kworker.0 00000100:00100000:3.0:1782217029.181807:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43695c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713075840:0@lo:400:kworker.0 00000100:00100000:1.0:1782217029.181829:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43694380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1868789713075712:0@lo:400:kworker.0 00000100:00100000:3.0:1782217029.181835:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4330d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1868789713076352:0@lo:400:kworker.0 00000100:00100000:1.0:1782217029.181850:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713075584:0@lo:400:kworker.0 00010000:00080000:1.0:1782217029.181865:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7c673800 x1868789713076096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217045 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782217029.181875:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c673800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1868789713076096:0@lo:400:kworker.0 00000100:00080000:0.0:1782217029.182401:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782217029.182407:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782217029.182409:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782217029.182423:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713076224 00000100:00100000:0.0:1782217029.182427:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713076224 00000100:00100000:0.0:1782217029.182459:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1782217029.182466:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4268e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713076224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217029.182681:0:8432:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41bf9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8432:1868789713074944:192.168.203.30@tcp:104: 00010000:00010000:1.0:1782217029.182702:0:8432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000052671b85/0x92b8e04cbf5f99db lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217029.183175:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4268e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713076224:12345-0@lo:400:kworker.0 Request processed in 708us (2925us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217029.183183:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1782217029.183219:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43c4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713076224:0@lo:400:kworker.0 00000100:00100000:1.0:1782217029.183626:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41bf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713076736:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782217029.183667:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217029.183953:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713076736 00000100:00100000:2.0:1782217029.183959:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713076736 00000100:00100000:2.0:1782217029.184188:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1782217029.184197:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43605180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713076736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782217029.184217:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:2.0:1782217029.184256:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43605180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713076736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217029.184262:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1782217029.184458:0:3648:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1782217029.184464:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff952d4263fb80, transno 4294967304 00000100:00100000:1.0:1782217029.184486:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41bf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713076736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782217029.186787:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217029.187300:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693073152 00000100:00100000:3.0:1782217029.187310:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693073152 00010000:00010000:3.0:1782217029.187358:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000091802ae6/0x92b8e04cbf5f99c6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973484 expref: 8 pid: 8432 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217029.187398:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 61 00000100:00100000:3.0:1782217029.187406:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4268f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24a87249-c61f-41a1-85ec-9a313129e739+8:2403:x1868789693073152:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782217029.187420:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217029.187449:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000091802ae6/0x92b8e04cbf5f99c6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973484 expref: 8 pid: 8432 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217029.187463:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000091802ae6/0x92b8e04cbf5f99c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973484 expref: 8 pid: 8432 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217029.187485:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091802ae6/0x92b8e04cbf5f99c6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973484 expref: 8 pid: 8432 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217029.187669:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782217029.187673:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782217029.187680:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000052671b85/0x92b8e04cbf5f99db lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217029.187690:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052671b85/0x92b8e04cbf5f99db lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217029.187722:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217029.187770:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4268f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24a87249-c61f-41a1-85ec-9a313129e739+7:2403:x1868789693073152:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 363us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217029.187777:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 61 00010000:00010000:0.0:1782217029.187839:0:8432:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000052671b85/0x92b8e04cbf5f99db lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217029.187867:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052671b85/0x92b8e04cbf5f99db lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217029.187887:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000052671b85/0x92b8e04cbf5f99db lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217029.187902:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052671b85/0x92b8e04cbf5f99db lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217029.187923:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052671b85/0x92b8e04cbf5f99db lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217029.187930:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2c200 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:0.0:1782217029.187934:0:8432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052671b85/0x92b8e04cbf5f99db lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217029.187942:0:8432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052671b85/0x92b8e04cbf5f99db lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217029.187954:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052671b85/0x92b8e04cbf5f99db lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217029.187961:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052671b85/0x92b8e04cbf5f99db lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217029.188013:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c695c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24a87249-c61f-41a1-85ec-9a313129e739+6:2402:x1868789693073024:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 Request processed in 14736us (15233us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217029.188020:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 40 00000100:00100000:3.0:1782217029.196859:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217029.196949:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693073408 00000100:00100000:1.0:1782217029.196958:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693073408 00000100:00100000:1.0:1782217029.197032:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 93 00000100:00100000:1.0:1782217029.197043:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c794380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+14:11297:x1868789693073408:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1782217029.197121:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f99e2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.197137:0:6548:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5f9822 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97340d expref: 14 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.197147:0:6548:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f99e2 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.197179:0:6548:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5f9822 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97340d expref: 14 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.197192:0:6548:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5f9822 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97340d expref: 14 pid: 6548 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217029.197206:0:6548:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6548:1868789713076864:192.168.203.30@tcp:104: 00000100:00100000:1.0:1782217029.197276:0:6548:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e529a2480 going to sleep for 11 seconds 00000100:00100000:2.0:1782217029.201472:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217029.201578:0:6548:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6548:1868789713076864:192.168.203.30@tcp:104: 00010000:00010000:1.0:1782217029.201640:0:6548:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f99e2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217029.202009:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693073536 00000100:00100000:0.0:1782217029.202016:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693073536 00010000:00010000:0.0:1782217029.202054:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5f9822 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97340d expref: 15 pid: 6548 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217029.202088:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 62 00000100:00100000:0.0:1782217029.202110:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e6f92f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24a87249-c61f-41a1-85ec-9a313129e739+15:2403:x1868789693073536:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782217029.202126:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217029.202133:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5f9822 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97340d expref: 15 pid: 6548 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217029.202145:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5f9822 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97340d expref: 15 pid: 6548 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217029.202164:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5f9822 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97340d expref: 15 pid: 6548 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217029.202178:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e46d74000) 00010000:00010000:0.0:1782217029.202183:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f99e2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217029.202192:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f99e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217029.202201:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f99e2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217029.202427:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217029.202483:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e6f92f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24a87249-c61f-41a1-85ec-9a313129e739+14:2403:x1868789693073536:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 373us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217029.202498:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 62 00010000:00010000:3.0:1782217029.203185:0:6548:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f99e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217029.203196:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f99e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217029.203394:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f99e9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217029.203415:0:6548:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f99a3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97346f expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217029.203424:0:6548:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f99e9 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217029.203455:0:6548:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f99a3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97346f expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217029.203469:0:6548:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f99a3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97346f expref: 14 pid: 6518 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217029.203484:0:6548:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c797800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6548:1868789713076992:192.168.203.30@tcp:104: 00000100:00100000:2.0:1782217029.204437:0:6548:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d426cc300 going to sleep for 11 seconds 00000100:00100000:2.0:1782217029.210574:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217029.210796:0:6548:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c797800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6548:1868789713076992:192.168.203.30@tcp:104: 00010000:00010000:1.0:1782217029.210831:0:6548:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f99e9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217029.211169:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693073664 00000100:00100000:3.0:1782217029.211177:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693073664 00010000:00010000:3.0:1782217029.211211:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f99a3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97346f expref: 15 pid: 6518 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217029.211256:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 63 00000100:00100000:3.0:1782217029.211265:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24a87249-c61f-41a1-85ec-9a313129e739+15:2403:x1868789693073664:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782217029.211279:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217029.211286:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f99a3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97346f expref: 15 pid: 6518 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217029.211298:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f99a3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97346f expref: 15 pid: 6518 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217029.212435:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f99a3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97346f expref: 15 pid: 6518 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217029.212457:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff952e6105c800) 00010000:00010000:3.0:1782217029.212463:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f99e9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217029.212474:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f99e9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217029.212483:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f99e9 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217029.212696:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217029.212756:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24a87249-c61f-41a1-85ec-9a313129e739+14:2403:x1868789693073664:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 1490us (2188us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217029.212766:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 63 00010000:00010000:1.0:1782217029.212895:0:6548:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f99e9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.212906:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f99e9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782217029.213148:0:6548:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:1.0:1782217029.213265:0:6548:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000001:00080000:1.0:1782217029.213300:0:6548:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:1.0:1782217029.213391:0:6548:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6548:1868789713077120:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1782217029.213454:0:6548:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217029.213486:0:6548:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e460e8600 going to sleep for 11 seconds 00000100:00100000:0.0:1782217029.213664:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713077120 00000100:00100000:0.0:1782217029.213671:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713077120 00000100:00100000:0.0:1782217029.213708:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1782217029.213717:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4368f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6548:x1868789713077120:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1782217029.213824:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4368f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6548:x1868789713077120:12345-0@lo:1000:mdt00_003.0 Request processed in 108us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217029.213832:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1782217029.213948:0:6548:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6548:1868789713077120:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1782217029.214219:0:6548:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967362 00000100:00100000:2.0:1782217029.214273:0:6548:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6548:1868789713077248:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1782217029.214305:0:6548:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217029.214328:0:6548:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e7c722b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782217029.214458:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713077248 00000100:00100000:0.0:1782217029.214463:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713077248 00000100:00100000:0.0:1782217029.214574:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1782217029.214616:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4263e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6548:x1868789713077248:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1782217029.214728:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4263e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6548:x1868789713077248:12345-0@lo:1000:mdt00_003.0 Request processed in 145us (420us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1782217029.214735:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1782217029.214874:0:6548:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6548:1868789713077248:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1782217029.214908:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f99e9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.214917:0:6548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f99e9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.214925:0:6548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f99e9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.214931:0:6548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362e00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217029.214935:0:6548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f99e9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.214943:0:6548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f99e9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.214956:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff952e6105c800) 00010000:00010000:1.0:1782217029.215666:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782217029.215675:0:6548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f99e9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.215683:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f99e9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.215717:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9917 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.215724:0:6548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9917 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.215730:0:6548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9917 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.215735:0:6548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2d800 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217029.215738:0:6548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9917 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.215744:0:6548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9917 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.215754:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e46d74000) 00010000:00010000:1.0:1782217029.215757:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782217029.215760:0:6548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9917 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.215766:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9917 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.215795:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f99f0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.215833:0:6548:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9933 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973453 expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.215843:0:6548:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f99f0 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.215876:0:6548:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9933 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973453 expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.215890:0:6548:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9933 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973453 expref: 17 pid: 6520 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217029.215902:0:6548:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4368d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6548:1868789713077376:192.168.203.30@tcp:104: 00000100:00100000:1.0:1782217029.217115:0:6548:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e460e83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782217029.219835:0:6548:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4368d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6548:1868789713077376:192.168.203.30@tcp:104: 00010000:00010000:1.0:1782217029.219864:0:6548:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f99f0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217029.220570:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217029.220877:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693073792 00000100:00100000:0.0:1782217029.220886:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693073792 00010000:00010000:0.0:1782217029.220926:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9933 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973453 expref: 18 pid: 6520 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217029.220965:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 64 00000100:00100000:0.0:1782217029.221253:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c795500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24a87249-c61f-41a1-85ec-9a313129e739+18:2403:x1868789693073792:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782217029.221270:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217029.221278:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9933 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973453 expref: 18 pid: 6520 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217029.221292:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9933 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973453 expref: 18 pid: 6520 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217029.221322:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9933 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973453 expref: 18 pid: 6520 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217029.221359:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e46d74000) 00010000:00010000:0.0:1782217029.221365:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f99f0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217029.221374:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f99f0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217029.221382:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f99f0 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217029.221409:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217029.221457:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c795500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24a87249-c61f-41a1-85ec-9a313129e739+17:2403:x1868789693073792:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 208us (890us total) trans 0 rc 0/0 00010000:00010000:1.0:1782217029.221500:0:6548:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f99f0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.221508:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f99f0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.221520:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f99f0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.221526:0:6548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f99f0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.221538:0:6548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f99f0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.221544:0:6548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43072e00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217029.221549:0:6548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f99f0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.221556:0:6548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f99f0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.221565:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e46d74000) 00010000:00010000:1.0:1782217029.221568:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217029.221572:0:6548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f99f0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.221578:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f99f0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.221610:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f99e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.221616:0:6548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f99e2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.221622:0:6548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f99e2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.221627:0:6548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43073400 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217029.221630:0:6548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f99e2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.221644:0:6548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f99e2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.221652:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e46d74000) 00010000:00010000:1.0:1782217029.221654:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782217029.221657:0:6548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f99e2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.221663:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f99e2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782217029.221838:0:13796:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782217029.221843:0:13796:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782217029.221856:0:13796:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1782217029.221860:0:13796:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1782217029.221933:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c794380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+17:11297:x1868789693073408:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 24891us (25083us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1782217029.221942:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 93 00000020:00080000:1.0:1782217029.221946:0:6548:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1782217029.223135:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 64 00000100:00100000:2.0:1782217029.224792:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217029.224904:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693074048 00000100:00100000:0.0:1782217029.224913:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693074048 00000100:00100000:0.0:1782217029.225135:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00100000:0.0:1782217029.225150:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4263fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24a87249-c61f-41a1-85ec-9a313129e739+16:11297:x1868789693074048:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1782217029.225422:0:6522:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1782217029.225456:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967364 00010000:00010000:0.0:1782217029.225500:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d800/0x92b8e04cbf5f99f7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217029.225516:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d800/0x92b8e04cbf5f99f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217029.225528:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d800/0x92b8e04cbf5f99f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217029.225557:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d800/0x92b8e04cbf5f99f7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217029.225563:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d800/0x92b8e04cbf5f99f7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217029.225569:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d800/0x92b8e04cbf5f99f7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217029.225630:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782217029.225715:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4263fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24a87249-c61f-41a1-85ec-9a313129e739+18:11297:x1868789693074048:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 568us (929us total) trans 4294967365 rc 0/0 00010000:00010000:1.0:1782217029.225894:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782217029.225901:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d800/0x92b8e04cbf5f99f7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.225908:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121d800 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:1.0:1782217029.225912:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d800/0x92b8e04cbf5f99f7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.225920:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d800/0x92b8e04cbf5f99f7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.225943:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff952e6105c800) 00010000:00010000:1.0:1782217029.225947:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782217029.225952:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d800/0x92b8e04cbf5f99f7 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.225958:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d800/0x92b8e04cbf5f99f7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217029.225983:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217029.225985:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217029.225987:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782217029.226431:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 20 00000020:00080000:0.0:1782217029.226439:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1782217029.688948:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782217029.688980:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c797100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713077504:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782217029.689048:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217029.689174:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713077504 00000100:00100000:2.0:1782217029.689182:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713077504 00000100:00100000:2.0:1782217029.689235:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1782217029.689245:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4368d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713077504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782217029.689279:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1782217029.689327:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4368d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713077504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217029.689335:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1782217029.689526:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c797100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713077504:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1782217030.137226:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782217030.714484:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713077632:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782217030.714617:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217030.714661:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713077632 00000100:00100000:2.0:1782217030.714673:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713077632 00000100:00100000:2.0:1782217030.714739:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1782217030.714750:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713077632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782217030.714797:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1782217030.716847:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713077632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2085us (2249us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217030.716865:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1782217030.719058:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713077632:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1782217031.022158:0:14259:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782217031.022168:0:14259:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782217031.022196:0:14259:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1782217031.022204:0:14259:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1782217031.165980:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782217031.218996:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217031.227738:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693074304 00000100:00100000:0.0:1782217031.227755:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693074304 00000100:00100000:1.0:1782217031.227921:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 94 00000100:00100000:1.0:1782217031.227935:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+18:11316:x1868789693074304:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1782217031.227960:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217031.227980:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5f99fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be97348b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.228091:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073c00/0x92b8e04cbf5f9a05 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.228105:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073c00/0x92b8e04cbf5f9a05 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.228117:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073c00/0x92b8e04cbf5f9a05 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782217031.228147:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1782217031.228245:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5f99fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97348b expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.228265:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073c00/0x92b8e04cbf5f9a05 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97348b expref: 20 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.228273:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff952e6105ce00) 00010000:00010000:1.0:1782217031.228276:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782217031.228279:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43073c00, rc 0) 00000100:00100000:1.0:1782217031.228339:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+20:11316:x1868789693074304:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 409us (9352us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1782217031.228347:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 94 00000100:00080000:0.0:1782217031.229225:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782217031.235344:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217031.235443:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693074432 00000100:00100000:0.0:1782217031.235452:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693074432 00000100:00100000:0.0:1782217031.235517:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 95 00000100:00100000:0.0:1782217031.235527:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+20:11316:x1868789693074432:12345-192.168.203.30@tcp:34:lfs.0 00010000:00010000:0.0:1782217031.235645:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c400/0x92b8e04cbf5f9a13 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.235664:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c400/0x92b8e04cbf5f9a13 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.235676:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c400/0x92b8e04cbf5f9a13 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.235721:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121cc00/0x92b8e04cbf5f9a1a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.235729:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121cc00/0x92b8e04cbf5f9a1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.235736:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121cc00/0x92b8e04cbf5f9a1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.235822:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9a21 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.235830:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9a21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.235837:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9a21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782217031.235890:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9a21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.235902:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c400/0x92b8e04cbf5f9a13 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.235908:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c400/0x92b8e04cbf5f9a13 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.235915:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c400/0x92b8e04cbf5f9a13 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.235921:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121c400 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782217031.235924:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c400/0x92b8e04cbf5f9a13 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.235939:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c400/0x92b8e04cbf5f9a13 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.235951:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff952e6105ce00) 00010000:00010000:0.0:1782217031.235954:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217031.235959:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c400/0x92b8e04cbf5f9a13 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.235965:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c400/0x92b8e04cbf5f9a13 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.235978:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121cc00/0x92b8e04cbf5f9a1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.235984:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121cc00/0x92b8e04cbf5f9a1a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.235990:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121cc00/0x92b8e04cbf5f9a1a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.235994:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121cc00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782217031.235997:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121cc00/0x92b8e04cbf5f9a1a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.236003:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121cc00/0x92b8e04cbf5f9a1a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.236009:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff952d426a0800) 00010000:00010000:0.0:1782217031.236012:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217031.236015:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121cc00/0x92b8e04cbf5f9a1a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.236030:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121cc00/0x92b8e04cbf5f9a1a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.236044:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9a21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.236051:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9a21 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.236057:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9a21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.236062:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121c600 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782217031.236065:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9a21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.236071:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9a21 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.236079:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952d426a0900) 00010000:00010000:0.0:1782217031.236081:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217031.236084:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9a21 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.236089:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9a21 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217031.236151:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+20:11316:x1868789693074432:12345-192.168.203.30@tcp:34:lfs.0 Request processed in 625us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217031.236159:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 95 00000100:00100000:2.0:1782217031.309269:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217031.312411:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693074688 00000100:00100000:1.0:1782217031.312426:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693074688 00000100:00100000:1.0:1782217031.312866:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 96 00000100:00100000:1.0:1782217031.312878:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+20:11319:x1868789693074688:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1782217031.312898:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217031.312918:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5f9a28 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973492 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.312986:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9a2f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.313000:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9a2f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.313028:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9a2f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.313043:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9a36 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.313051:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9a36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.313057:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9a36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.313158:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072400/0x92b8e04cbf5f9a3d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.313171:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072400/0x92b8e04cbf5f9a3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.313177:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072400/0x92b8e04cbf5f9a3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782217031.313188:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1782217031.313253:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9a2f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.313260:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9a2f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.313266:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9a2f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.313271:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43073a00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217031.313287:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9a2f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.313296:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9a2f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.313308:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff952e6105ce00) 00010000:00010000:1.0:1782217031.313310:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217031.313314:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9a2f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.313320:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9a2f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.313334:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9a36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.313341:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9a36 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.313348:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9a36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.313353:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43072600 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217031.313355:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9a36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.313361:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9a36 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.313368:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff952e6105c400) 00010000:00010000:1.0:1782217031.313370:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217031.313378:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9a36 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.313384:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9a36 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.313423:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5f9a28 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973492 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.313435:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072400/0x92b8e04cbf5f9a3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973492 expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.313441:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e6105c700) 00010000:00010000:1.0:1782217031.313443:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782217031.313445:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43072400, rc 0) 00000100:00100000:1.0:1782217031.314732:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+22:11319:x1868789693074688:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 1849us (5465us total) trans 4294967367 rc 0/0 00000100:00100000:1.0:1782217031.314744:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 96 00000100:00100000:3.0:1782217031.319698:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217031.319897:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693074816 00000100:00100000:0.0:1782217031.319906:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693074816 00000100:00100000:0.0:1782217031.319958:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 97 00000100:00100000:0.0:1782217031.319968:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c794700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+22:11319:x1868789693074816:12345-192.168.203.30@tcp:54:lfs.0 00010000:00010000:0.0:1782217031.320031:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9a4b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.320045:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9a4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.320056:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9a4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.320090:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9a4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.320097:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9a4b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.320104:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9a4b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.320110:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121c600 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782217031.320113:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9a4b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.320120:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9a4b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.320130:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e6105c700) 00010000:00010000:0.0:1782217031.320133:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782217031.320138:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9a4b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.320158:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9a4b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217031.320223:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c794700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+22:11319:x1868789693074816:12345-192.168.203.30@tcp:54:lfs.0 Request processed in 256us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217031.320230:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 97 00000100:00100000:3.0:1782217031.322963:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217031.323241:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693075072 00000100:00100000:2.0:1782217031.323252:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693075072 00000100:00100000:2.0:1782217031.323314:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:2.0:1782217031.323331:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e64f09c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+22:11319:x1868789693075072:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:2.0:1782217031.323863:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e64f09c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+23:11319:x1868789693075072:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 532us (906us total) trans 4294967368 rc 0/0 00000100:00100000:2.0:1782217031.323882:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:2.0:1782217031.392654:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217031.392767:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693075328 00000100:00100000:0.0:1782217031.392779:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693075328 00000100:00100000:0.0:1782217031.392855:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 98 00000100:00100000:0.0:1782217031.392865:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+23:10837:x1868789693075328:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:0.0:1782217031.392900:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217031.392921:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9a52 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973499 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.393031:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121cc00/0x92b8e04cbf5f9a59 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.393047:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072400/0x92b8e04cbf5f9a3d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973492 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.393058:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121cc00/0x92b8e04cbf5f9a59 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.393090:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072400/0x92b8e04cbf5f9a3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973492 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.393103:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072400/0x92b8e04cbf5f9a3d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973492 expref: 24 pid: 6519 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217031.393137:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4268f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1868789713077760:192.168.203.30@tcp:104: 00000100:00100000:0.0:1782217031.393250:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e51f75480 going to sleep for 11 seconds 00000100:00100000:3.0:1782217031.401727:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217031.401862:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4268f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1868789713077760:192.168.203.30@tcp:104: 00010000:00010000:0.0:1782217031.401893:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121cc00/0x92b8e04cbf5f9a59 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217031.405927:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693075456 00000100:00100000:1.0:1782217031.405942:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693075456 00010000:00010000:1.0:1782217031.405991:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072400/0x92b8e04cbf5f9a3d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973492 expref: 25 pid: 6519 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217031.406049:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 65 00000100:00100000:1.0:1782217031.406060:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c796d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24a87249-c61f-41a1-85ec-9a313129e739+25:2403:x1868789693075456:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782217031.406075:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782217031.406082:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072400/0x92b8e04cbf5f9a3d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973492 expref: 25 pid: 6519 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.406114:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072400/0x92b8e04cbf5f9a3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973492 expref: 25 pid: 6519 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.406136:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072400/0x92b8e04cbf5f9a3d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973492 expref: 25 pid: 6519 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.406153:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e6105c700) 00010000:00010000:1.0:1782217031.406158:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121cc00/0x92b8e04cbf5f9a59 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.406167:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121cc00/0x92b8e04cbf5f9a59 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.406174:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121cc00/0x92b8e04cbf5f9a59 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.406449:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782217031.406523:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c796d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24a87249-c61f-41a1-85ec-9a313129e739+24:2403:x1868789693075456:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 463us (4802us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217031.406531:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 65 00010000:00010000:2.0:1782217031.406967:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121cc00/0x92b8e04cbf5f9a59 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.406977:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121cc00/0x92b8e04cbf5f9a59 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217031.406996:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1782217031.407118:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9a52 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973499 expref: 25 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.407135:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121cc00/0x92b8e04cbf5f9a59 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973499 expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.407142:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e6105c700) 00010000:00010000:2.0:1782217031.407145:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1782217031.407148:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e4121cc00, rc 0) 00000100:00100000:2.0:1782217031.407176:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+24:10837:x1868789693075328:12345-192.168.203.30@tcp:101:bash.0 Request processed in 14313us (14534us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1782217031.407184:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 98 00000100:00100000:3.0:1782217031.413195:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217031.421023:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693075584 00000100:00100000:0.0:1782217031.421037:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693075584 00000100:00100000:0.0:1782217031.421106:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 99 00000100:00100000:0.0:1782217031.421116:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+24:10837:x1868789693075584:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:0.0:1782217031.421138:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217031.421157:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c400/0x92b8e04cbf5f9a67 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9734a0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.421188:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c000/0x92b8e04cbf5f9a6e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.421201:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c000/0x92b8e04cbf5f9a6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.421213:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c000/0x92b8e04cbf5f9a6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.421320:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c400/0x92b8e04cbf5f9a67 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734a0 expref: 26 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.421339:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c000/0x92b8e04cbf5f9a6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734a0 expref: 25 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.421355:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e6105c700) 00010000:00010000:0.0:1782217031.421358:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782217031.421362:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e4121c000, rc 0) 00000100:00100000:0.0:1782217031.421437:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+25:10837:x1868789693075584:12345-192.168.203.30@tcp:101:bash.0 Request processed in 321us (8252us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217031.421444:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 99 00000100:00100000:2.0:1782217031.425265:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217031.425549:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693075840 00000100:00100000:1.0:1782217031.425558:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693075840 00000100:00100000:1.0:1782217031.425634:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 100 00000100:00100000:1.0:1782217031.425645:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+25:10837:x1868789693075840:12345-192.168.203.30@tcp:36:bash.0 00010000:00010000:1.0:1782217031.425877:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072400/0x92b8e04cbf5f9a75 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.425893:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072400/0x92b8e04cbf5f9a75 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.425916:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072400/0x92b8e04cbf5f9a75 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782217031.425956:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000004:00010000:1.0:1782217031.425977:0:6519:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000085ba7e63 reply state 00000000153ae1df transno 4294967371 ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072400/0x92b8e04cbf5f9a75 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.425989:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072400/0x92b8e04cbf5f9a75 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.425996:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e6105c700) 00010000:00010000:1.0:1782217031.425999:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782217031.426002:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1782217031.426037:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967371 00000100:00100000:1.0:1782217031.426120:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+29:10837:x1868789693075840:12345-192.168.203.30@tcp:36:bash.0 Request processed in 477us (865us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1782217031.426128:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 100 00000020:00080000:1.0:1782217031.426133:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1782217031.434065:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217031.434177:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693075968 00000100:00100000:3.0:1782217031.434187:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693075968 00000100:00100000:3.0:1782217031.434244:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 101 00000100:00100000:3.0:1782217031.434253:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4268f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+29:10837:x1868789693075968:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:3.0:1782217031.434281:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217031.434299:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5f9a7c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9734a7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217031.434349:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5f9a7c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734a7 expref: 30 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217031.434362:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5f9a7c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734a7 expref: 30 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217031.434379:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e6105c700) 00010000:00010000:3.0:1782217031.434383:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782217031.434394:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b363c00, rc 0) 00000100:00100000:3.0:1782217031.434448:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4268f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+30:10837:x1868789693075968:12345-192.168.203.30@tcp:101:bash.0 Request processed in 196us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217031.434455:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 101 00000100:00100000:2.0:1782217031.439776:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217031.439846:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693076096 00000100:00100000:0.0:1782217031.439857:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693076096 00000100:00100000:0.0:1782217031.439928:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 41 00000100:00100000:0.0:1782217031.439938:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:24a87249-c61f-41a1-85ec-9a313129e739+6:10837:x1868789693076096:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:0.0:1782217031.439955:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217031.439978:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000371c0003/0x92b8e04cbf5f9a83 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9734ae expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782217031.440002:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a3a7943, atime: 0x6a3a7942, ctime: 0x6a3a7943, blocks: 0x8 00010000:00010000:0.0:1782217031.440021:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=394s v=(0 0) 00010000:00010000:0.0:1782217031.440026:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217031.440034:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000371c0003/0x92b8e04cbf5f9a83 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734ae expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.440053:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000371c0003/0x92b8e04cbf5f9a83 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734ae expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.440066:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e4121c400, rc 0) 00000100:00100000:0.0:1782217031.440144:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:24a87249-c61f-41a1-85ec-9a313129e739+7:10837:x1868789693076096:12345-192.168.203.30@tcp:101:bash.0 Request processed in 207us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217031.440152:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 41 00000100:00080000:2.0:1782217031.440219:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782217031.442272:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217031.442421:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693076224 00000100:00100000:0.0:1782217031.442429:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693076224 00002000:00010000:0.0:1782217031.442474:0:8438:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:0.0:1782217031.442478:0:8438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff952d43df3480 with x1868789693076224 ext(0->18446744073709551615) 00002000:00010000:0.0:1782217031.442489:0:8438:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff952d43df3480. 00000100:00100000:3.0:1782217031.442653:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1 00000100:00100000:3.0:1782217031.442666:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:24a87249-c61f-41a1-85ec-9a313129e739+7:2403:x1868789693076224:12345-192.168.203.30@tcp:10:bash.0 00002000:00010000:3.0:1782217031.442909:0:8439:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1782217031.442914:0:8439:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1782217027 -> 1782217031 00002000:00010000:3.0:1782217031.442916:0:8439:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1782217026 -> 1782217026 00002000:00010000:3.0:1782217031.442924:0:8439:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1782217027 -> 1782217031 00002000:00010000:3.0:1782217031.442927:0:8439:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1782217031.442983:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:24a87249-c61f-41a1-85ec-9a313129e739+8:2403:x1868789693076224:12345-192.168.203.30@tcp:10:bash.0 Request processed in 319us (719us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1782217031.442991:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1 00002000:00010000:3.0:1782217031.442995:0:8439:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:3.0:1782217031.442998:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff952d43df3480 with x1868789693076224 ext(0->18446744073709551615) 00002000:00010000:3.0:1782217031.443003:0:8439:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff952d43df3480. 00000100:00100000:1.0:1782217031.573365:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217031.573440:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693076352 00000100:00100000:2.0:1782217031.573454:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693076352 00000100:00100000:2.0:1782217031.573530:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 102 00000100:00100000:2.0:1782217031.573540:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4368ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+30:11333:x1868789693076352:12345-192.168.203.30@tcp:34:lfs.0 00010000:00010000:2.0:1782217031.573650:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f9a8a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.573667:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f9a8a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.573679:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f9a8a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.573694:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9a91 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.573700:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9a91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.573706:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9a91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.573771:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9a98 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.573780:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9a98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.573787:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9a98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782217031.573839:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9a98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.573865:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f9a8a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.573871:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f9a8a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.573878:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f9a8a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.573884:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2c600 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782217031.573888:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f9a8a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.573895:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f9a8a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.573908:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff952e6105ce00) 00010000:00010000:2.0:1782217031.573911:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217031.573915:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f9a8a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.573922:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f9a8a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.573934:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9a91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.573940:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9a91 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.573946:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9a91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.573957:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2c400 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782217031.573960:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9a91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.573966:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9a91 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.573973:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff952d410ab400) 00010000:00010000:2.0:1782217031.573975:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217031.573977:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9a91 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.573983:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9a91 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.573996:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9a98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.574001:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9a98 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.574007:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9a98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.574012:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2d000 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782217031.574015:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9a98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.574020:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9a98 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.574034:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e6105c700) 00010000:00010000:2.0:1782217031.574036:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217031.574039:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9a98 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.574045:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9a98 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217031.574236:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4368ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+30:11333:x1868789693076352:12345-192.168.203.30@tcp:34:lfs.0 Request processed in 696us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217031.574244:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 102 00000100:00100000:2.0:1782217031.636098:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217031.636251:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693076608 00000100:00100000:3.0:1782217031.636270:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693076608 00000100:00100000:3.0:1782217031.636369:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 103 00000100:00100000:3.0:1782217031.636382:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+30:11336:x1868789693076608:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1782217031.636663:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217031.636694:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5f9a9f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9734b5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217031.636814:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5f9aa6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217031.636831:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5f9aa6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217031.636845:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5f9aa6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217031.637476:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f9aad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217031.637654:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f9aad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217031.637688:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f9aad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217031.637876:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5f9ab4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217031.637886:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5f9ab4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217031.637894:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5f9ab4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217031.637906:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1782217031.638233:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5f9aa6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217031.638242:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5f9aa6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217031.638249:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5f9aa6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217031.638257:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362c00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217031.638262:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5f9aa6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217031.638271:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5f9aa6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217031.638287:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff952e6105ce00) 00010000:00010000:3.0:1782217031.638291:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217031.638303:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5f9aa6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217031.638310:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5f9aa6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217031.638328:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f9aad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217031.638334:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f9aad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217031.638340:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f9aad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217031.638345:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362e00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217031.638348:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f9aad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217031.638354:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f9aad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217031.638363:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff952e5a063d00) 00010000:00010000:3.0:1782217031.638365:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217031.638368:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f9aad lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217031.638375:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f9aad lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217031.638430:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5f9a9f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734b5 expref: 33 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217031.638459:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5f9ab4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734b5 expref: 32 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217031.638468:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e6105c700) 00010000:00010000:3.0:1782217031.638471:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1782217031.638473:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b363a00, rc 0) 00000100:00100000:3.0:1782217031.639144:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+32:11336:x1868789693076608:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 2762us (3050us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1782217031.639156:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 103 00000100:00100000:3.0:1782217031.648396:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217031.648522:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693076736 00000100:00100000:1.0:1782217031.648535:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693076736 00000100:00100000:1.0:1782217031.648649:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 104 00000100:00100000:1.0:1782217031.648661:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+32:11336:x1868789693076736:12345-192.168.203.30@tcp:54:lfs.0 00010000:00010000:1.0:1782217031.648757:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9ac2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.648779:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121cc00/0x92b8e04cbf5f9a59 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973499 expref: 32 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.648825:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9ac2 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.648888:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121cc00/0x92b8e04cbf5f9a59 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973499 expref: 32 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.648904:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121cc00/0x92b8e04cbf5f9a59 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973499 expref: 32 pid: 6518 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217031.648923:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4368c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1868789713077888:192.168.203.30@tcp:104: 00000100:00100000:1.0:1782217031.649044:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d437876c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782217031.656453:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217031.656758:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4368c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1868789713077888:192.168.203.30@tcp:104: 00010000:00010000:1.0:1782217031.656790:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9ac2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217031.657210:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693076992 00000100:00100000:0.0:1782217031.657221:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693076992 00000100:00100000:0.0:1782217031.657356:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 22 00000100:00100000:0.0:1782217031.657368:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c797800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24a87249-c61f-41a1-85ec-9a313129e739+33:6170:x1868789693076992:12345-192.168.203.30@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1782217031.663648:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c797800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24a87249-c61f-41a1-85ec-9a313129e739+34:6170:x1868789693076992:12345-192.168.203.30@tcp:35:ldlm_bl.0 Request processed in 6263us (7190us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1782217031.663668:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 22 00000100:00100000:0.0:1782217031.670377:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217031.670531:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693077120 00000100:00100000:2.0:1782217031.670544:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693077120 00010000:00010000:2.0:1782217031.670685:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121cc00/0x92b8e04cbf5f9a59 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973499 expref: 34 pid: 6518 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217031.670761:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 66 00000100:00100000:2.0:1782217031.670771:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4268c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24a87249-c61f-41a1-85ec-9a313129e739+34:2402:x1868789693077120:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782217031.670790:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217031.670807:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121cc00/0x92b8e04cbf5f9a59 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973499 expref: 34 pid: 6518 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.670822:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121cc00/0x92b8e04cbf5f9a59 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973499 expref: 34 pid: 6518 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.670849:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121cc00/0x92b8e04cbf5f9a59 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973499 expref: 34 pid: 6518 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.670977:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e6105c700) 00010000:00010000:2.0:1782217031.670983:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9ac2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.670996:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.671005:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9ac2 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.671043:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217031.672952:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4268c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24a87249-c61f-41a1-85ec-9a313129e739+33:2402:x1868789693077120:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 2164us (2572us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217031.672971:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 66 00010000:00010000:1.0:1782217031.673096:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.673109:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.673170:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.673178:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9ac2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.673186:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9ac2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.674185:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43072600 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217031.674192:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9ac2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.674218:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9ac2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.674250:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e6105c700) 00010000:00010000:1.0:1782217031.674253:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782217031.674259:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9ac2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.674266:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9ac2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217031.674389:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+32:11336:x1868789693076736:12345-192.168.203.30@tcp:54:lfs.0 Request processed in 25725us (26005us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217031.674401:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 104 00000100:00100000:0.0:1782217031.680880:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217031.681071:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693077376 00000100:00100000:2.0:1782217031.681086:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693077376 00000100:00100000:2.0:1782217031.681162:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 23 00000100:00100000:2.0:1782217031.681175:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4268e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+32:11336:x1868789693077376:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:2.0:1782217031.681488:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4268e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+33:11336:x1868789693077376:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 315us (631us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1782217031.681497:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 23 00000001:00080000:1.0:1782217031.746721:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:1.0:1782217031.746740:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:2.0:1782217031.768043:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217031.768145:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693077632 00000100:00100000:1.0:1782217031.768156:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693077632 00000100:00100000:1.0:1782217031.768246:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 105 00000100:00100000:1.0:1782217031.768256:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+33:11347:x1868789693077632:12345-192.168.203.30@tcp:101:cat.0 00010000:00010000:1.0:1782217031.768282:0:6548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217031.768301:0:6548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9ac9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9734bc expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.768405:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9ad0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.768420:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9ad0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.768431:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9ad0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.768444:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5f9ad7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.768451:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5f9ad7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.768458:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5f9ad7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.768561:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5f9ade lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.768571:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5f9ade lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.768577:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5f9ade lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782217031.768753:0:6548:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:1.0:1782217031.768838:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9ad0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.768846:0:6548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9ad0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.768859:0:6548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9ad0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.768865:0:6548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43073a00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217031.768935:0:6548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9ad0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.768946:0:6548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9ad0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.768958:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff952e6105ce00) 00010000:00010000:1.0:1782217031.768961:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217031.768965:0:6548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9ad0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.768972:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9ad0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.768986:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5f9ad7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.768991:0:6548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5f9ad7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.768997:0:6548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5f9ad7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.769002:0:6548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43073600 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217031.769005:0:6548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5f9ad7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.769019:0:6548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5f9ad7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.769026:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff952e6105c400) 00010000:00010000:1.0:1782217031.769028:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217031.769031:0:6548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5f9ad7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.769035:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5f9ad7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.769079:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9ac9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734bc expref: 36 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.769092:0:6548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5f9ade lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734bc expref: 35 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217031.769099:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e6105c700) 00010000:00010000:1.0:1782217031.769101:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782217031.769103:0:6548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43073800, rc 0) 00000100:00100000:1.0:1782217031.769208:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+35:11347:x1868789693077632:12345-192.168.203.30@tcp:101:cat.0 Request processed in 952us (1174us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1782217031.769215:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 105 00000100:00100000:3.0:1782217031.778076:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217031.779764:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693077888 00000100:00100000:2.0:1782217031.779779:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693077888 00000100:00100000:2.0:1782217031.779862:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 24 00000100:00100000:2.0:1782217031.779873:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+35:11347:x1868789693077888:12345-192.168.203.30@tcp:35:cat.0 00000100:00100000:2.0:1782217031.780166:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+36:11347:x1868789693077888:12345-192.168.203.30@tcp:35:cat.0 Request processed in 294us (2104us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1782217031.780175:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 24 00000100:00100000:0.0:1782217031.815918:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217031.816041:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693078144 00000100:00100000:2.0:1782217031.816054:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693078144 00000100:00100000:2.0:1782217031.816131:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 106 00000100:00100000:2.0:1782217031.816143:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+36:11348:x1868789693078144:12345-192.168.203.30@tcp:36:rm.0 00010000:00010000:2.0:1782217031.816231:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1782217031.816267:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5f9a7c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734a7 expref: 36 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.816293:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5f9ade lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734bc expref: 35 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.816307:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5f9ab4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734b5 expref: 34 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.816320:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c000/0x92b8e04cbf5f9a6e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734a0 expref: 33 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.816344:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e6105c700) 00010000:00010000:2.0:1782217031.816350:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782217031.816380:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f9aec lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.816395:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f9aec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.816429:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f9aec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.816450:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9af3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.816458:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9af3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.816465:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9af3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.816652:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9afa lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.816661:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9afa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.816668:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9afa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782217031.816957:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1782217031.816970:0:6518:0:(osp_sync.c:1862:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 394800386843ns, next at 395800383111ns, rc = 0 00010000:00010000:2.0:1782217031.817026:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9b01 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.817035:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9b01 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.817044:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9b01 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.817068:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9b01 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.817074:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9b01 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.817081:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9b01 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.817106:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782217031.817131:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9afa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.817137:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9afa lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.817144:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9afa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.817151:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2d800 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782217031.817156:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9afa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.817164:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9afa lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.817175:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e6105c700) 00010000:00010000:2.0:1782217031.817178:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782217031.817182:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9afa lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.817198:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9afa lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.817218:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f9aec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.817225:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f9aec lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.817231:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f9aec lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.817236:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2d200 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782217031.817240:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f9aec lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.817250:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f9aec lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.817258:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff952e6105ce00) 00010000:00010000:2.0:1782217031.817261:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217031.817264:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f9aec lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.817270:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f9aec lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782217031.817279:0:6518:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008391e387 reply state 0000000068d681c6 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9af3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.817291:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9af3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.817304:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff952d410a7a00) 00010000:00010000:2.0:1782217031.817306:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1782217031.817308:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782217031.817408:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+34:11348:x1868789693078144:12345-192.168.203.30@tcp:36:rm.0 Request processed in 1264us (1502us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1782217031.817417:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 106 00010000:00010000:3.0:1782217031.818193:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782217031.818215:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9b01 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217031.818224:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2c200 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:3.0:1782217031.818228:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9b01 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217031.818236:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9b01 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217031.818252:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e6105c700) 00010000:00010000:3.0:1782217031.818255:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782217031.818259:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9b01 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217031.818284:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9b01 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217031.818301:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217031.818303:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217031.818305:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782217031.889147:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217031.889258:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693078400 00000100:00100000:2.0:1782217031.889272:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693078400 00000100:00100000:2.0:1782217031.889370:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 107 00000100:00100000:2.0:1782217031.889382:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43695c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+34:11354:x1868789693078400:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:2.0:1782217031.889415:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217031.889455:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f9b08 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9734c3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.890066:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9b0f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.890160:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9b0f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.890176:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9b0f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.890192:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9b16 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.890200:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9b16 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.890400:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9b16 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782217031.891939:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:2.0:1782217031.894109:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f9b1d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.894136:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f9b1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.894152:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f9b1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.894216:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9b0f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.894224:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9b0f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.894232:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9b0f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.894238:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2d800 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782217031.894244:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9b0f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.894251:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9b0f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.894266:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff952e6105ce00) 00010000:00010000:2.0:1782217031.894270:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217031.894295:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9b0f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.894304:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9b0f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782217031.894342:0:6520:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c48e0073 reply state 00000000a9b5b9d4 transno 4294967379 ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9b16 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.894358:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9b16 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.894365:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff952d410a7a00) 00010000:00010000:2.0:1782217031.894367:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1782217031.894370:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782217031.894432:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f9b08 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734c3 expref: 37 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.894450:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f9b1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734c3 expref: 36 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.894458:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff952d410a7400) 00010000:00010000:2.0:1782217031.894460:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782217031.894463:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2c600, rc 0) 00000100:00100000:2.0:1782217031.894637:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43695c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+37:11354:x1868789693078400:12345-192.168.203.30@tcp:101:bash.0 Request processed in 5199us (5448us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1782217031.894650:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 107 00000100:00100000:3.0:1782217031.898170:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217031.898340:0:10025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693078528 00000100:00100000:0.0:1782217031.898353:0:10025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693078528 00000100:00100000:0.0:1782217031.898446:0:10025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 42 00000100:00100000:0.0:1782217031.898457:0:10025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4330d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:24a87249-c61f-41a1-85ec-9a313129e739+5:2404:x1868789693078528:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:0.0:1782217031.898480:0:10025:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217031.898508:0:10025:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1f9c6d7/0x92b8e04cbf5f9b2b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9734ca expref: -99 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782217031.898540:0:10025:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782217031.898613:0:10025:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=394s v=(0 0) 00010000:00010000:0.0:1782217031.898619:0:10025:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217031.898632:0:10025:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1f9c6d7/0x92b8e04cbf5f9b2b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734ca expref: 6 pid: 10025 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.898657:0:10025:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e1f9c6d7/0x92b8e04cbf5f9b2b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734ca expref: 6 pid: 10025 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217031.898674:0:10025:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e4121de00, rc 0) 00000100:00100000:0.0:1782217031.898748:0:10025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4330d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:24a87249-c61f-41a1-85ec-9a313129e739+6:2404:x1868789693078528:12345-192.168.203.30@tcp:101:bash.0 Request processed in 293us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217031.898756:0:10025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 42 00000100:00080000:2.0:1782217031.898843:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782217031.902481:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217031.902955:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693078656 00000100:00100000:2.0:1782217031.902968:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693078656 00000100:00100000:2.0:1782217031.903086:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 43 00000100:00100000:2.0:1782217031.903116:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43605880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:24a87249-c61f-41a1-85ec-9a313129e739+6:11354:x1868789693078656:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:2.0:1782217031.903140:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217031.903163:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff039d4c/0x92b8e04cbf5f9b32 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9734d1 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.903202:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e1f9c6d7/0x92b8e04cbf5f9b2b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734ca expref: 7 pid: 10025 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.903213:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782217031.903217:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782217031.903223:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff039d4c/0x92b8e04cbf5f9b32 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734d1 expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.903267:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e1f9c6d7/0x92b8e04cbf5f9b2b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734ca expref: 7 pid: 10025 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.903283:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e1f9c6d7/0x92b8e04cbf5f9b2b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734ca expref: 7 pid: 10025 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217031.903312:0:8435:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8435:1868789713078016:192.168.203.30@tcp:104: 00000100:00100000:2.0:1782217031.903484:0:8435:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d42661e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782217031.906821:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217031.906904:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693078784 00000100:00100000:3.0:1782217031.906914:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693078784 00010000:00010000:3.0:1782217031.906962:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e1f9c6d7/0x92b8e04cbf5f9b2b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734ca expref: 8 pid: 10025 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217031.907006:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 67 00000100:00100000:3.0:1782217031.907016:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43606d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24a87249-c61f-41a1-85ec-9a313129e739+8:2402:x1868789693078784:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782217031.907035:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217031.907060:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e1f9c6d7/0x92b8e04cbf5f9b2b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734ca expref: 8 pid: 10025 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217031.907075:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e1f9c6d7/0x92b8e04cbf5f9b2b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734ca expref: 8 pid: 10025 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217031.907106:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217031.907112:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217031.907122:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff039d4c/0x92b8e04cbf5f9b32 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734d1 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217031.907158:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff039d4c/0x92b8e04cbf5f9b32 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734d1 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217031.907205:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ff039d4c/0x92b8e04cbf5f9b32 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734d1 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217031.907224:0:6506:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4330d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6506:1868789713078144:192.168.203.30@tcp:105: 00000100:00100000:3.0:1782217031.907336:0:6506:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d426cc6c0 going to sleep for 11 seconds 00010000:00010000:2.0:1782217031.908885:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1f9c6d7/0x92b8e04cbf5f9b2b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734ca expref: 8 pid: 10025 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217031.908915:0:8435:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8435:1868789713078016:192.168.203.30@tcp:104: 00010000:00010000:2.0:1782217031.908975:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ff039d4c/0x92b8e04cbf5f9b32 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734d1 expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217031.908991:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2d200, rc 0) 00000100:00100000:2.0:1782217031.909130:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43605880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:24a87249-c61f-41a1-85ec-9a313129e739+7:11354:x1868789693078656:12345-192.168.203.30@tcp:101:bash.0 Request processed in 6015us (6664us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217031.909139:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 43 00000100:00100000:3.0:1782217031.910858:0:6506:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4330d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6506:1868789713078144:192.168.203.30@tcp:105: 00010000:00010000:3.0:1782217031.910898:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217031.910992:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43606d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24a87249-c61f-41a1-85ec-9a313129e739+6:2402:x1868789693078784:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 3976us (4182us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217031.911005:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 67 00000100:00100000:3.0:1782217031.912082:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217031.912179:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693079040 00000100:00100000:2.0:1782217031.912191:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693079040 00000100:00100000:2.0:1782217031.912303:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 25 00000100:00100000:2.0:1782217031.912315:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4330d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+37:11354:x1868789693079040:12345-192.168.203.30@tcp:35:bash.0 00000100:00100000:2.0:1782217031.912728:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4330d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+38:11354:x1868789693079040:12345-192.168.203.30@tcp:35:bash.0 Request processed in 413us (652us total) trans 4294967380 rc 0/0 00000100:00100000:2.0:1782217031.912737:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 25 00000100:00100000:1.0:1782217032.055630:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217032.056008:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693079168 00000100:00100000:2.0:1782217032.056023:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693079168 00000100:00100000:2.0:1782217032.056102:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 108 00000100:00100000:2.0:1782217032.056114:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4368c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+38:11370:x1868789693079168:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1782217032.056146:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217032.056174:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9b39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9734d8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.056278:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9b40 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.056296:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9b40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.056330:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9b40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217032.056388:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1782217032.056393:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782217032.056418:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9b40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.056449:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9b39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734d8 expref: 40 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.056472:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9b40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734d8 expref: 39 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.056481:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff952e6105ce00) 00010000:00010000:2.0:1782217032.056484:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782217032.056489:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2c400, rc 0) 00000100:00100000:2.0:1782217032.056567:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4368c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+39:11370:x1868789693079168:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 455us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217032.056575:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 108 00000100:00100000:0.0:1782217032.060907:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217032.060967:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693079424 00000100:00100000:1.0:1782217032.060979:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693079424 00000100:00100000:1.0:1782217032.061066:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 109 00000100:00100000:1.0:1782217032.061077:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+39:11370:x1868789693079424:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1782217032.061122:0:6548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217032.061146:0:6548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9b47 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9734df expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.061310:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9b4e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.061328:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9b4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.061341:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9b4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782217032.061355:0:6548:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1782217032.061508:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9b47 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734df expref: 42 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.061532:0:6548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9b4e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734df expref: 41 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.061541:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff952d410a7400) 00010000:00010000:1.0:1782217032.061545:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782217032.061549:0:6548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43072e00, rc 0) 00000100:00100000:1.0:1782217032.061981:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+41:11370:x1868789693079424:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 903us (1086us total) trans 4294967381 rc 0/0 00000100:00100000:1.0:1782217032.061991:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 109 00000100:00100000:3.0:1782217032.064866:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217032.065041:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693079552 00000100:00100000:1.0:1782217032.065053:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693079552 00000100:00100000:1.0:1782217032.065135:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:1.0:1782217032.065165:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c673800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24a87249-c61f-41a1-85ec-9a313129e739+41:2403:x1868789693079552:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782217032.065185:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782217032.065223:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9b4e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734df expref: 41 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.065247:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff952d410a7400) 00010000:00010000:1.0:1782217032.065253:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782217032.065443:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c673800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24a87249-c61f-41a1-85ec-9a313129e739+40:2403:x1868789693079552:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 279us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217032.065453:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:0.0:1782217032.067215:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217032.067385:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693079808 00000100:00100000:2.0:1782217032.067396:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693079808 00000100:00100000:2.0:1782217032.067498:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 110 00000100:00100000:2.0:1782217032.067510:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4360ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+40:11370:x1868789693079808:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1782217032.067541:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217032.067565:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9b5c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9734e6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.067750:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9b63 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.067766:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9b63 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.067778:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9b63 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217032.067800:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1782217032.067934:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9b5c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734e6 expref: 43 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.067952:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9b63 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734e6 expref: 42 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.067961:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff952d410a7400) 00010000:00010000:2.0:1782217032.067964:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1782217032.067967:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2d400, rc 0) 00000100:00100000:2.0:1782217032.068029:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4360ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+42:11370:x1868789693079808:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 522us (834us total) trans 4294967382 rc 0/0 00000100:00100000:2.0:1782217032.068036:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 110 00000100:00100000:2.0:1782217032.075127:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217032.075230:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693079936 00000100:00100000:1.0:1782217032.075243:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693079936 00000100:00100000:1.0:1782217032.075320:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 44 00000100:00100000:1.0:1782217032.075332:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24a87249-c61f-41a1-85ec-9a313129e739+6:2402:x1868789693079936:12345-192.168.203.30@tcp:1:lfs.0 00010000:00010000:1.0:1782217032.075392:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000383b62e5/0x92b8e04cbf5f9b71 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.075429:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff039d4c/0x92b8e04cbf5f9b32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734d1 expref: 6 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.075439:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1782217032.075443:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782217032.075448:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000383b62e5/0x92b8e04cbf5f9b71 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.075491:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ff039d4c/0x92b8e04cbf5f9b32 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734d1 expref: 6 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.075526:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ff039d4c/0x92b8e04cbf5f9b32 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734d1 expref: 6 pid: 8435 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217032.075544:0:8432:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4368d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8432:1868789713078272:192.168.203.30@tcp:104: 00000100:00100000:1.0:1782217032.075833:0:8432:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d437870c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782217032.079167:0:8432:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4368d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8432:1868789713078272:192.168.203.30@tcp:104: 00010000:00010000:1.0:1782217032.079211:0:8432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000383b62e5/0x92b8e04cbf5f9b71 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217032.081731:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217032.082024:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693080064 00000100:00100000:3.0:1782217032.082037:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693080064 00002000:00100000:3.0:1782217032.082107:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff952d4263e680 x1868789693080064/t0(0) o4->24a87249-c61f-41a1-85ec-9a313129e739@192.168.203.30@tcp:283/0 lens 504/0 e 0 to 0 dl 1782217043 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782217032.082120:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff952d4263e680 with x1868789693080064 ext(0->8) 00010000:00010000:3.0:1782217032.082131:0:8440:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ff039d4c/0x92b8e04cbf5f9b32 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734d1 expref: 7 pid: 8435 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217032.082151:0:8440:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ff039d4c/0x92b8e04cbf5f9b32 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734d1 expref: 7 pid: 8435 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782217032.082178:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff952d4263e680 00000100:00100000:3.0:1782217032.082221:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1 00000100:00100000:3.0:1782217032.082231:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4263e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:24a87249-c61f-41a1-85ec-9a313129e739+7:2403:x1868789693080064:12345-192.168.203.30@tcp:4:lfs.0 00000100:00100000:3.0:1782217032.084709:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4263e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:24a87249-c61f-41a1-85ec-9a313129e739+9:2403:x1868789693080064:12345-192.168.203.30@tcp:4:lfs.0 Request processed in 2466us (2980us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1782217032.084724:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1 00002000:00100000:3.0:1782217032.084739:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff952d4263e680 x1868789693080064/t4294967303(0) o4->24a87249-c61f-41a1-85ec-9a313129e739@192.168.203.30@tcp:283/0 lens 504/448 e 0 to 0 dl 1782217043 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782217032.084750:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff952d4263e680 with x1868789693080064 ext(0->8) 00010000:00010000:3.0:1782217032.084762:0:8440:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ff039d4c/0x92b8e04cbf5f9b32 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734d1 expref: 9 pid: 8435 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217032.084783:0:8440:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ff039d4c/0x92b8e04cbf5f9b32 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734d1 expref: 9 pid: 8435 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782217032.084802:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff952d4263e680 00000100:00100000:3.0:1782217032.088956:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217032.089180:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693080192 00000100:00100000:2.0:1782217032.089195:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693080192 00010000:00010000:2.0:1782217032.089261:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ff039d4c/0x92b8e04cbf5f9b32 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734d1 expref: 9 pid: 8435 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217032.089354:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 68 00000100:00100000:2.0:1782217032.089367:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e6f92e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24a87249-c61f-41a1-85ec-9a313129e739+9:2403:x1868789693080192:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782217032.089388:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1782217032.089411:0:6504:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1782217032.089414:0:6504:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1782217031 00002000:00010000:2.0:1782217032.089417:0:6504:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1782217032 00002000:00010000:2.0:1782217032.089419:0:6504:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1782217031 00002000:00010000:2.0:1782217032.089421:0:6504:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1782217032.089428:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ff039d4c/0x92b8e04cbf5f9b32 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734d1 expref: 9 pid: 8435 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.089444:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ff039d4c/0x92b8e04cbf5f9b32 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734d1 expref: 9 pid: 8435 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.089478:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff039d4c/0x92b8e04cbf5f9b32 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734d1 expref: 9 pid: 8435 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.089499:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782217032.089504:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782217032.089511:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000383b62e5/0x92b8e04cbf5f9b71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.089523:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000383b62e5/0x92b8e04cbf5f9b71 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.089576:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782217032.089823:0:8432:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000383b62e5/0x92b8e04cbf5f9b71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.089835:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000383b62e5/0x92b8e04cbf5f9b71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.089860:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000383b62e5/0x92b8e04cbf5f9b71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.089879:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000383b62e5/0x92b8e04cbf5f9b71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.089887:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000383b62e5/0x92b8e04cbf5f9b71 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.089909:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43073a00 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:1.0:1782217032.089913:0:8432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000383b62e5/0x92b8e04cbf5f9b71 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.089924:0:8432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000383b62e5/0x92b8e04cbf5f9b71 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.089936:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000383b62e5/0x92b8e04cbf5f9b71 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.089943:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000383b62e5/0x92b8e04cbf5f9b71 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217032.090060:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24a87249-c61f-41a1-85ec-9a313129e739+8:2402:x1868789693079936:12345-192.168.203.30@tcp:1:lfs.0 Request processed in 14730us (14946us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217032.090070:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 44 00000100:00100000:2.0:1782217032.090545:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e6f92e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24a87249-c61f-41a1-85ec-9a313129e739+7:2403:x1868789693080192:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 1179us (1603us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217032.090554:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 68 00000100:00100000:2.0:1782217032.098623:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217032.101336:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693080448 00000100:00100000:1.0:1782217032.101350:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693080448 00000100:00100000:1.0:1782217032.101482:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 26 00000100:00100000:1.0:1782217032.101493:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e64f0b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24a87249-c61f-41a1-85ec-9a313129e739+42:11370:x1868789693080448:12345-192.168.203.30@tcp:35:lfs.0 00000004:00010000:1.0:1782217032.101560:0:6522:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9b63 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734e6 expref: 42 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782217032.101833:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1782217032.101868:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:1.0:1782217032.102205:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00010000:00010000:1.0:1782217032.102239:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9b78 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.102255:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f9b1d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734c3 expref: 46 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.102264:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9b78 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.102498:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f9b1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734c3 expref: 46 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.102515:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f9b1d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734c3 expref: 46 pid: 6520 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217032.102528:0:6522:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4368d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1868789713078400:192.168.203.30@tcp:104: 00000100:00100000:1.0:1782217032.102646:0:6522:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43787780 going to sleep for 11 seconds 00000100:00100000:1.0:1782217032.109461:0:6522:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4368d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1868789713078400:192.168.203.30@tcp:104: 00010000:00010000:1.0:1782217032.109491:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9b78 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217032.109957:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217032.115532:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693080576 00000100:00100000:3.0:1782217032.115546:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693080576 00010000:00010000:3.0:1782217032.115606:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f9b1d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734c3 expref: 47 pid: 6520 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217032.115642:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 69 00000100:00100000:3.0:1782217032.115652:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4263fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24a87249-c61f-41a1-85ec-9a313129e739+47:2403:x1868789693080576:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782217032.115691:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217032.115700:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f9b1d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734c3 expref: 47 pid: 6520 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217032.115714:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f9b1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734c3 expref: 47 pid: 6520 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217032.115737:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f9b1d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734c3 expref: 47 pid: 6520 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217032.115754:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff952d410a7400) 00010000:00010000:3.0:1782217032.115759:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9b78 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217032.115769:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9b78 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217032.115777:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9b78 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217032.115821:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217032.115888:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4263fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24a87249-c61f-41a1-85ec-9a313129e739+46:2403:x1868789693080576:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 237us (5932us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217032.115896:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 69 00010000:00010000:1.0:1782217032.116257:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9b78 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.116267:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9b78 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782217032.116389:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000001:00080000:1.0:1782217032.116497:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:1.0:1782217032.116642:0:6522:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4368d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1868789713078528:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1782217032.116885:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217032.116921:0:6522:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43787d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782217032.116972:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713078528 00000100:00100000:0.0:1782217032.116978:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713078528 00000100:00100000:0.0:1782217032.117043:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1782217032.117052:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6522:x1868789713078528:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1782217032.117140:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6522:x1868789713078528:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 90us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217032.117148:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:2.0:1782217032.117212:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782217032.117871:0:6522:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:3.0:1782217032.117878:0:6522:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967302 00000004:00080000:3.0:1782217032.117898:0:6522:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff952d43799f80, transno 4294967302 00000100:00100000:3.0:1782217032.117957:0:6522:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4368d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1868789713078528:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1782217032.118103:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00000100:00100000:3.0:1782217032.118160:0:6522:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c671180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1868789713078656:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1782217032.118203:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217032.118235:0:6522:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d426ccf00 going to sleep for 11 seconds 00000100:00100000:0.0:1782217032.118815:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713078656 00000100:00100000:0.0:1782217032.118823:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713078656 00000100:00100000:0.0:1782217032.118875:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1782217032.118884:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c673800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6522:x1868789713078656:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1782217032.119031:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c673800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6522:x1868789713078656:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 149us (827us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1782217032.119039:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1782217032.119156:0:6522:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c671180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1868789713078656:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1782217032.119201:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:3.0:1782217032.119238:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9b78 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217032.119248:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9b78 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217032.119256:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9b78 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217032.119262:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43073a00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217032.119267:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9b78 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217032.119275:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9b78 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217032.119303:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff952d410a7400) 00010000:00010000:3.0:1782217032.119307:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1782217032.119311:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9b78 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217032.119318:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9b78 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782217032.119412:0:6522:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1782217032.119493:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:3.0:1782217032.119505:0:6522:0:(osp_sync.c:1862:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 395102921257ns, next at 396102919067ns, rc = 0 00000001:00080000:3.0:1782217032.119512:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967390 00010000:00010000:3.0:1782217032.119535:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff952d410a7400) 00010000:00010000:3.0:1782217032.119538:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1782217032.119545:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9b63 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734e6 expref: 50 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217032.119667:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e64f0b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24a87249-c61f-41a1-85ec-9a313129e739+49:11370:x1868789693080448:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 18175us (21054us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1782217032.119676:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 26 00000020:00080000:3.0:1782217032.119681:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1782217032.123954:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217032.124100:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693080704 00000100:00100000:0.0:1782217032.124110:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693080704 00000100:00100000:0.0:1782217032.124168:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 111 00000100:00100000:0.0:1782217032.124178:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+49:11370:x1868789693080704:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1782217032.124199:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217032.124222:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9b7f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9734ed expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217032.124277:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9b7f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734ed expref: 50 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217032.124292:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9b7f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734ed expref: 50 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217032.124309:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff952d426a0300) 00010000:00010000:0.0:1782217032.124312:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782217032.124315:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e4121d600, rc 0) 00000100:00100000:0.0:1782217032.124372:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+50:11370:x1868789693080704:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 196us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217032.124379:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 111 00000100:00100000:0.0:1782217032.131151:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217032.131254:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693080960 00000100:00100000:2.0:1782217032.131264:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693080960 00000100:00100000:2.0:1782217032.131335:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 27 00000100:00100000:2.0:1782217032.131346:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+50:11370:x1868789693080960:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:2.0:1782217032.134154:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+51:11370:x1868789693080960:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 2799us (3001us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1782217032.134169:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 27 00010000:00010000:1.0:1782217032.187292:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782217032.256282:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217032.256398:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693081088 00000100:00100000:1.0:1782217032.256407:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693081088 00000100:00100000:1.0:1782217032.256467:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 112 00000100:00100000:1.0:1782217032.256477:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4330d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+51:11380:x1868789693081088:12345-192.168.203.30@tcp:34:lfs.0 00010000:00010000:1.0:1782217032.256550:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9b86 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.256566:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9b86 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.256577:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9b86 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.256738:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9b8d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.256746:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9b8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.256753:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9b8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.256834:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9b94 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.256842:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9b94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.256932:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9b94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782217032.256981:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9b94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.256993:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9b86 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.257000:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9b86 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.257007:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9b86 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.257013:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43072e00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217032.257018:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9b86 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.257024:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9b86 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.257036:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff952e6105ce00) 00010000:00010000:1.0:1782217032.257039:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217032.257043:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9b86 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.257049:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9b86 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.257061:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9b8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.257075:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9b8d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.257081:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9b8d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.257087:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43073400 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217032.257090:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9b8d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.257095:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9b8d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.257103:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff952d410a7a00) 00010000:00010000:1.0:1782217032.257106:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217032.257108:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9b8d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.257113:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9b8d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.257123:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9b94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.257130:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9b94 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.257136:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9b94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.257141:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43072200 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217032.257150:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9b94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.257157:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9b94 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.257165:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff952d426a0300) 00010000:00010000:1.0:1782217032.257167:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217032.257170:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9b94 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.257175:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9b94 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217032.257291:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4330d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+51:11380:x1868789693081088:12345-192.168.203.30@tcp:34:lfs.0 Request processed in 814us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217032.257300:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 112 00000100:00100000:0.0:1782217032.343347:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217032.343453:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693081344 00000100:00100000:2.0:1782217032.343468:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693081344 00000100:00100000:2.0:1782217032.343557:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 113 00000100:00100000:2.0:1782217032.343568:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+51:11383:x1868789693081344:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1782217032.343644:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217032.343668:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9b9b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9734f4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.343741:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9ba2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.343756:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9ba2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.343796:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9ba2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.343810:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f9ba9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.343817:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f9ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.343822:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f9ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.343929:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f9bb0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.343938:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f9bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.343944:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f9bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217032.343955:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1782217032.344030:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9ba2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.344038:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9ba2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.344045:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9ba2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.344051:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2d400 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782217032.344062:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9ba2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.344069:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9ba2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.344082:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff952e6105ce00) 00010000:00010000:2.0:1782217032.344085:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217032.344090:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9ba2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.344096:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9ba2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.344109:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f9ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.344114:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f9ba9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.344120:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f9ba9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.344125:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2c600 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782217032.344128:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f9ba9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.344134:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f9ba9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.344141:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff952d410a7a00) 00010000:00010000:2.0:1782217032.344143:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217032.344151:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f9ba9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.344157:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f9ba9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.344192:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9b9b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734f4 expref: 54 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.344206:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f9bb0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734f4 expref: 53 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.344213:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff952d426a0300) 00010000:00010000:2.0:1782217032.344216:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782217032.344218:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2d200, rc 0) 00000100:00100000:2.0:1782217032.344283:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+53:11383:x1868789693081344:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 717us (953us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1782217032.344291:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 113 00000100:00100000:0.0:1782217032.350443:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217032.351483:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693081472 00000100:00100000:3.0:1782217032.351499:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693081472 00000100:00100000:3.0:1782217032.351579:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 114 00000100:00100000:3.0:1782217032.351635:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4379bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+53:11383:x1868789693081472:12345-192.168.203.30@tcp:54:lfs.0 00010000:00010000:3.0:1782217032.351733:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5f9bbe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217032.351756:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5f9bbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217032.351770:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5f9bbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217032.351829:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5f9bbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217032.351862:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5f9bbe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217032.353157:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5f9bbe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217032.353175:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362a00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217032.353181:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5f9bbe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217032.353192:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5f9bbe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217032.353214:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff952d426a0300) 00010000:00010000:3.0:1782217032.353218:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782217032.353223:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5f9bbe lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217032.353230:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5f9bbe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217032.354197:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4379bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+53:11383:x1868789693081472:12345-192.168.203.30@tcp:54:lfs.0 Request processed in 2551us (3758us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217032.354212:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 114 00000100:00100000:3.0:1782217032.358631:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217032.367388:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693081728 00000100:00100000:1.0:1782217032.367408:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693081728 00000100:00100000:1.0:1782217032.368523:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 28 00000100:00100000:1.0:1782217032.368543:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4368d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24a87249-c61f-41a1-85ec-9a313129e739+53:11383:x1868789693081728:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:1.0:1782217032.369135:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4368d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24a87249-c61f-41a1-85ec-9a313129e739+54:11383:x1868789693081728:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 597us (10561us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1782217032.369146:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 28 00000100:00100000:0.0:1782217032.465841:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217032.466243:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693081984 00000100:00100000:2.0:1782217032.466257:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693081984 00000100:00100000:2.0:1782217032.469695:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 115 00000100:00100000:2.0:1782217032.469731:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43c4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+54:11393:x1868789693081984:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:2.0:1782217032.469768:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217032.469772:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1782217032.469821:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9b40 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734d8 expref: 54 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.469849:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff952e6105ce00) 00010000:00010000:2.0:1782217032.469855:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782217032.469904:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9bc5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9734fb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.470486:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f9bcc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.470504:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f9bcc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.470514:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f9bcc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217032.470525:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1782217032.470706:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9bc5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734fb expref: 56 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.470725:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f9bcc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734fb expref: 55 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.470734:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff952d426a0300) 00010000:00010000:2.0:1782217032.470737:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782217032.470739:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2c600, rc 0) 00000100:00100000:2.0:1782217032.471029:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43c4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+55:11393:x1868789693081984:12345-192.168.203.30@tcp:101:bash.0 Request processed in 1317us (5199us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1782217032.471120:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 115 00000100:00100000:0.0:1782217032.478810:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217032.478995:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217032.479132:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693082240 00000100:00100000:2.0:1782217032.479145:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693082240 00000100:00100000:2.0:1782217032.479223:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 116 00000100:00100000:2.0:1782217032.479237:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7f6c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+55:11393:x1868789693082240:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:2.0:1782217032.479279:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217032.479306:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9bda lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973502 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.479350:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9be1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.479366:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9be1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.479381:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9be1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.479728:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9bda lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973502 expref: 57 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.479753:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9be1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973502 expref: 56 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.479763:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff952d426a0300) 00010000:00010000:2.0:1782217032.479767:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782217032.479770:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2d400, rc 0) 00000100:00100000:2.0:1782217032.479852:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7f6c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+56:11393:x1868789693082240:12345-192.168.203.30@tcp:101:bash.0 Request processed in 618us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217032.479868:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 116 00000100:00100000:1.0:1782217032.481680:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693082112 00000100:00100000:1.0:1782217032.481699:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693082112 00000100:00100000:1.0:1782217032.481809:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 8 00000100:00100000:1.0:1782217032.481821:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7f6c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24a87249-c61f-41a1-85ec-9a313129e739+56:2402:x1868789693082112:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782217032.481847:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782217032.481957:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f9bcc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734fb expref: 56 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.481981:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff952d426a0300) 00010000:00010000:1.0:1782217032.481987:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782217032.482190:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7f6c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24a87249-c61f-41a1-85ec-9a313129e739+55:2402:x1868789693082112:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 370us (3407us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217032.482198:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 8 00000100:00100000:0.0:1782217032.487808:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217032.488465:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693082496 00000100:00100000:1.0:1782217032.488478:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693082496 00000100:00100000:1.0:1782217032.488560:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 117 00000100:00100000:1.0:1782217032.488572:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7f6c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+55:11393:x1868789693082496:12345-192.168.203.30@tcp:36:bash.0 00010000:00010000:1.0:1782217032.488672:0:6548:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782217032.488706:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f9bb0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734f4 expref: 55 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.488731:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff952d426a0300) 00010000:00010000:1.0:1782217032.488737:0:6548:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782217032.489061:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9be8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.489080:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9be8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.489091:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9be8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782217032.489144:0:6548:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967396 00000004:00010000:1.0:1782217032.489169:0:6548:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c82e977e reply state 00000000c3804446 transno 4294967397 ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9be8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.489201:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9be8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.489446:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff952d426a0300) 00010000:00010000:1.0:1782217032.489450:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782217032.489453:0:6548:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782217032.489713:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7f6c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+57:11393:x1868789693082496:12345-192.168.203.30@tcp:36:bash.0 Request processed in 1141us (1925us total) trans 4294967397 rc 0/0 00000100:00100000:1.0:1782217032.489723:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 117 00000020:00080000:1.0:1782217032.489730:0:6548:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1782217032.493261:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217032.493425:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693082624 00000100:00100000:3.0:1782217032.493439:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693082624 00000100:00100000:3.0:1782217032.493510:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 118 00000100:00100000:3.0:1782217032.493523:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7f6c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+57:11393:x1868789693082624:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:3.0:1782217032.493573:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217032.493739:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5f9bef lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973509 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217032.493880:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f9bf6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217032.493899:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f9bf6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217032.493913:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f9bf6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217032.493954:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1782217032.493959:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782217032.493982:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f9bf6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217032.494015:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5f9bef lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973509 expref: 59 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217032.494035:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f9bf6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973509 expref: 58 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217032.494045:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff952d426a0300) 00010000:00010000:3.0:1782217032.494048:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782217032.494053:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b362e00, rc 0) 00000100:00100000:3.0:1782217032.494135:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7f6c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+58:11393:x1868789693082624:12345-192.168.203.30@tcp:101:bash.0 Request processed in 615us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217032.494144:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 118 00000100:00100000:3.0:1782217032.501697:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217032.501821:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693082880 00000100:00100000:2.0:1782217032.501833:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693082880 00000100:00100000:2.0:1782217032.502178:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 29 00000100:00100000:2.0:1782217032.502191:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72e8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+58:11393:x1868789693082880:12345-192.168.203.30@tcp:35:bash.0 00000100:00100000:2.0:1782217032.502575:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72e8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+59:11393:x1868789693082880:12345-192.168.203.30@tcp:35:bash.0 Request processed in 385us (891us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1782217032.502617:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 29 00000100:00100000:0.0:1782217032.630512:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217032.630723:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693083008 00000100:00100000:1.0:1782217032.630736:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693083008 00000100:00100000:1.0:1782217032.630829:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 119 00000100:00100000:1.0:1782217032.630842:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7f6c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+59:11399:x1868789693083008:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1782217032.630884:0:6548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217032.630911:0:6548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9bfd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973510 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.630993:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5f9c04 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.631010:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5f9c04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.631024:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5f9c04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782217032.631082:0:6548:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1782217032.631087:0:6548:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782217032.631127:0:6548:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5f9c04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.631154:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9bfd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973510 expref: 61 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.631174:0:6548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5f9c04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973510 expref: 60 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.631183:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff952e6105ce00) 00010000:00010000:1.0:1782217032.631186:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782217032.631190:0:6548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43073e00, rc 0) 00000100:00100000:1.0:1782217032.631262:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7f6c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+60:11399:x1868789693083008:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 423us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217032.631269:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 119 00000100:00100000:0.0:1782217032.638486:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217032.638727:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693083136 00000100:00100000:2.0:1782217032.638741:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693083136 00000100:00100000:2.0:1782217032.638833:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 120 00000100:00100000:2.0:1782217032.638846:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7f6c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+60:11399:x1868789693083136:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1782217032.639050:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217032.639082:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9c0b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973517 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.639173:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9c12 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.639191:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9c12 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.639204:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9c12 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.639218:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9c19 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.639226:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9c19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.639233:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9c19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.639327:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f9c20 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.639354:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f9c20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.639362:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f9c20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217032.639485:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1782217032.639490:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782217032.639516:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f9c20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.639531:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f9c20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.639541:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9c12 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.639548:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9c12 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.639556:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9c12 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.639563:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2c000 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782217032.639568:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9c12 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.639577:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9c12 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.639756:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff952e6105ce00) 00010000:00010000:2.0:1782217032.639760:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217032.639774:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9c12 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.639781:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9c12 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.639809:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9c19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.639816:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9c19 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.639822:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9c19 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.639827:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2d000 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782217032.639830:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9c19 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.639837:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9c19 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.639845:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff952d410a7a00) 00010000:00010000:2.0:1782217032.639847:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217032.639850:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9c19 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.639856:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9c19 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.640007:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9c0b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973517 expref: 62 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.640036:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f9c20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973517 expref: 61 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217032.640044:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff952d426a0300) 00010000:00010000:2.0:1782217032.640047:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782217032.640049:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2c800, rc 0) 00000100:00100000:2.0:1782217032.640190:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7f6c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+61:11399:x1868789693083136:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 1346us (1787us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217032.640199:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 120 00000100:00100000:3.0:1782217032.651549:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217032.651696:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217032.651734:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217032.651811:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217032.651877:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693083520 00000100:00100000:2.0:1782217032.651889:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693083520 00000100:00100000:2.0:1782217032.651962:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 88 00000100:00100000:2.0:1782217032.651974:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42611880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:24a87249-c61f-41a1-85ec-9a313129e739+8:2403:x1868789693083520:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1782217032.652070:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42611880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:24a87249-c61f-41a1-85ec-9a313129e739+8:2403:x1868789693083520:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 98us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217032.652080:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 88 00000100:00100000:0.0:1782217032.652472:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693083264 00000100:00100000:0.0:1782217032.652479:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693083264 00000100:00100000:0.0:1782217032.652526:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 384 00000100:00100000:0.0:1782217032.652534:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:2403:x1868789693083264:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782217032.652568:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:2403:x1868789693083264:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 35us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217032.652574:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 384 00000100:00100000:1.0:1782217032.660892:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693083392 00000100:00100000:1.0:1782217032.660916:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693083392 00000100:00100000:1.0:1782217032.661223:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693083776 00000100:00100000:1.0:1782217032.661228:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693083776 00000100:00080000:0.0:1782217032.661840:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782217032.661848:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782217032.661909:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 300 00000100:00100000:0.0:1782217032.661927:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+5:2402:x1868789693083392:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1782217032.662415:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 301 00000100:00100000:1.0:1782217032.662426:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a927f5f6-9735-45e0-abce-963bd125e020+5:2403:x1868789693083776:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782217032.662827:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+5:2402:x1868789693083392:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 903us (11289us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217032.662838:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 300 00000100:00100000:3.0:1782217032.662883:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217032.662938:0:10025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693083648 00000100:00100000:0.0:1782217032.663054:0:10025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693083648 00000100:00100000:0.0:1782217032.663102:0:10025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 89 00000100:00100000:0.0:1782217032.663109:0:10025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:24a87249-c61f-41a1-85ec-9a313129e739+7:2402:x1868789693083648:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782217032.663291:0:10025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:24a87249-c61f-41a1-85ec-9a313129e739+7:2402:x1868789693083648:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 181us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217032.663312:0:10025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 89 00000100:00100000:1.0:1782217032.663456:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a927f5f6-9735-45e0-abce-963bd125e020+5:2403:x1868789693083776:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 1032us (11644us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217032.663466:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 301 00000100:00100000:2.0:1782217032.663673:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217032.663703:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217032.663730:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217032.663755:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693084288 00000100:00100000:2.0:1782217032.663761:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693084288 00000100:00100000:0.0:1782217032.663923:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693083904 00000100:00100000:0.0:1782217032.663928:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693083904 00000100:00100000:0.0:1782217032.664151:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693084160 00000100:00100000:0.0:1782217032.664156:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693084160 00000100:00100000:0.0:1782217032.664190:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 302 00000100:00100000:0.0:1782217032.664199:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a927f5f6-9735-45e0-abce-963bd125e020+5:2402:x1868789693083904:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782217032.664249:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a927f5f6-9735-45e0-abce-963bd125e020+5:2402:x1868789693083904:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 51us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217032.664256:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 302 00000100:00100000:0.0:1782217032.664271:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 121 00000100:00100000:0.0:1782217032.664278:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c797800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+62:11399:x1868789693084160:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1782217032.664291:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217032.664317:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9c27 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be97351e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217032.664672:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121cc00/0x92b8e04cbf5f9c2e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217032.664693:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f9bf6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973509 expref: 63 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217032.664703:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f9c20 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973517 expref: 63 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217032.664714:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121cc00/0x92b8e04cbf5f9c2e lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217032.664796:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f9c20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973517 expref: 63 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1782217032.666923:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1782217032.667414:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f9c20 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973517 expref: 63 pid: 6518 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217032.667445:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7f6c0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1868789713078784:192.168.203.30@tcp:104: 00010000:00010000:2.0:1782217032.667520:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f9c20 lrc: 6/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973517 expref: 63 pid: 6518 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217032.667663:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 70 00000100:00100000:1.0:1782217032.667683:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c795500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24a87249-c61f-41a1-85ec-9a313129e739+63:2402:x1868789693084288:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782217032.667700:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782217032.667724:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f9c20 lrc: 6/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973517 expref: 63 pid: 6518 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.667750:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f9c20 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973517 expref: 63 pid: 6518 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.667777:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff952d426a0300) 00010000:00010000:1.0:1782217032.667782:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121cc00/0x92b8e04cbf5f9c2e lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.667801:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121cc00/0x92b8e04cbf5f9c2e lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.667808:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782217032.667839:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c795500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24a87249-c61f-41a1-85ec-9a313129e739+63:2402:x1868789693084288:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 165us (4107us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217032.667848:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 70 00010000:00010000:0.0:1782217032.668150:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f9bf6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973509 expref: 62 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217032.668165:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f9bf6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973509 expref: 62 pid: 6519 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217032.668177:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7f6c1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1868789713078912:192.168.203.30@tcp:104: 00000100:00100000:1.0:1782217032.674894:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217032.675496:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693084416 00000100:00100000:3.0:1782217032.675509:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693084416 00010000:00010000:3.0:1782217032.675895:0:8449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f9bf6 lrc: 6/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973509 expref: 63 pid: 6519 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217032.675938:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 71 00000100:00100000:3.0:1782217032.675950:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:24a87249-c61f-41a1-85ec-9a313129e739+63:2403:x1868789693084416:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782217032.675968:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217032.675975:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f9bf6 lrc: 6/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973509 expref: 63 pid: 6519 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217032.675991:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f9bf6 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973509 expref: 63 pid: 6519 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217032.676020:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff952d426a0300) 00010000:00010000:3.0:1782217032.676026:0:8449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121cc00/0x92b8e04cbf5f9c2e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217032.676038:0:8449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121cc00/0x92b8e04cbf5f9c2e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217032.676046:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121cc00/0x92b8e04cbf5f9c2e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217032.676089:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217032.676161:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:24a87249-c61f-41a1-85ec-9a313129e739+63:2403:x1868789693084416:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 214us (1281us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217032.676171:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 71 00000100:00100000:0.0:1782217032.677513:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e51f75d80 going to sleep for 11 seconds 00010000:00010000:0.0:1782217032.677564:0:6518:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.30@tcp) returned -22 from blocking AST (req@00000000dfd003ee x1868789713078784) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f9c20 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973517 expref: 62 pid: 6518 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217032.680991:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f9c20 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973517 expref: 62 pid: 6518 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217032.681035:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7f6c0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1868789713078784:192.168.203.30@tcp:104: 00010000:00010000:0.0:1782217032.681086:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5f9bf6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973509 expref: 61 pid: 6519 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217032.681139:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7f6c1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1868789713078912:192.168.203.30@tcp:104: 00010000:00010000:0.0:1782217032.681174:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff952d426a0300) 00010000:00010000:0.0:1782217032.681185:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121cc00/0x92b8e04cbf5f9c2e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217032.681195:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121cc00/0x92b8e04cbf5f9c2e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217032.681200:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121cc00/0x92b8e04cbf5f9c2e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782217032.681229:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1782217032.681527:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9c27 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97351e expref: 62 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217032.681549:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121cc00/0x92b8e04cbf5f9c2e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97351e expref: 61 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217032.681557:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff952d426a0300) 00010000:00010000:0.0:1782217032.681560:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1782217032.681562:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e4121cc00, rc 0) 00000100:00100000:0.0:1782217032.681921:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c797800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+61:11399:x1868789693084160:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 17641us (18214us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1782217032.681932:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 121 00000100:00100000:1.0:1782217032.686475:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217032.686642:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693084672 00000100:00100000:0.0:1782217032.686655:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693084672 00000100:00100000:0.0:1782217032.686737:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:0.0:1782217032.686767:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24a87249-c61f-41a1-85ec-9a313129e739+61:11399:x1868789693084672:12345-192.168.203.30@tcp:103:lfs.0 00010000:00010000:0.0:1782217032.686798:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217032.686830:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9b7f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734ed expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217032.686854:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff952d426a0300) 00010000:00010000:0.0:1782217032.687061:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217032.687147:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24a87249-c61f-41a1-85ec-9a313129e739+60:11399:x1868789693084672:12345-192.168.203.30@tcp:103:lfs.0 Request processed in 382us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217032.687156:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:2.0:1782217032.690508:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217032.693330:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693084800 00000100:00100000:1.0:1782217032.693353:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693084800 00000100:00100000:1.0:1782217032.693465:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 122 00000100:00100000:1.0:1782217032.693478:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c796d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+60:11399:x1868789693084800:12345-192.168.203.30@tcp:58:lfs.0 00010000:00010000:1.0:1782217032.693918:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9c3c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.693941:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9c3c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.693955:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9c3c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782217032.694091:0:6548:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1782217032.694220:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c796d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+60:11399:x1868789693084800:12345-192.168.203.30@tcp:58:lfs.0 Request processed in 743us (3725us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217032.694229:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 122 00000100:00100000:2.0:1782217032.701397:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217032.701811:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693084928 00000100:00100000:1.0:1782217032.701824:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693084928 00000100:00100000:1.0:1782217032.702064:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 123 00000100:00100000:1.0:1782217032.702077:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4268e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+60:11399:x1868789693084928:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1782217032.702104:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217032.702132:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072000/0x92b8e04cbf5f9c43 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973525 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.702232:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9c3c lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.702244:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072000/0x92b8e04cbf5f9c43 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973525 expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.702266:0:6520:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9c3c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.702280:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072000/0x92b8e04cbf5f9c43 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973525 expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.702295:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff952d426a0300) 00010000:00010000:1.0:1782217032.702299:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782217032.702302:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072000/0x92b8e04cbf5f9c43 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973525 expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217032.702318:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43072000, rc 0) 00000100:00100000:1.0:1782217032.702397:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4268e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+61:11399:x1868789693084928:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 322us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217032.702405:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 123 00010000:00010000:2.0:1782217033.208946:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782217033.338195:0:13796:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782217033.338210:0:13796:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782217033.338268:0:13796:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1782217033.338281:0:13796:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1782217033.338464:0:13796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df7100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13796:1868789713079040:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1782217033.340254:0:13796:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43787180 going to sleep for 11 seconds 00000100:00100000:2.0:1782217033.345411:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217033.345628:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693085056 00000100:00100000:0.0:1782217033.345640:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693085056 00000100:00100000:0.0:1782217033.345738:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 124 00000100:00100000:0.0:1782217033.345750:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4268c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+62:11400:x1868789693085056:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1782217033.345827:0:6519:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1782217033.345993:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4268c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+62:11400:x1868789693085056:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 244us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217033.346001:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 124 00000100:00100000:1.0:1782217033.347718:0:13796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df7100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13796:1868789713079040:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00080000:2.0:1782217033.347906:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782217033.355038:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217033.359231:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693085184 00000100:00100000:0.0:1782217033.359252:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693085184 00000100:00100000:0.0:1782217033.359343:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 125 00000100:00100000:0.0:1782217033.359355:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+61:11400:x1868789693085184:12345-192.168.203.30@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1782217033.359452:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9c4a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.359473:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9c4a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.359910:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9c4a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.359938:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9c51 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.359946:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9c51 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.359954:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9c51 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.359983:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d800/0x92b8e04cbf5f9c58 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.359994:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d800/0x92b8e04cbf5f9c58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.360001:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d800/0x92b8e04cbf5f9c58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782217033.360065:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1782217033.360070:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782217033.360086:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d800/0x92b8e04cbf5f9c58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.360339:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9c4a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.360347:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9c4a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.360369:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9c4a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.360375:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121d600 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782217033.360380:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9c4a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.360389:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9c4a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.360406:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff952e7b201600) 00010000:00010000:0.0:1782217033.360409:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217033.360415:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9c4a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.360422:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9c4a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.360438:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9c51 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.360445:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9c51 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.360451:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9c51 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.360456:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121c600 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782217033.360459:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9c51 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.360477:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9c51 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.360486:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff952d426a0000) 00010000:00010000:0.0:1782217033.360488:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217033.360491:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9c51 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.361330:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9c51 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.361363:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d800/0x92b8e04cbf5f9c58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.361371:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d800/0x92b8e04cbf5f9c58 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.361377:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d800/0x92b8e04cbf5f9c58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.361384:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121d800 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782217033.361387:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d800/0x92b8e04cbf5f9c58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.361395:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d800/0x92b8e04cbf5f9c58 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.361408:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff952d426a0300) 00010000:00010000:0.0:1782217033.361411:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217033.361415:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d800/0x92b8e04cbf5f9c58 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.361437:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d800/0x92b8e04cbf5f9c58 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217033.362214:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+61:11400:x1868789693085184:12345-192.168.203.30@tcp:34:lhsmtool_posix.0 Request processed in 2847us (7176us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217033.362232:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 125 00000100:00100000:2.0:1782217033.367245:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217033.368018:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693085440 00000100:00100000:0.0:1782217033.368035:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693085440 00000100:00100000:0.0:1782217033.368117:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 126 00000100:00100000:0.0:1782217033.368128:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43f40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+61:11400:x1868789693085440:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782217033.368156:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217033.368182:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c000/0x92b8e04cbf5f9c5f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be97352c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.371986:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9c66 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.372016:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9c66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.372031:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9c66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782217033.372051:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1782217033.372173:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9c66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.372181:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9c66 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.372213:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9c66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.372219:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121da00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782217033.372223:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9c66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.372231:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9c66 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.372245:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff952d426a0300) 00010000:00010000:0.0:1782217033.372248:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782217033.372253:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9c66 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.372259:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9c66 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.372327:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c000/0x92b8e04cbf5f9c5f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97352c expref: 63 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.372340:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff952e7b201600) 00010000:00010000:0.0:1782217033.372342:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782217033.372347:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c000/0x92b8e04cbf5f9c5f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97352c expref: 63 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.372357:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e4121c000, rc 0) 00000100:00100000:0.0:1782217033.372444:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43f40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+62:11400:x1868789693085440:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 4316us (5213us total) trans 4294967400 rc 301/301 00000100:00100000:0.0:1782217033.372463:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 126 00000100:00100000:3.0:1782217033.377775:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217033.378357:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693085568 00000100:00100000:1.0:1782217033.378371:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693085568 00000100:00100000:1.0:1782217033.378447:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 127 00000100:00100000:1.0:1782217033.378458:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+62:11400:x1868789693085568:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1782217033.378505:0:6520:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1782217033.378690:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+62:11400:x1868789693085568:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 233us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217033.378699:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 127 00000100:00100000:2.0:1782217033.383571:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217033.383647:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693085824 00000100:00100000:0.0:1782217033.383813:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693085824 00000100:00100000:0.0:1782217033.383886:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 128 00000100:00100000:0.0:1782217033.383897:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43f41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+62:11400:x1868789693085824:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782217033.383933:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217033.383937:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1782217033.383973:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5f9c04 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973510 expref: 62 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.383997:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff952e6105ce00) 00010000:00010000:0.0:1782217033.384003:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782217033.384020:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d800/0x92b8e04cbf5f9c74 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973533 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782217033.384499:0:6519:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:0.0:1782217033.384711:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9c7b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.384726:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9c7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.384736:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9c7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.384805:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d800/0x92b8e04cbf5f9c74 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973533 expref: 64 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.384846:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9c7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973533 expref: 63 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.384854:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff952d426a0000) 00010000:00010000:0.0:1782217033.384857:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782217033.384859:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e4121c600, rc 0) 00000100:00100000:0.0:1782217033.384938:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43f41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+63:11400:x1868789693085824:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 1043us (1384us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1782217033.384947:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 128 00000100:00100000:2.0:1782217033.395852:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217033.399378:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693086080 00000100:00100000:1.0:1782217033.399398:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693086080 00000100:00100000:1.0:1782217033.399497:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 129 00000100:00100000:1.0:1782217033.399510:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43f42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+63:11400:x1868789693086080:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1782217033.399619:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782217033.399667:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9c7b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973533 expref: 63 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217033.399693:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff952d426a0000) 00010000:00010000:1.0:1782217033.399708:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782217033.399737:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5f9c89 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217033.399752:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5f9c89 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217033.399764:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5f9c89 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217033.399790:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9c90 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xeb27e385 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217033.399798:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9c90 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xeb27e385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217033.399805:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9c90 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xeb27e385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217033.401270:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5f9c89 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217033.401360:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5f9c89 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217033.401369:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5f9c89 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217033.401376:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43073e00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217033.401401:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5f9c89 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217033.401412:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5f9c89 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217033.401430:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff952e6105ce00) 00010000:00010000:1.0:1782217033.401434:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217033.401439:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5f9c89 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217033.401446:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5f9c89 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217033.401464:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9c90 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xeb27e385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217033.401471:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9c90 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xeb27e385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217033.401477:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9c90 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xeb27e385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217033.401483:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43073400 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217033.401487:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9c90 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xeb27e385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217033.401493:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9c90 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xeb27e385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217033.401501:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xeb27e385 (ffff952e6105c400) 00010000:00010000:1.0:1782217033.401503:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217033.401518:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9c90 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xeb27e385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217033.401524:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9c90 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xeb27e385 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217033.401756:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43f42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+62:11400:x1868789693086080:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 2244us (5914us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782217033.401768:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 129 00000100:00100000:2.0:1782217033.414448:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217033.414562:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693086208 00000100:00100000:0.0:1782217033.414576:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693086208 00000100:00100000:0.0:1782217033.414767:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 130 00000100:00100000:0.0:1782217033.414789:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43f42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+62:11400:x1868789693086208:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782217033.414818:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217033.414846:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d800/0x92b8e04cbf5f9c97 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be97353a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.414899:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c000/0x92b8e04cbf5f9c9e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.414916:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c000/0x92b8e04cbf5f9c9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.414930:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c000/0x92b8e04cbf5f9c9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.415079:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d800/0x92b8e04cbf5f9c97 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97353a expref: 64 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.415124:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c000/0x92b8e04cbf5f9c9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97353a expref: 63 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.415135:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff952d426a0a00) 00010000:00010000:0.0:1782217033.415139:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782217033.415143:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e4121c000, rc 0) 00000100:00100000:0.0:1782217033.415377:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43f42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+63:11400:x1868789693086208:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 598us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217033.415386:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 130 00000100:00100000:2.0:1782217033.420570:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217033.420734:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693086464 00000100:00100000:0.0:1782217033.420747:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693086464 00000100:00100000:0.0:1782217033.420823:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 131 00000100:00100000:0.0:1782217033.420836:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43f42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+63:11400:x1868789693086464:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1782217033.420960:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9ca5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.420983:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9ca5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.420996:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9ca5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782217033.421373:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:0.0:1782217033.421386:0:6518:0:(osp_sync.c:1862:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 396404802236ns, next at 397404798770ns, rc = 0 00000004:00010000:0.0:1782217033.421452:0:6518:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a5150367 reply state 0000000051e9b53b transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9ca5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.421492:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9ca5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.421500:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff952d426a0a00) 00010000:00010000:0.0:1782217033.421503:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1782217033.421508:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782217033.421669:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43f42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+65:11400:x1868789693086464:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 835us (1111us total) trans 4294967402 rc 0/0 00000100:00100000:0.0:1782217033.421678:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 131 00000100:00100000:3.0:1782217033.429161:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217033.429401:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693086592 00000100:00100000:1.0:1782217033.429415:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693086592 00000100:00100000:1.0:1782217033.429483:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 132 00000100:00100000:1.0:1782217033.429493:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+65:11400:x1868789693086592:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782217033.429523:0:6548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217033.429548:0:6548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9cac lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973541 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217033.429658:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9cac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973541 expref: 66 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217033.429675:0:6548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9cac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973541 expref: 66 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217033.429697:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff952d426a0a00) 00010000:00010000:1.0:1782217033.429700:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782217033.429704:0:6548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43073400, rc 0) 00000100:00100000:1.0:1782217033.429770:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+66:11400:x1868789693086592:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 278us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217033.429788:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 132 00000100:00100000:3.0:1782217033.433701:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217033.435014:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693086720 00000100:00100000:2.0:1782217033.435033:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693086720 00000100:00100000:2.0:1782217033.435149:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 45 00000100:00100000:2.0:1782217033.435162:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:24a87249-c61f-41a1-85ec-9a313129e739+8:2403:x1868789693086720:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1782217033.435464:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:24a87249-c61f-41a1-85ec-9a313129e739+9:2403:x1868789693086720:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 Request processed in 304us (1775us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1782217033.435473:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 45 00000100:00080000:1.0:1782217033.435567:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782217033.438045:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217033.438260:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693086976 00000100:00100000:1.0:1782217033.438272:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693086976 00000100:00100000:1.0:1782217033.438395:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 30 00000100:00100000:1.0:1782217033.438408:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43f41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24a87249-c61f-41a1-85ec-9a313129e739+66:11400:x1868789693086976:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1782217033.438769:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43f41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24a87249-c61f-41a1-85ec-9a313129e739+67:11400:x1868789693086976:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 364us (737us total) trans 4294967403 rc 0/0 00000100:00100000:1.0:1782217033.438775:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 30 00000100:00100000:0.0:1782217033.441276:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217033.441474:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693087232 00000100:00100000:2.0:1782217033.441487:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693087232 00000100:00100000:2.0:1782217033.441560:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 133 00000100:00100000:2.0:1782217033.441572:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7f6c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+67:11400:x1868789693087232:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1782217033.441740:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7f6c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+67:11400:x1868789693087232:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 170us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217033.441747:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 133 00000100:00100000:3.0:1782217033.443874:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217033.444155:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693087360 00000100:00100000:0.0:1782217033.444168:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693087360 00000100:00100000:0.0:1782217033.444242:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 134 00000100:00100000:0.0:1782217033.444254:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+67:11400:x1868789693087360:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782217033.444280:0:6548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217033.444317:0:6548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9cb3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973548 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.444413:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121dc00/0x92b8e04cbf5f9cba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.444430:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121dc00/0x92b8e04cbf5f9cba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.444443:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121dc00/0x92b8e04cbf5f9cba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782217033.444501:0:6548:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782217033.445012:0:6548:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121dc00/0x92b8e04cbf5f9cba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.445058:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9cb3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973548 expref: 69 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.445087:0:6548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121dc00/0x92b8e04cbf5f9cba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973548 expref: 68 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.445097:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff952d426a0a00) 00010000:00010000:0.0:1782217033.445101:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1782217033.445107:0:6548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e4121dc00, rc 0) 00000100:00100000:0.0:1782217033.445294:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+68:11400:x1868789693087360:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 1042us (1441us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217033.445304:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 134 00000100:00100000:2.0:1782217033.448836:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217033.448987:0:10025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693087488 00000100:00100000:0.0:1782217033.449000:0:10025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693087488 00000100:00100000:0.0:1782217033.449117:0:10025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 46 00000100:00100000:0.0:1782217033.449129:0:10025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43f40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:24a87249-c61f-41a1-85ec-9a313129e739+9:2403:x1868789693087488:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782217033.449153:0:10025:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217033.449180:0:10025:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1f9c6d7/0x92b8e04cbf5f9cc1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be97354f expref: -99 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782217033.449224:0:10025:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a3a7949, blocks: 0x0 00010000:00010000:0.0:1782217033.449248:0:10025:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=396s v=(0 0) 00010000:00010000:0.0:1782217033.449253:0:10025:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217033.449264:0:10025:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1f9c6d7/0x92b8e04cbf5f9cc1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97354f expref: 10 pid: 10025 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.449318:0:10025:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e1f9c6d7/0x92b8e04cbf5f9cc1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97354f expref: 10 pid: 10025 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.449334:0:10025:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e4121de00, rc 0) 00000100:00100000:0.0:1782217033.449407:0:10025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43f40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:24a87249-c61f-41a1-85ec-9a313129e739+10:2403:x1868789693087488:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 279us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217033.449416:0:10025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 46 00000100:00100000:2.0:1782217033.451962:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217033.452389:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693087744 00000100:00100000:3.0:1782217033.452403:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693087744 00000100:00100000:2.0:1782217033.452803:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 135 00000100:00100000:2.0:1782217033.452834:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43f43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+68:11400:x1868789693087744:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1782217033.453075:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43f43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+68:11400:x1868789693087744:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 243us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217033.453084:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 135 00000100:00100000:3.0:1782217033.456000:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217033.456141:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693087872 00000100:00100000:2.0:1782217033.456153:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693087872 00000100:00100000:2.0:1782217033.456225:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 47 00000100:00100000:2.0:1782217033.456237:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:24a87249-c61f-41a1-85ec-9a313129e739+10:11400:x1868789693087872:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782217033.456263:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217033.456300:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff039d4c/0x92b8e04cbf5f9cc8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973556 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.456346:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1f9c6d7/0x92b8e04cbf5f9cc1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97354f expref: 11 pid: 10025 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.456357:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782217033.456361:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782217033.456367:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff039d4c/0x92b8e04cbf5f9cc8 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973556 expref: 11 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.456420:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e1f9c6d7/0x92b8e04cbf5f9cc1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97354f expref: 11 pid: 10025 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.456437:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e1f9c6d7/0x92b8e04cbf5f9cc1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97354f expref: 11 pid: 10025 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217033.456478:0:8434:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43f40700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8434:1868789713079168:192.168.203.30@tcp:104: 00000100:00100000:2.0:1782217033.456681:0:8434:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d42661e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782217033.460155:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217033.460391:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693088000 00000100:00100000:0.0:1782217033.460402:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693088000 00010000:00010000:0.0:1782217033.460456:0:8449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e1f9c6d7/0x92b8e04cbf5f9cc1 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97354f expref: 12 pid: 10025 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217033.460509:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 72 00000100:00100000:0.0:1782217033.460521:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:24a87249-c61f-41a1-85ec-9a313129e739+12:2403:x1868789693088000:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782217033.460539:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217033.460563:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e1f9c6d7/0x92b8e04cbf5f9cc1 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97354f expref: 12 pid: 10025 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.460577:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e1f9c6d7/0x92b8e04cbf5f9cc1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97354f expref: 12 pid: 10025 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.460710:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217033.460715:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217033.460725:0:8449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff039d4c/0x92b8e04cbf5f9cc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973556 expref: 12 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.460755:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff039d4c/0x92b8e04cbf5f9cc8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973556 expref: 12 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.460811:0:8449:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ff039d4c/0x92b8e04cbf5f9cc8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973556 expref: 12 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217033.460828:0:8449:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7f6c0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8449:1868789713079296:192.168.203.30@tcp:105: 00010000:00010000:2.0:1782217033.461070:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1f9c6d7/0x92b8e04cbf5f9cc1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97354f expref: 12 pid: 10025 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217033.461089:0:8434:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43f40700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8434:1868789713079168:192.168.203.30@tcp:104: 00010000:00010000:2.0:1782217033.461120:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff039d4c/0x92b8e04cbf5f9cc8 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973556 expref: 11 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.461131:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2d200, rc 0) 00000100:00100000:0.0:1782217033.461307:0:8449:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e51f75540 going to sleep for 11 seconds 00000100:00100000:2.0:1782217033.461775:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:24a87249-c61f-41a1-85ec-9a313129e739+11:11400:x1868789693087872:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 5537us (5786us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217033.461793:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 47 00000100:00100000:0.0:1782217033.474485:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217033.475483:0:8449:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7f6c0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8449:1868789713079296:192.168.203.30@tcp:105: 00010000:00010000:3.0:1782217033.475518:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217033.475744:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:24a87249-c61f-41a1-85ec-9a313129e739+10:2403:x1868789693088000:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 15224us (15603us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217033.475759:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 72 00000100:00100000:2.0:1782217033.477543:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693088128 00000100:00100000:2.0:1782217033.477573:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693088128 00002000:00100000:2.0:1782217033.477672:0:8438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff952e7f6c0000 x1868789693088128/t0(0) o4->24a87249-c61f-41a1-85ec-9a313129e739@192.168.203.30@tcp:284/0 lens 504/0 e 0 to 0 dl 1782217044 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782217033.477686:0:8438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff952e7f6c0000 with x1868789693088128 ext(0->12) 00002000:00010000:2.0:1782217033.477693:0:8438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff952e7f6c0000 00000100:00100000:2.0:1782217033.477737:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2 00000100:00100000:2.0:1782217033.477748:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7f6c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:24a87249-c61f-41a1-85ec-9a313129e739+10:2403:x1868789693088128:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1782217033.480120:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7f6c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:24a87249-c61f-41a1-85ec-9a313129e739+12:2403:x1868789693088128:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 Request processed in 2362us (5638us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1782217033.480152:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2 00002000:00100000:2.0:1782217033.480165:0:8438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff952e7f6c0000 x1868789693088128/t4294967309(0) o4->24a87249-c61f-41a1-85ec-9a313129e739@192.168.203.30@tcp:284/0 lens 504/448 e 0 to 0 dl 1782217044 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782217033.480176:0:8438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff952e7f6c0000 with x1868789693088128 ext(0->12) 00002000:00010000:2.0:1782217033.480183:0:8438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff952e7f6c0000 00000100:00100000:3.0:1782217033.482765:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217033.484564:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693088256 00000100:00100000:1.0:1782217033.484579:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693088256 00000100:00100000:1.0:1782217033.484687:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 136 00000100:00100000:1.0:1782217033.484698:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+68:11400:x1868789693088256:12345-192.168.203.30@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1782217033.498921:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967403 is committed 00000004:00080000:0.0:1782217033.498957:0:6498:0:(osp_sync.c:1827:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:0.0:1782217033.499003:0:6498:0:(osp_sync.c:1827:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:0.0:1782217033.499023:0:6498:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff952d426cc000 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1782217033.499029:0:6498:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff952e7c62e900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff952d426cc6c0 00000020:00080000:0.0:1782217033.499032:0:6498:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff952e7c62e000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff952d43724c00 00000004:00080000:0.0:1782217033.499069:0:6498:0:(osp_sync.c:1827:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1782217033.499104:0:6498:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff952e7c722e40 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1782217033.499107:0:6498:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff952e74d4bf00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff952e7c722cc0 00000020:00080000:0.0:1782217033.499110:0:6498:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff952e74d4b500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff952d43725800 00000020:00080000:0.0:1782217033.499152:0:6551:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1782217033.499256:0:6551:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1782217033.499337:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782217033.499364:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713079424:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782217033.499480:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+22:11400:x1868789693088256:12345-192.168.203.30@tcp:44:lhsmtool_posix.0 Request processed in 14775us (16722us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217033.499519:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 136 00000100:00100000:2.0:1782217033.499569:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782217033.499619:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43f42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713079680:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1782217033.499704:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217033.499770:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43f40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713079552:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782217033.499813:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217033.499813:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713079424 00000100:00100000:0.0:1782217033.499829:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713079424 00000100:00100000:1.0:1782217033.499868:0:10025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713079552 00000100:00100000:1.0:1782217033.499875:0:10025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713079552 00000100:00100000:0.0:1782217033.499897:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1782217033.499910:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1868789713079424:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782217033.499930:0:10025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1782217033.499940:0:10025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3648:x1868789713079552:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782217033.499973:0:10025:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00080000:0.0:1782217033.499973:0:8432:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:1.0:1782217033.500001:0:10025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383b62e5/0x92b8e04cbf5f9ccf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782217033.500017:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a3a7947, atime: 0x6a3a7948, ctime: 0x6a3a7947, blocks: 0x8 00010000:00010000:1.0:1782217033.500024:0:10025:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000371c0003/0x92b8e04cbf5f9a83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734ae expref: 11 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.500032:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cded8c73/0x92b8e04cbf5f9cd6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217033.500076:0:10025:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1782217033.500076:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=396s v=(0 0) 00010000:00010000:0.0:1782217033.500095:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217033.500096:0:10025:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782217033.500119:0:10025:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383b62e5/0x92b8e04cbf5f9ccf lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.500123:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cded8c73/0x92b8e04cbf5f9cd6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.500169:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cded8c73/0x92b8e04cbf5f9cd6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217033.500176:0:10025:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000371c0003/0x92b8e04cbf5f9a83 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734ae expref: 11 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.500203:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cded8c73/0x92b8e04cbf5f9cd6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217033.500211:0:10025:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000371c0003/0x92b8e04cbf5f9a83 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734ae expref: 11 pid: 8435 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.500228:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cded8c73/0x92b8e04cbf5f9cd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217033.500241:0:10025:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10025:1868789713079808:192.168.203.30@tcp:104: 00010000:00010000:0.0:1782217033.500260:0:8432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782217033.500304:0:10025:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d437873c0 going to sleep for 11 seconds 00000100:00080000:1.0:1782217033.500318:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782217033.500433:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217033.500461:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3648:x1868789713079424:12345-0@lo:6:osp-syn-1-0.0 Request processed in 551us (757us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1782217033.500468:0:8434:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1782217033.500484:0:8434:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1782217033.500488:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1782217033.500512:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713079680 00000100:00100000:0.0:1782217033.500517:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713079680 00000100:00100000:0.0:1782217033.500559:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1782217033.500569:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43f43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3650:x1868789713079680:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1782217033.500713:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1782217033.500718:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1782217033 00002000:00010000:0.0:1782217033.500720:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1782217033.500723:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1782217033 -> 1782217033 00002000:00010000:0.0:1782217033.500726:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1782217033.500769:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43f43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3650:x1868789713079680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 203us (337us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1782217033.500776:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:0.0:1782217033.500810:0:10336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782217033.500817:0:10336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cded8c73/0x92b8e04cbf5f9cd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.500826:0:10336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121ca00 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:0.0:1782217033.500831:0:10336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cded8c73/0x92b8e04cbf5f9cd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.500840:0:10336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cded8c73/0x92b8e04cbf5f9cd6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.500861:0:10336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cded8c73/0x92b8e04cbf5f9cd6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.500881:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cded8c73/0x92b8e04cbf5f9cd6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.500907:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217033.500909:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217033.500911:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217033.503409:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5f99cd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.503430:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5f99cd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.503439:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5f99cd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.503446:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43073000 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217033.503474:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5f99cd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.503483:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5f99cd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.503504:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff952e6105c800) 00010000:00010000:3.0:1782217033.503507:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217033.503513:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5f99cd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.503519:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5f99cd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782217033.503906:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff952d43df7100/2, rc 0, transno 4294967305 00000100:00100000:1.0:1782217033.503922:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713079424:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1782217033.504012:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff952d43f42680/2, rc 0, transno 4294967310 00000100:00100000:2.0:1782217033.504019:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43f42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713079680:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1782217033.504023:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072400/0x92b8e04cbf5f9a75 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.504035:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072400/0x92b8e04cbf5f9a75 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.504043:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072400/0x92b8e04cbf5f9a75 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.504049:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43072400 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217033.504053:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072400/0x92b8e04cbf5f9a75 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.504060:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072400/0x92b8e04cbf5f9a75 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.504072:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff952e6105c700) 00010000:00010000:3.0:1782217033.504075:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217033.504089:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072400/0x92b8e04cbf5f9a75 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.504096:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072400/0x92b8e04cbf5f9a75 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.504117:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9af3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.504134:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9af3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.504141:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9af3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.504147:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2cc00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217033.504150:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9af3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.504156:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9af3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.504164:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff952d410a7a00) 00010000:00010000:3.0:1782217033.504167:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217033.504170:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9af3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.504176:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9af3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.504187:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9b16 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.504202:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9b16 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.504208:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9b16 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.504213:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2c200 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217033.504216:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9b16 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.504223:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9b16 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.504232:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff952d410a7a00) 00010000:00010000:3.0:1782217033.504235:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217033.504238:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9b16 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.504244:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9b16 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.504262:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9be8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.504268:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9be8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.504274:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9be8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.504280:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43072200 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217033.504298:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9be8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.504305:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9be8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.504314:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff952d426a0300) 00010000:00010000:3.0:1782217033.504316:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217033.504320:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9be8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.504326:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9be8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.504338:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9ca5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.504345:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9ca5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.504351:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9ca5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.504356:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121da00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217033.504359:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9ca5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.504365:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9ca5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.504373:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff952d426a0a00) 00010000:00010000:3.0:1782217033.504375:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782217033.504384:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9ca5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.504390:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9ca5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217033.508472:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217033.508531:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693088384 00000100:00100000:2.0:1782217033.508557:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693088384 00000100:00100000:2.0:1782217033.508651:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 51 00000100:00100000:2.0:1782217033.508662:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7f6c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:24a87249-c61f-41a1-85ec-9a313129e739+12:2402:x1868789693088384:12345-192.168.203.30@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1782217033.511194:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:3.0:1782217033.511234:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:2.0:1782217033.511426:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7f6c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:24a87249-c61f-41a1-85ec-9a313129e739+7:2402:x1868789693088384:12345-192.168.203.30@tcp:16:lhsmtool_posix.0 Request processed in 2757us (2959us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217033.511439:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 51 00000100:00100000:0.0:1782217033.512566:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217033.512729:0:13731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693088512 00000100:00100000:3.0:1782217033.512740:0:13731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693088512 00010000:00010000:3.0:1782217033.512777:0:13731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000371c0003/0x92b8e04cbf5f9a83 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734ae expref: 7 pid: 8435 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217033.512816:0:13731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 73 00000100:00100000:3.0:1782217033.512825:0:13731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e6f92c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:24a87249-c61f-41a1-85ec-9a313129e739+7:2403:x1868789693088512:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782217033.512841:0:13731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217033.512847:0:13731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000371c0003/0x92b8e04cbf5f9a83 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734ae expref: 7 pid: 8435 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.513967:0:13731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000371c0003/0x92b8e04cbf5f9a83 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734ae expref: 7 pid: 8435 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.514000:0:13731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782217033.514005:0:13731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782217033.514010:0:13731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383b62e5/0x92b8e04cbf5f9ccf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.514020:0:13731:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383b62e5/0x92b8e04cbf5f9ccf lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.514058:0:13731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782217033.514944:0:10025:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000371c0003/0x92b8e04cbf5f9a83 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9734ae expref: 7 pid: 8435 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217033.514975:0:10025:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10025:1868789713079808:192.168.203.30@tcp:104: 00010000:00010000:1.0:1782217033.515008:0:10025:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000383b62e5/0x92b8e04cbf5f9ccf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217033.515043:0:10025:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000383b62e5/0x92b8e04cbf5f9ccf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217033.515050:0:10025:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383b62e5/0x92b8e04cbf5f9ccf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217033.515064:0:10025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000383b62e5/0x92b8e04cbf5f9ccf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217033.515072:0:10025:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000383b62e5/0x92b8e04cbf5f9ccf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217033.515096:0:10025:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782217033.515697:0:10025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3648:x1868789713079552:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15755us (15881us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1782217033.515710:0:10025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:1.0:1782217033.515755:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782217033.515763:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000383b62e5/0x92b8e04cbf5f9ccf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217033.515772:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43073a00 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:1.0:1782217033.515786:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000383b62e5/0x92b8e04cbf5f9ccf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217033.515797:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000383b62e5/0x92b8e04cbf5f9ccf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217033.515829:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000383b62e5/0x92b8e04cbf5f9ccf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217033.515836:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383b62e5/0x92b8e04cbf5f9ccf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217033.515918:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217033.515920:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217033.515922:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782217033.515956:0:3648:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1782217033.515963:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:1.0:1782217033.515986:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff952d43f42680, transno 4294967310 00000100:00100000:1.0:1782217033.516004:0:3648:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff952d43f40700 x1868789713079552/t4294967311(4294967311) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1782217049 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1782217033.516016:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff952d43f40700/2, rc 0, transno 4294967311 00000100:00100000:1.0:1782217033.516021:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43f40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713079552:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782217033.519866:0:13731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e6f92c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:24a87249-c61f-41a1-85ec-9a313129e739+6:2403:x1868789693088512:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 7020us (7297us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217033.519886:0:13731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 73 00000100:00100000:2.0:1782217033.519973:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217033.526536:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693088768 00000100:00100000:1.0:1782217033.526628:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693088768 00000100:00100000:1.0:1782217033.526726:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 137 00000100:00100000:1.0:1782217033.526742:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43f40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+16:11400:x1868789693088768:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1782217033.526829:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782217033.526865:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121dc00/0x92b8e04cbf5f9cba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973548 expref: 16 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217033.526893:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff952d426a0a00) 00010000:00010000:1.0:1782217033.526917:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782217033.528754:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9cdd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217033.528862:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9cdd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217033.528877:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9cdd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782217033.529247:0:6519:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f5012d5f reply state 0000000036fc5b9f transno 4294967404 ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9cdd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217033.529265:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9cdd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217033.529334:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff952d426a0a00) 00010000:00010000:1.0:1782217033.529337:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782217033.529341:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782217033.529750:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43f40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+17:11400:x1868789693088768:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 2942us (9716us total) trans 4294967404 rc 0/0 00000100:00100000:1.0:1782217033.529762:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 137 00000100:00100000:2.0:1782217033.547193:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217033.547298:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693088896 00000100:00100000:0.0:1782217033.547308:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693088896 00000100:00100000:0.0:1782217033.547382:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 52 00000100:00100000:0.0:1782217033.547392:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24a87249-c61f-41a1-85ec-9a313129e739+6:2403:x1868789693088896:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1782217033.547539:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1782217033.547543:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1782217033 -> 1782217032 00002000:00010000:0.0:1782217033.547545:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1782217032 00002000:00010000:0.0:1782217033.547547:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1782217033 -> 1782217032 00002000:00010000:0.0:1782217033.547549:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1782217033.547631:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24a87249-c61f-41a1-85ec-9a313129e739+7:2403:x1868789693088896:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 Request processed in 240us (447us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1782217033.547638:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 52 00000100:00100000:0.0:1782217033.551536:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217033.551654:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693089152 00000100:00100000:2.0:1782217033.551664:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693089152 00000100:00100000:2.0:1782217033.551722:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 138 00000100:00100000:2.0:1782217033.551731:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7f6c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+17:11400:x1868789693089152:12345-192.168.203.30@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1782217033.551827:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9ce4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.551844:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c000/0x92b8e04cbf5f9c9e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97353a expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.551855:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9ce4 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.551889:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c000/0x92b8e04cbf5f9c9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97353a expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.551902:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c000/0x92b8e04cbf5f9c9e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97353a expref: 17 pid: 6519 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217033.551916:0:6520:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43f40000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1868789713079936:192.168.203.30@tcp:104: 00000100:00100000:2.0:1782217033.552006:0:6520:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d42661000 going to sleep for 11 seconds 00000100:00100000:1.0:1782217033.555191:0:6520:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43f40000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1868789713079936:192.168.203.30@tcp:104: 00010000:00010000:1.0:1782217033.555217:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9ce4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217033.558148:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217033.558301:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693089280 00000100:00100000:1.0:1782217033.558313:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693089280 00010000:00010000:1.0:1782217033.558365:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c000/0x92b8e04cbf5f9c9e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97353a expref: 18 pid: 6519 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217033.558431:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 74 00000100:00100000:1.0:1782217033.558442:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7f6c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24a87249-c61f-41a1-85ec-9a313129e739+18:2402:x1868789693089280:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782217033.558460:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782217033.558468:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c000/0x92b8e04cbf5f9c9e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97353a expref: 18 pid: 6519 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217033.558483:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c000/0x92b8e04cbf5f9c9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97353a expref: 18 pid: 6519 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217033.558508:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c000/0x92b8e04cbf5f9c9e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97353a expref: 18 pid: 6519 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217033.558530:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff952d426a0a00) 00010000:00010000:1.0:1782217033.558536:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9ce4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217033.558563:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9ce4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217033.558573:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9ce4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217033.558669:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782217033.558736:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7f6c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24a87249-c61f-41a1-85ec-9a313129e739+17:2402:x1868789693089280:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 295us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217033.558745:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 74 00010000:00010000:0.0:1782217033.559532:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9ce4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.559558:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9ce4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.559639:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9ce4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.559648:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9ce4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.559655:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9ce4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.559661:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2d000 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782217033.559665:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9ce4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.559673:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9ce4 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.559687:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff952d426a0a00) 00010000:00010000:0.0:1782217033.559691:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1782217033.559694:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9ce4 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.559701:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9ce4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217033.559794:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7f6c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+16:11400:x1868789693089152:12345-192.168.203.30@tcp:55:lhsmtool_posix.0 Request processed in 8059us (8265us total) trans 0 rc -22/-22 00000100:00100000:0.0:1782217033.559823:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 138 00000100:00100000:0.0:1782217033.566341:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217033.566627:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693089408 00000100:00100000:3.0:1782217033.566641:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693089408 00000100:00100000:3.0:1782217033.566715:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 53 00000100:00100000:3.0:1782217033.566727:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7f6c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:24a87249-c61f-41a1-85ec-9a313129e739+7:2403:x1868789693089408:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1782217033.566800:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005da6ed1a/0x92b8e04cbf5f9ceb lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.566827:0:14273:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff039d4c/0x92b8e04cbf5f9cc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973556 expref: 7 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.566838:0:14273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217033.566842:0:14273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782217033.566847:0:14273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005da6ed1a/0x92b8e04cbf5f9ceb lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.567129:0:14273:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ff039d4c/0x92b8e04cbf5f9cc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973556 expref: 7 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.567147:0:14273:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ff039d4c/0x92b8e04cbf5f9cc8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973556 expref: 7 pid: 8434 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217033.567165:0:14273:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43d90e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14273:1868789713080064:192.168.203.30@tcp:104: 00000100:00100000:3.0:1782217033.567327:0:14273:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d426cca80 going to sleep for 11 seconds 00000100:00100000:3.0:1782217033.573872:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217033.573928:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693089536 00000100:00100000:3.0:1782217033.573938:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693089536 00010000:00010000:3.0:1782217033.574097:0:8449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ff039d4c/0x92b8e04cbf5f9cc8 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973556 expref: 8 pid: 8434 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217033.574228:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 75 00000100:00100000:3.0:1782217033.574240:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:24a87249-c61f-41a1-85ec-9a313129e739+8:2403:x1868789693089536:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782217033.574260:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217033.574737:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ff039d4c/0x92b8e04cbf5f9cc8 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973556 expref: 8 pid: 8434 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.574755:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ff039d4c/0x92b8e04cbf5f9cc8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973556 expref: 8 pid: 8434 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.574802:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782217033.574807:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782217033.574815:0:8449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005da6ed1a/0x92b8e04cbf5f9ceb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.574827:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005da6ed1a/0x92b8e04cbf5f9ceb lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.574860:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217033.574932:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:24a87249-c61f-41a1-85ec-9a313129e739+8:2403:x1868789693089536:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 693us (1076us total) trans 0 rc 0/0 00010000:00010000:2.0:1782217033.576943:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff039d4c/0x92b8e04cbf5f9cc8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973556 expref: 8 pid: 8434 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217033.576970:0:14273:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43d90e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14273:1868789713080064:192.168.203.30@tcp:104: 00010000:00010000:2.0:1782217033.576992:0:14273:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005da6ed1a/0x92b8e04cbf5f9ceb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.577003:0:14273:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005da6ed1a/0x92b8e04cbf5f9ceb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.577035:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005da6ed1a/0x92b8e04cbf5f9ceb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.577065:0:14273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005da6ed1a/0x92b8e04cbf5f9ceb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.577073:0:14273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005da6ed1a/0x92b8e04cbf5f9ceb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.577081:0:14273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005da6ed1a/0x92b8e04cbf5f9ceb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.577088:0:14273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362c00 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:2.0:1782217033.577092:0:14273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005da6ed1a/0x92b8e04cbf5f9ceb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.577100:0:14273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005da6ed1a/0x92b8e04cbf5f9ceb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.577123:0:14273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005da6ed1a/0x92b8e04cbf5f9ceb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.577130:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005da6ed1a/0x92b8e04cbf5f9ceb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217033.577225:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7f6c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:24a87249-c61f-41a1-85ec-9a313129e739+7:2403:x1868789693089408:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 Request processed in 10499us (10899us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217033.577234:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 53 00000100:00100000:3.0:1782217033.577532:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 75 00000100:00100000:1.0:1782217033.582917:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217033.583398:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693089792 00000100:00100000:2.0:1782217033.583412:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693089792 00000100:00100000:2.0:1782217033.583532:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 139 00000100:00100000:2.0:1782217033.583559:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+16:11400:x1868789693089792:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1782217033.583699:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f9cf2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.583721:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9be1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973502 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.583733:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f9cf2 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.583791:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9be1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973502 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.583808:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9be1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973502 expref: 16 pid: 6518 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217033.583826:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43f41180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1868789713080192:192.168.203.30@tcp:104: 00000100:00100000:2.0:1782217033.583937:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d42661540 going to sleep for 11 seconds 00000100:00100000:3.0:1782217033.587400:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217033.588015:0:13731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693089920 00000100:00100000:0.0:1782217033.588028:0:13731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693089920 00010000:00010000:0.0:1782217033.588078:0:13731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9be1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973502 expref: 17 pid: 6518 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217033.588185:0:13731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 76 00000100:00100000:0.0:1782217033.588198:0:13731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:24a87249-c61f-41a1-85ec-9a313129e739+17:2402:x1868789693089920:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782217033.588419:0:13731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217033.588430:0:13731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9be1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973502 expref: 17 pid: 6518 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.588445:0:13731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9be1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973502 expref: 17 pid: 6518 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.588473:0:13731:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff952d426a0300) 00010000:00010000:0.0:1782217033.588480:0:13731:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072000/0x92b8e04cbf5f9c43 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973525 expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.588492:0:13731:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f9cf2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.588501:0:13731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f9cf2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.588510:0:13731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f9cf2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.588547:0:13731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782217033.588727:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9be1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973502 expref: 17 pid: 6518 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217033.589069:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43f41180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1868789713080192:192.168.203.30@tcp:104: 00010000:00010000:2.0:1782217033.589097:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f9cf2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.589107:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f9cf2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.589114:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f9cf2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217033.589598:0:13731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:24a87249-c61f-41a1-85ec-9a313129e739+16:2402:x1868789693089920:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 1385us (2196us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217033.589610:0:13731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 76 00010000:00010000:2.0:1782217033.590011:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9cf9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.590029:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9cac lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973541 expref: 16 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.590039:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9cf9 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.590081:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9cac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973541 expref: 16 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.590099:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9cac lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973541 expref: 16 pid: 6548 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217033.590114:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43f41180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1868789713080320:192.168.203.30@tcp:104: 00000100:00100000:2.0:1782217033.590425:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d42661cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782217033.595558:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43f41180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1868789713080320:192.168.203.30@tcp:104: 00010000:00010000:2.0:1782217033.595639:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9cf9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217033.596904:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217033.597067:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693090048 00000100:00100000:2.0:1782217033.597078:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693090048 00010000:00010000:2.0:1782217033.597134:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9cac lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973541 expref: 17 pid: 6548 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217033.597177:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 77 00000100:00100000:2.0:1782217033.597187:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24a87249-c61f-41a1-85ec-9a313129e739+17:2403:x1868789693090048:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782217033.597205:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217033.597221:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9cac lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973541 expref: 17 pid: 6548 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.597236:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9cac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973541 expref: 17 pid: 6548 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.597262:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9cac lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973541 expref: 17 pid: 6548 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.597288:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff952d426a0a00) 00010000:00010000:2.0:1782217033.597295:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9cf9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.597305:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9cf9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.597314:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9cf9 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.597358:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217033.597421:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24a87249-c61f-41a1-85ec-9a313129e739+16:2403:x1868789693090048:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 235us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217033.597430:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 77 00010000:00010000:3.0:1782217033.601018:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9cf9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.601038:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9cf9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782217033.601199:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:3.0:1782217033.601844:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000001:00080000:3.0:1782217033.601958:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:3.0:1782217033.602069:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43d92300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6518:1868789713080448:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1782217033.602478:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217033.602616:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d426cca80 going to sleep for 11 seconds 00000100:00100000:1.0:1782217033.603917:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713080448 00000100:00100000:1.0:1782217033.603934:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713080448 00000100:00100000:0.0:1782217033.604147:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1782217033.604159:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6518:x1868789713080448:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1782217033.604431:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6518:x1868789713080448:12345-0@lo:1000:mdt00_000.0 Request processed in 273us (1953us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217033.604439:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1782217033.604521:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43d92300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6518:1868789713080448:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1782217033.604733:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967408 00000100:00100000:3.0:1782217033.604834:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43d92300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6518:1868789713080576:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1782217033.604892:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217033.605574:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d426cc0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782217033.605724:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713080576 00000100:00100000:2.0:1782217033.605733:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713080576 00000100:00100000:2.0:1782217033.605790:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1782217033.605801:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6518:x1868789713080576:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1782217033.605990:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6518:x1868789713080576:12345-0@lo:1000:mdt00_000.0 Request processed in 190us (1096us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1782217033.605998:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1782217033.606144:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43d92300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6518:1868789713080576:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1782217033.606196:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9cf9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.606478:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9cf9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.606488:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9cf9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.606496:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2c000 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217033.606501:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9cf9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.606532:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9cf9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.606554:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff952d426a0a00) 00010000:00010000:3.0:1782217033.606557:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782217033.606564:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9cf9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.606570:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9cf9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.606634:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9c3c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.606642:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9c3c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.606649:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9c3c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.606654:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43072e00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217033.606657:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9c3c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.606663:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9c3c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.606672:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff952d426a0300) 00010000:00010000:3.0:1782217033.606674:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782217033.606682:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072000/0x92b8e04cbf5f9c43 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973525 expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.606706:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072000/0x92b8e04cbf5f9c43 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973525 expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.606717:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072000/0x92b8e04cbf5f9c43 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973525 expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.606756:0:6518:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072000/0x92b8e04cbf5f9c43 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973525 expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217033.606770:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43d93480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1868789713080704:192.168.203.30@tcp:105: 00000100:00100000:3.0:1782217033.606941:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d426cc0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782217033.613462:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217033.613968:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693090176 00000100:00100000:1.0:1782217033.613980:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693090176 00000100:00100000:1.0:1782217033.614053:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 31 00000100:00100000:1.0:1782217033.614066:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7f6c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+20:11399:x1868789693090176:12345-192.168.203.30@tcp:49:lfs.0 00000100:00100000:1.0:1782217033.614246:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7f6c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+20:11399:x1868789693090176:12345-192.168.203.30@tcp:49:lfs.0 Request processed in 182us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217033.614255:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 31 00000100:00100000:3.0:1782217033.615053:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43d93480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1868789713080704:192.168.203.30@tcp:105: 00010000:00010000:3.0:1782217033.615088:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9c3c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.615101:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9c3c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.615157:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5f9d00 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.615175:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5f9d00 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.615189:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5f9d00 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.615201:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5f9d00 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.615351:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5f9d00 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.615358:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5f9d00 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.615364:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362a00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217033.615369:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5f9d00 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.615378:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5f9d00 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.615393:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff952d426a0300) 00010000:00010000:3.0:1782217033.615397:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217033.615401:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5f9d00 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.615407:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5f9d00 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.615420:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f9cf2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.615426:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f9cf2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.615433:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f9cf2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.615438:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2d200 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217033.615449:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f9cf2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.615456:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f9cf2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.615466:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff952d426a0300) 00010000:00010000:3.0:1782217033.615469:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1782217033.615472:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f9cf2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.615479:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f9cf2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217033.615695:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+19:11400:x1868789693089792:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 32150us (32845us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1782217033.615706:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 139 00000020:00080000:3.0:1782217033.615712:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1782217033.617572:0:13796:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782217033.617628:0:13796:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782217033.618150:0:13796:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1782217033.618162:0:13796:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782217033.620194:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217033.620556:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693090432 00000100:00100000:1.0:1782217033.620569:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693090432 00000100:00100000:1.0:1782217033.622362:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217033.622522:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693090688 00000100:00100000:2.0:1782217033.622533:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693090688 00000100:00100000:2.0:1782217033.622627:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 32 00000100:00100000:2.0:1782217033.622639:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e64f0a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+20:11400:x1868789693090688:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1782217033.623018:0:6521:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1782217033.623062:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967410 00010000:00010000:2.0:1782217033.623103:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9d07 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.623123:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9d07 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.623137:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9d07 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.623147:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9d07 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.623174:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9d07 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.623181:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9d07 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.623205:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782217033.623330:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e64f0a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+22:11400:x1868789693090688:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 690us (977us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1782217033.623340:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 32 00000020:00080000:2.0:1782217033.623347:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782217033.623900:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782217033.623910:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9d07 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.623920:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2d800 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:3.0:1782217033.623924:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9d07 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.623935:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9d07 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.623953:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff952d426a0a00) 00010000:00010000:3.0:1782217033.623956:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782217033.623972:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9d07 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.623979:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9d07 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.623997:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217033.623999:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217033.624000:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782217033.626486:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 140 00000100:00100000:0.0:1782217033.626512:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7f6c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+21:11399:x1868789693090432:12345-192.168.203.30@tcp:58:lfs.0 00000040:00080000:0.0:1782217033.626768:0:6548:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1782217033.626904:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7f6c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+21:11399:x1868789693090432:12345-192.168.203.30@tcp:58:lfs.0 Request processed in 403us (6722us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217033.626912:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 140 00000100:00100000:1.0:1782217033.659693:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217033.659811:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693090816 00000100:00100000:0.0:1782217033.659823:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693090816 00000100:00100000:0.0:1782217033.659898:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 141 00000100:00100000:0.0:1782217033.659910:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+21:11402:x1868789693090816:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1782217033.659943:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217033.659969:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9d0e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be97355d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.660089:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d800/0x92b8e04cbf5f9d15 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.660106:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d800/0x92b8e04cbf5f9d15 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.660119:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d800/0x92b8e04cbf5f9d15 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.660137:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9d1c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.660144:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9d1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.660151:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9d1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.660250:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c000/0x92b8e04cbf5f9d23 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.660262:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121cc00/0x92b8e04cbf5f9c2e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97351e expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.660272:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c000/0x92b8e04cbf5f9d23 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.660326:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121cc00/0x92b8e04cbf5f9c2e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97351e expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217033.660365:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121cc00/0x92b8e04cbf5f9c2e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97351e expref: 22 pid: 6518 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217033.660382:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7f6c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1868789713080832:192.168.203.30@tcp:104: 00000100:00100000:0.0:1782217033.660720:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e51f75000 going to sleep for 11 seconds 00000100:00100000:3.0:1782217033.664370:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217033.664556:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7f6c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1868789713080832:192.168.203.30@tcp:104: 00010000:00010000:0.0:1782217033.664692:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c000/0x92b8e04cbf5f9d23 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217033.664877:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693091072 00000100:00100000:2.0:1782217033.664886:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693091072 00000100:00100000:2.0:1782217033.664964:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 33 00000100:00100000:2.0:1782217033.664976:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+23:6170:x1868789693091072:12345-192.168.203.30@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1782217033.665303:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+24:6170:x1868789693091072:12345-192.168.203.30@tcp:35:ldlm_bl.0 Request processed in 327us (947us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1782217033.665312:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 33 00000100:00100000:1.0:1782217033.668833:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217033.668943:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693091200 00000100:00100000:3.0:1782217033.668956:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693091200 00010000:00010000:3.0:1782217033.669007:0:8449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121cc00/0x92b8e04cbf5f9c2e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97351e expref: 24 pid: 6518 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217033.669070:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 78 00000100:00100000:3.0:1782217033.669082:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:24a87249-c61f-41a1-85ec-9a313129e739+24:2403:x1868789693091200:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782217033.669102:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217033.669110:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121cc00/0x92b8e04cbf5f9c2e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97351e expref: 24 pid: 6518 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.669125:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121cc00/0x92b8e04cbf5f9c2e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97351e expref: 24 pid: 6518 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.669154:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121cc00/0x92b8e04cbf5f9c2e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97351e expref: 24 pid: 6518 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.669175:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff952d426a0300) 00010000:00010000:3.0:1782217033.669181:0:8449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c000/0x92b8e04cbf5f9d23 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.669224:0:8449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c000/0x92b8e04cbf5f9d23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.669233:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c000/0x92b8e04cbf5f9d23 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217033.669277:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217033.669359:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:24a87249-c61f-41a1-85ec-9a313129e739+23:2403:x1868789693091200:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 279us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217033.669368:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 78 00010000:00010000:2.0:1782217033.669973:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c000/0x92b8e04cbf5f9d23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.669986:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c000/0x92b8e04cbf5f9d23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217033.670065:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1782217033.670071:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782217033.670098:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c000/0x92b8e04cbf5f9d23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.670131:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c000/0x92b8e04cbf5f9d23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.670144:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d800/0x92b8e04cbf5f9d15 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.670152:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d800/0x92b8e04cbf5f9d15 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.670160:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d800/0x92b8e04cbf5f9d15 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.670168:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121d800 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782217033.670173:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d800/0x92b8e04cbf5f9d15 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.670181:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d800/0x92b8e04cbf5f9d15 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.670193:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff952e6105ce00) 00010000:00010000:2.0:1782217033.670197:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217033.670202:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d800/0x92b8e04cbf5f9d15 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.670221:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d800/0x92b8e04cbf5f9d15 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.670236:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9d1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.670242:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9d1c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.670255:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9d1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.670261:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121d600 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782217033.670264:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9d1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.670271:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9d1c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.670433:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff952d426a0600) 00010000:00010000:2.0:1782217033.670437:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217033.670441:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9d1c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.670448:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9d1c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.670498:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9d0e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97355d expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.670513:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c000/0x92b8e04cbf5f9d23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97355d expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217033.670521:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff952d426a0300) 00010000:00010000:2.0:1782217033.670524:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782217033.670526:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e4121c000, rc 0) 00000100:00100000:2.0:1782217033.670615:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+22:11402:x1868789693090816:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 10707us (10937us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217033.670633:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 141 00010000:00010000:3.0:1782217034.234102:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782217034.301120:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713080960:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782217034.301223:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217034.301563:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7f6c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713081088:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782217034.301714:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217034.302124:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713080960 00000100:00100000:1.0:1782217034.302134:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713080960 00000100:00100000:1.0:1782217034.302203:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713081088 00000100:00100000:1.0:1782217034.302206:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713081088 00000100:00100000:1.0:1782217034.302228:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1782217034.302238:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713080960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782217034.302269:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:1.0:1782217034.302330:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713080960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217034.302356:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1782217034.302378:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1782217034.302384:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7f6c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713081088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782217034.302408:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782217034.302441:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7f6c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713081088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217034.302448:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:1.0:1782217034.302473:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782217034.302477:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782217034.302524:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713080960:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782217034.303755:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7f6c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713081088:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782217034.307507:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43f41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713081344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782217034.307693:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217034.308214:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7f6c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17bce19a-7a0f-4c9d-b31c-4e0155298487:3648:1868789713081216:0@lo:400:kworker.0 00000100:00100000:0.0:1782217034.308266:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217034.308295:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7f6c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1868789713081728:0@lo:400:kworker.0 00000100:00100000:0.0:1782217034.308326:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217034.308344:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43feb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1868789713082240:0@lo:400:kworker.0 00000100:00100000:0.0:1782217034.308366:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217034.308390:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1782217034.308397:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7f6c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713081600:0@lo:400:kworker.0 00000100:00100000:0.0:1782217034.308424:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217034.308445:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c795500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1868789713082112:0@lo:400:kworker.0 00000100:00100000:0.0:1782217034.308468:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217034.308498:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43fead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713082624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782217034.308523:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217034.308681:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713081344 00000100:00100000:2.0:1782217034.308693:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713081344 00000100:00100000:2.0:1782217034.310519:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713082624 00000100:00100000:2.0:1782217034.310536:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713082624 00000100:00100000:0.0:1782217034.311088:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713081216 00000100:00100000:0.0:1782217034.311098:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713081216 00000100:00100000:0.0:1782217034.311166:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1782217034.311177:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3648:x1868789713081216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217034.311289:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3648:x1868789713081216:12345-0@lo:400:kworker.0 Request processed in 114us (3022us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217034.311297:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1782217034.311343:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713081728 00000100:00100000:0.0:1782217034.311347:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713081728 00000100:00100000:0.0:1782217034.311381:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713082240 00000100:00100000:0.0:1782217034.311385:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713082240 00000100:00100000:0.0:1782217034.311411:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713082112 00000100:00100000:0.0:1782217034.311414:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713082112 00000100:00100000:1.0:1782217034.311428:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7f6c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17bce19a-7a0f-4c9d-b31c-4e0155298487:3648:1868789713081216:0@lo:400:kworker.0 00000100:00100000:0.0:1782217034.311460:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1782217034.311469:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43feaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1868789713081728:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1782217034.311470:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782217034.311477:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782217034.311516:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43feaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1868789713081728:12345-0@lo:400:kworker.0 Request processed in 48us (3188us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217034.311523:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1782217034.311540:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7f6c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1868789713081728:0@lo:400:kworker.0 00000100:00100000:0.0:1782217034.311540:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1782217034.311633:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713081600 00000100:00100000:1.0:1782217034.311638:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713081600 00000100:00100000:1.0:1782217034.311671:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1782217034.311677:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fe9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713081600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217034.311739:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fe9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713081600:12345-0@lo:400:kworker.0 Request processed in 62us (3314us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217034.311746:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1782217034.311883:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1782217034.311890:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fe8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1868789713082112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217034.311945:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fe8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1868789713082112:12345-0@lo:400:kworker.0 Request processed in 56us (3477us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217034.311952:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1782217034.311979:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7f6c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1868789713081472:0@lo:400:kworker.0 00000100:00100000:1.0:1782217034.312021:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217034.312047:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4263fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1868789713081984:0@lo:400:kworker.0 00000100:00100000:1.0:1782217034.312072:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217034.312084:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1868789713082240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217034.312087:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43fe9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713082496:0@lo:400:kworker.0 00000100:00100000:1.0:1782217034.312128:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217034.312138:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1868789713082240:12345-0@lo:400:kworker.0 Request processed in 590us (3769us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217034.312146:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1782217034.312157:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1782217034.312162:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713081472 00000100:00100000:1.0:1782217034.312168:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7f6c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713081856:0@lo:400:kworker.0 00000100:00100000:0.0:1782217034.312168:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713081472 00000100:00100000:0.0:1782217034.312187:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713081984 00000100:00100000:0.0:1782217034.312196:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713081984 00000100:00100000:0.0:1782217034.312225:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1782217034.312231:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1868789713081472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217034.312261:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1868789713081472:12345-0@lo:400:kworker.0 Request processed in 30us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217034.312267:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1782217034.312278:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1782217034.312283:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7f6c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1868789713081984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217034.312308:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7f6c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1868789713081984:12345-0@lo:400:kworker.0 Request processed in 24us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217034.312313:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1782217034.312340:0:10535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1782217034.312349:0:10535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1868789713081344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782217034.312374:0:10535:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:0.0:1782217034.312410:0:10535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1868789713081344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (4719us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217034.312416:0:10535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1782217034.312431:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1782217034.312440:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43feb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1868789713082624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782217034.312452:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782217034.312491:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43feb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1868789713082624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (3966us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217034.312532:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1782217034.312641:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217034.312666:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43fe8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1868789713082368:0@lo:400:kworker.0 00000100:00080000:3.0:1782217034.312790:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782217034.312795:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782217034.312821:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217034.312860:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7f6c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1868789713081472:0@lo:400:kworker.0 00000100:00100000:1.0:1782217034.312872:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4263fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1868789713081984:0@lo:400:kworker.0 00000100:00100000:1.0:1782217034.312903:0:10025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713082496 00000100:00100000:1.0:1782217034.312966:0:10025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713082496 00000100:00100000:1.0:1782217034.313012:0:10025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1782217034.313020:0:10025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7f6c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3650:x1868789713082496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217034.313067:0:10025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7f6c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3650:x1868789713082496:12345-0@lo:400:kworker.0 Request processed in 48us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217034.313074:0:10025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1782217034.313097:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43fe9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713082496:0@lo:400:kworker.0 00000100:00100000:0.0:1782217034.313351:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713082368 00000100:00100000:0.0:1782217034.313356:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713082368 00000100:00100000:0.0:1782217034.313406:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1782217034.313413:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1868789713082368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217034.313451:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1868789713082368:12345-0@lo:400:kworker.0 Request processed in 39us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217034.313458:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1782217034.313562:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713081856 00000100:00100000:1.0:1782217034.313577:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713081856 00000100:00080000:3.0:1782217034.313671:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1782217034.313802:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43fe8e00 x1868789713082368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217050 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782217034.313815:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43fe8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1868789713082368:0@lo:400:kworker.0 00000100:00100000:0.0:1782217034.314019:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43f41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713081344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782217034.314036:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1782217034.314048:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713081856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217034.314065:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7f6c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713081600:0@lo:400:kworker.0 00010000:00080000:0.0:1782217034.314092:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7c795500 x1868789713082112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217050 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782217034.314104:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c795500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1868789713082112:0@lo:400:kworker.0 00000100:00100000:1.0:1782217034.314109:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713081856:12345-0@lo:400:kworker.0 Request processed in 64us (1466us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217034.314116:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1782217034.314242:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7f6c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713081856:0@lo:400:kworker.0 00000100:00100000:0.0:1782217034.314351:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43fead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713082624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782217034.314365:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43feb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1868789713082240:0@lo:400:kworker.0 00000040:00080000:3.0:1782217034.623390:0:14312:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782217034.623402:0:14312:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782217034.623564:0:14312:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1782217034.623573:0:14312:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1782217034.692795:0:13796:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782217034.692808:0:13796:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782217034.692866:0:13796:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1782217034.692877:0:13796:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782217034.693066:0:13796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43f41180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13796:1868789713082752:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1782217034.693192:0:13796:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d425be6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782217034.702470:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217034.702573:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693091328 00000100:00100000:2.0:1782217034.702577:0:13796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43f41180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13796:1868789713082752:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1782217034.702790:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693091328 00000100:00100000:3.0:1782217034.702860:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 142 00000100:00100000:3.0:1782217034.702870:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+22:11414:x1868789693091328:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1782217034.702905:0:6519:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1782217034.704389:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+22:11414:x1868789693091328:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 1511us (1923us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217034.704402:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 142 00000100:00100000:1.0:1782217034.715142:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217034.715384:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693091584 00000100:00100000:2.0:1782217034.715397:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693091584 00000100:00100000:2.0:1782217034.715474:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 143 00000100:00100000:2.0:1782217034.715496:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+22:11414:x1868789693091584:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782217034.715525:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217034.715550:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9d2a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973564 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217034.715712:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9d31 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217034.715731:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9d31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217034.715745:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9d31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217034.715759:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1782217034.718407:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9d2a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973564 expref: 25 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217034.718440:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9d31 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973564 expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217034.718450:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff952d426a0300) 00010000:00010000:2.0:1782217034.718453:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782217034.718458:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2d000, rc 0) 00000100:00100000:2.0:1782217034.718627:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+24:11414:x1868789693091584:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 3132us (3497us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1782217034.718638:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 143 00000100:00100000:1.0:1782217034.725502:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217034.725664:0:13731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693091712 00000100:00100000:2.0:1782217034.725678:0:13731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693091712 00000100:00100000:2.0:1782217034.725766:0:13731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00100000:2.0:1782217034.725788:0:13731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:24a87249-c61f-41a1-85ec-9a313129e739+24:2402:x1868789693091712:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782217034.725809:0:13731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217034.725841:0:13731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9d31 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973564 expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217034.725877:0:13731:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff952d426a0300) 00010000:00010000:2.0:1782217034.725883:0:13731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217034.725950:0:13731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:24a87249-c61f-41a1-85ec-9a313129e739+23:2402:x1868789693091712:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 163us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217034.725959:0:13731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00100000:2.0:1782217034.734823:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217034.736171:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693091968 00000100:00100000:0.0:1782217034.736188:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693091968 00000100:00100000:0.0:1782217034.736565:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 144 00000100:00100000:0.0:1782217034.736579:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43f41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+23:11414:x1868789693091968:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1782217034.736703:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9d3f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217034.736725:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9d3f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217034.736740:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9d3f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217034.736962:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9d3f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217034.736970:0:6548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9d3f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217034.736977:0:6548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9d3f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217034.736983:0:6548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121da00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782217034.737003:0:6548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9d3f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217034.737011:0:6548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9d3f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217034.737025:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff952d426a0300) 00010000:00010000:0.0:1782217034.737028:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782217034.737033:0:6548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9d3f lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217034.737040:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5f9d3f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217034.737185:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43f41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+24:11414:x1868789693091968:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 608us (2373us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1782217034.737194:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 144 00000040:00080000:2.0:1782217034.738516:0:13796:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782217034.738524:0:13796:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782217034.739123:0:13796:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1782217034.739134:0:13796:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782217034.742605:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217034.742676:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693092224 00000100:00100000:3.0:1782217034.742688:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693092224 00000100:00100000:3.0:1782217034.742749:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 34 00000100:00100000:3.0:1782217034.742759:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43feb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+24:11414:x1868789693092224:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1782217034.743111:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43feb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+25:11414:x1868789693092224:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 352us (539us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1782217034.743120:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 34 00000100:00100000:2.0:1782217034.809519:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782217034.809553:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43d90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713082880:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782217034.809737:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217034.810013:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713082880 00000100:00100000:3.0:1782217034.810024:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713082880 00000100:00100000:3.0:1782217034.810090:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1782217034.810102:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43f41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713082880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1782217034.810160:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1782217034.810287:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43f41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713082880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 187us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217034.810296:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1782217034.812172:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43d90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713082880:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1782217035.256824:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782217035.833686:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782217035.837448:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43f43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713083008:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782217035.837721:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217035.838094:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713083008 00000100:00100000:2.0:1782217035.838110:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713083008 00000100:00100000:2.0:1782217035.838175:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1782217035.838185:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713083008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782217035.838223:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1782217035.838301:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713083008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217035.838318:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1782217035.839712:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43f43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713083008:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1782217036.280948:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782217036.487847:0:14363:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782217036.487856:0:14363:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782217036.487887:0:14363:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1782217036.487894:0:14363:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782217036.676822:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217036.677019:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693092480 00000100:00100000:1.0:1782217036.677028:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693092480 00000100:00080000:3.0:1782217036.677089:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782217036.677109:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 145 00000100:00100000:1.0:1782217036.677119:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+25:11434:x1868789693092480:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1782217036.677141:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217036.677159:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5f9d46 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be97356b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217036.677267:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9d4d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217036.677282:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9d4d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217036.677293:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9d4d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782217036.677304:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1782217036.677402:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5f9d46 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97356b expref: 28 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217036.677437:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9d4d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97356b expref: 27 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217036.677446:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff952d426a0300) 00010000:00010000:1.0:1782217036.677449:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1782217036.677451:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43072600, rc 0) 00000100:00100000:1.0:1782217036.677507:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+27:11434:x1868789693092480:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 389us (694us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1782217036.677513:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 145 00000100:00100000:0.0:1782217036.683444:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217036.683816:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693092608 00000100:00100000:2.0:1782217036.683826:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693092608 00000100:00100000:2.0:1782217036.683889:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 146 00000100:00100000:2.0:1782217036.683899:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fe8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+27:11434:x1868789693092608:12345-192.168.203.30@tcp:54:lfs.0 00010000:00010000:2.0:1782217036.683965:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9d5b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217036.683981:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9d5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217036.683993:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9d5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217036.684028:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9d5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217036.684112:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9d5b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217036.684119:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9d5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217036.684125:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2cc00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782217036.684128:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9d5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217036.684135:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9d5b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217036.684147:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff952d426a0300) 00010000:00010000:2.0:1782217036.684219:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782217036.684226:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9d5b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217036.684233:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9d5b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217036.684312:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fe8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+27:11434:x1868789693092608:12345-192.168.203.30@tcp:54:lfs.0 Request processed in 413us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217036.684320:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 146 00000100:00100000:3.0:1782217036.824751:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217036.824967:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693092736 00000100:00100000:0.0:1782217036.824977:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693092736 00000100:00100000:0.0:1782217036.825102:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 54 00000100:00100000:0.0:1782217036.825114:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:24a87249-c61f-41a1-85ec-9a313129e739+6:2404:x1868789693092736:12345-192.168.203.30@tcp:101:cat.0 00010000:00010000:0.0:1782217036.825133:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217036.825166:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa3ca814/0x92b8e04cbf5f9d62 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973572 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782217036.825191:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a3a7948, atime: 0x6a3a7948, ctime: 0x6a3a7948, blocks: 0x8 00010000:00010000:0.0:1782217036.825210:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=399s v=(0 0) 00010000:00010000:0.0:1782217036.825215:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217036.825224:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa3ca814/0x92b8e04cbf5f9d62 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973572 expref: 7 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217036.825243:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000aa3ca814/0x92b8e04cbf5f9d62 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973572 expref: 7 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217036.825257:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e4121cc00, rc 0) 00000100:00100000:0.0:1782217036.825323:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:24a87249-c61f-41a1-85ec-9a313129e739+7:2404:x1868789693092736:12345-192.168.203.30@tcp:101:cat.0 Request processed in 211us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217036.825331:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 54 00000100:00080000:3.0:1782217036.828630:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782217036.831173:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217036.831435:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693092864 00000100:00100000:3.0:1782217036.831445:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693092864 00002000:00100000:3.0:1782217036.831497:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff952d43fec700 x1868789693092864/t0(0) o3->24a87249-c61f-41a1-85ec-9a313129e739@192.168.203.30@tcp:287/0 lens 488/0 e 0 to 0 dl 1782217047 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782217036.831509:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff952d43fec700 with x1868789693092864 ext(0->4095) 00002000:00010000:3.0:1782217036.831528:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff952d43fec700 00000100:00100000:3.0:1782217036.831565:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3 00000100:00100000:3.0:1782217036.831575:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:24a87249-c61f-41a1-85ec-9a313129e739+7:2405:x1868789693092864:12345-192.168.203.30@tcp:3:cat.0 00000100:00100000:3.0:1782217036.832480:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:24a87249-c61f-41a1-85ec-9a313129e739+7:2405:x1868789693092864:12345-192.168.203.30@tcp:3:cat.0 Request processed in 903us (1314us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1782217036.832490:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3 00002000:00100000:3.0:1782217036.832498:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff952d43fec700 x1868789693092864/t0(0) o3->24a87249-c61f-41a1-85ec-9a313129e739@192.168.203.30@tcp:287/0 lens 488/4536 e 0 to 0 dl 1782217047 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782217036.832507:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff952d43fec700 with x1868789693092864 ext(0->4095) 00002000:00010000:3.0:1782217036.832512:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff952d43fec700 00010000:00010000:3.0:1782217037.304833:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782217037.759572:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217037.759647:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217037.759676:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217037.759698:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217037.759716:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217037.759732:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217037.759765:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217037.759795:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693093248 00000100:00100000:1.0:1782217037.759803:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693093248 00000100:00100000:1.0:1782217037.759855:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693093760 00000100:00100000:1.0:1782217037.759858:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693093760 00000100:00100000:1.0:1782217037.759869:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693093120 00000100:00100000:1.0:1782217037.759871:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693093120 00000100:00100000:1.0:1782217037.759879:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693093632 00000100:00100000:1.0:1782217037.759881:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693093632 00000100:00100000:1.0:1782217037.759895:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 309 00000100:00100000:1.0:1782217037.759904:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+5:2403:x1868789693093248:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1782217037.759990:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+5:2403:x1868789693093248:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 86us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217037.759996:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693093504 00000100:00100000:1.0:1782217037.760000:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 309 00000100:00100000:2.0:1782217037.760003:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693093504 00000100:00100000:1.0:1782217037.760023:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 310 00000100:00100000:1.0:1782217037.760031:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43feca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a927f5f6-9735-45e0-abce-963bd125e020+5:2403:x1868789693093760:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1782217037.760041:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693093376 00000100:00100000:2.0:1782217037.760046:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693093376 00000100:00100000:1.0:1782217037.760059:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43feca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a927f5f6-9735-45e0-abce-963bd125e020+5:2403:x1868789693093760:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 29us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217037.760066:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 310 00000100:00100000:1.0:1782217037.760079:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 311 00000100:00100000:1.0:1782217037.760085:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+27:2403:x1868789693093120:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1782217037.760122:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+27:2403:x1868789693093120:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 37us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217037.760127:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 311 00000100:00100000:1.0:1782217037.760137:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 312 00000100:00100000:1.0:1782217037.760142:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a927f5f6-9735-45e0-abce-963bd125e020+5:2403:x1868789693093632:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1782217037.760161:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a927f5f6-9735-45e0-abce-963bd125e020+5:2403:x1868789693093632:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 19us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217037.760166:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 312 00000100:00100000:1.0:1782217037.760185:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 91 00000100:00100000:1.0:1782217037.760192:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24a87249-c61f-41a1-85ec-9a313129e739+7:2403:x1868789693093504:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1782217037.760215:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24a87249-c61f-41a1-85ec-9a313129e739+7:2403:x1868789693093504:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 24us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217037.760220:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 91 00000100:00080000:1.0:1782217037.760246:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782217037.760250:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782217037.760252:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782217037.760507:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693092992 00000100:00100000:0.0:1782217037.760512:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693092992 00000100:00100000:0.0:1782217037.760543:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 386 00000100:00100000:0.0:1782217037.760550:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:2403:x1868789693092992:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782217037.760574:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:2403:x1868789693092992:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 25us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217037.760604:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 386 00000100:00100000:2.0:1782217037.761202:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 92 00000100:00100000:2.0:1782217037.761212:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:24a87249-c61f-41a1-85ec-9a313129e739+7:2403:x1868789693093376:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1782217037.761254:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:24a87249-c61f-41a1-85ec-9a313129e739+7:2403:x1868789693093376:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 44us (1520us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217037.761261:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 92 00000001:00080000:3.0:1782217037.887264:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:3.0:1782217037.887285:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000040:00080000:0.0:1782217038.141314:0:13800:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1782217038.328798:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782217038.840827:0:13796:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782217038.840836:0:13796:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782217038.840865:0:13796:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1782217038.840873:0:13796:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:1.0:1782217038.911962:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:1.0:1782217038.911999:0:6498:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff952d426cca80 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1782217038.912011:0:6498:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff952e7c62e100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff952d426ccb40 00000020:00080000:1.0:1782217038.912015:0:6498:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff952e7c62ea00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff952e7c5c3200 00000020:00080000:1.0:1782217038.912035:0:6498:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00010000:00010000:0.0:1782217038.912329:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9cdd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217038.912341:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9cdd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217038.912349:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9cdd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217038.912355:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43073a00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782217038.912359:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9cdd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217038.912367:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9cdd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217038.912384:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff952d426a0a00) 00010000:00010000:0.0:1782217038.912388:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217038.912392:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9cdd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217038.912398:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9cdd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1782217038.912432:0:6551:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1782217038.912505:0:6551:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:1.0:1782217038.913568:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:1.0:1782217038.913577:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00010000:00010000:3.0:1782217039.354842:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782217039.418217:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43fea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713083136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782217039.418283:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217039.418326:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43e91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1868789713083648:0@lo:400:kworker.0 00000100:00100000:0.0:1782217039.418360:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217039.418379:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43e92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1868789713084160:0@lo:400:kworker.0 00000100:00100000:3.0:1782217039.418477:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43feb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713083264:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782217039.418506:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217039.418525:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43e90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713083776:0@lo:400:kworker.0 00000100:00100000:3.0:1782217039.418546:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217039.418560:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43e93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1868789713084288:0@lo:400:kworker.0 00000100:00100000:3.0:1782217039.418578:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217039.418618:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43e91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1868789713084800:0@lo:400:kworker.0 00000100:00100000:3.0:1782217039.418638:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217039.418929:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217039.418949:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1868789713084672:0@lo:400:kworker.0 00000100:00100000:0.0:1782217039.418970:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217039.418987:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1782217039.418992:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43d93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17bce19a-7a0f-4c9d-b31c-4e0155298487:3650:1868789713083520:0@lo:400:kworker.0 00000100:00100000:0.0:1782217039.419018:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217039.419040:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43e90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713084032:0@lo:400:kworker.0 00000100:00100000:0.0:1782217039.419059:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217039.419076:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43e91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713084544:0@lo:400:kworker.0 00000100:00100000:0.0:1782217039.419098:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217039.419114:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43e93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713085056:0@lo:400:kworker.0 00000100:00100000:0.0:1782217039.419132:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217039.419167:0:10535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713083136 00000100:00100000:0.0:1782217039.419174:0:10535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713083136 00000100:00100000:0.0:1782217039.419219:0:10535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713083264 00000100:00100000:0.0:1782217039.419223:0:10535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713083264 00000100:00100000:0.0:1782217039.419241:0:10535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1782217039.419249:0:10535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fe8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713083136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782217039.419281:0:10535:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782217039.419325:0:10535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fe8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713083136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217039.419332:0:10535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1782217039.419348:0:10535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1782217039.419354:0:10535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713083264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782217039.419373:0:10535:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782217039.421440:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43f43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713083392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782217039.421499:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217039.421521:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43e93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1868789713083904:0@lo:400:kworker.0 00000100:00100000:1.0:1782217039.421543:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217039.421553:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713084416:0@lo:400:kworker.0 00000100:00100000:1.0:1782217039.421572:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217039.421608:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43e91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713084928:0@lo:400:kworker.0 00000100:00100000:1.0:1782217039.421629:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217039.421666:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713083648 00000100:00100000:1.0:1782217039.421673:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713083648 00000100:00100000:1.0:1782217039.421706:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713084288 00000100:00100000:1.0:1782217039.421710:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713084288 00000100:00100000:1.0:1782217039.421723:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713084800 00000100:00100000:1.0:1782217039.421726:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713084800 00000100:00100000:1.0:1782217039.421747:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713084160 00000100:00100000:1.0:1782217039.421750:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713084160 00000100:00100000:1.0:1782217039.421763:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713084672 00000100:00100000:1.0:1782217039.421766:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713084672 00000100:00100000:1.0:1782217039.421786:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713083904 00000100:00100000:1.0:1782217039.421788:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713083904 00000100:00100000:1.0:1782217039.421801:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1782217039.421919:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fe9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1868789713083648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217039.421967:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fe9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1868789713083648:12345-0@lo:400:kworker.0 Request processed in 159us (3606us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217039.421974:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1782217039.421990:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1782217039.421996:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1868789713084288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217039.422024:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1868789713084288:12345-0@lo:400:kworker.0 Request processed in 29us (3445us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217039.422030:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1782217039.422041:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1782217039.422046:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1868789713084800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217039.422072:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1868789713084800:12345-0@lo:400:kworker.0 Request processed in 26us (3432us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217039.422077:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1782217039.422087:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1782217039.422092:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fe8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1868789713084160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217039.422117:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fe8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1868789713084160:12345-0@lo:400:kworker.0 Request processed in 25us (3189us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217039.422123:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1782217039.422134:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1782217039.422139:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fe9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1868789713084672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217039.422162:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fe9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1868789713084672:12345-0@lo:400:kworker.0 Request processed in 24us (3192us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217039.422174:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1782217039.422187:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1782217039.422192:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1868789713083904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217039.422224:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1868789713083904:12345-0@lo:400:kworker.0 Request processed in 32us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217039.422230:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1782217039.422286:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713084544 00000100:00100000:1.0:1782217039.422290:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713084544 00000100:00100000:1.0:1782217039.422314:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713085056 00000100:00100000:1.0:1782217039.422317:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713085056 00000100:00100000:1.0:1782217039.422326:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713084416 00000100:00100000:1.0:1782217039.422328:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713084416 00000100:00100000:1.0:1782217039.422337:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713084928 00000100:00100000:1.0:1782217039.422339:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713084928 00000100:00100000:1.0:1782217039.422349:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1782217039.422354:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43febb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713084544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217039.422385:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43febb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713084544:12345-0@lo:400:kworker.0 Request processed in 31us (3285us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217039.422391:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1782217039.422402:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1782217039.422407:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fe8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713085056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217039.422435:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fe8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713085056:12345-0@lo:400:kworker.0 Request processed in 27us (3301us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217039.422441:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1782217039.422452:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1782217039.422458:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713084416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217039.422496:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713084416:12345-0@lo:400:kworker.0 Request processed in 38us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217039.422503:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1782217039.422514:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1782217039.422520:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3648:x1868789713084928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217039.422544:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3648:x1868789713084928:12345-0@lo:400:kworker.0 Request processed in 24us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217039.422549:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1782217039.422606:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43e93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1868789713083904:0@lo:400:kworker.0 00000100:00100000:1.0:1782217039.422618:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713084416:0@lo:400:kworker.0 00000100:00100000:1.0:1782217039.422626:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43e91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713084928:0@lo:400:kworker.0 00000100:00100000:0.0:1782217039.422781:0:10535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713083264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3426us (4272us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217039.422790:0:10535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1782217039.422822:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782217039.422831:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43fedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713085184:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782217039.422874:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217039.422901:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713083392 00000100:00100000:0.0:1782217039.422904:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713083392 00000100:00100000:0.0:1782217039.422921:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713085184 00000100:00100000:0.0:1782217039.422924:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713085184 00000100:00100000:0.0:1782217039.422934:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1782217039.422940:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713083392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782217039.422962:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1782217039.422995:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713083392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (1496us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217039.423002:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1782217039.423013:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1782217039.423018:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fe9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713085184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782217039.423028:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1782217039.423054:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fe9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713085184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 36us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217039.423060:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1782217039.423085:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713083520 00000100:00100000:0.0:1782217039.423089:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713083520 00000100:00100000:0.0:1782217039.423114:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1782217039.423120:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3650:x1868789713083520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217039.423159:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3650:x1868789713083520:12345-0@lo:400:kworker.0 Request processed in 39us (4139us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217039.423165:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1782217039.423193:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713083776 00000100:00100000:0.0:1782217039.423197:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713083776 00000100:00100000:0.0:1782217039.423216:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713084032 00000100:00100000:0.0:1782217039.423219:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713084032 00000100:00100000:0.0:1782217039.423231:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1782217039.423236:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713083776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217039.423267:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713083776:12345-0@lo:400:kworker.0 Request processed in 30us (4720us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217039.423272:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1782217039.423284:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1782217039.423290:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fe9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713084032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217039.423315:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fe9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713084032:12345-0@lo:400:kworker.0 Request processed in 26us (4256us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217039.423320:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00080000:0.0:1782217039.423342:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782217039.423347:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782217039.423349:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782217039.423351:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782217039.423379:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43fedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713085184:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782217039.423402:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43d93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17bce19a-7a0f-4c9d-b31c-4e0155298487:3650:1868789713083520:0@lo:400:kworker.0 00000100:00100000:0.0:1782217039.423412:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43e90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713084032:0@lo:400:kworker.0 00000100:00100000:0.0:1782217039.423421:0:3650:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:0.0:1782217039.423425:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff952d43f40700, transno 4294967311 00000004:00080000:0.0:1782217039.423440:0:3650:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:0.0:1782217039.423455:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43e91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713084544:0@lo:400:kworker.0 00000100:00100000:0.0:1782217039.423466:0:3650:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:0.0:1782217039.423470:0:3650:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:0.0:1782217039.423479:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff952d43df7100, transno 4294967305 00000100:00100000:0.0:1782217039.423486:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43e93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713085056:0@lo:400:kworker.0 00000100:00100000:0.0:1782217039.423500:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43fea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713083136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782217039.423509:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43e91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1868789713083648:0@lo:400:kworker.0 00000100:00100000:0.0:1782217039.423519:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43e92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1868789713084160:0@lo:400:kworker.0 00000100:00100000:0.0:1782217039.423529:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1868789713084672:0@lo:400:kworker.0 00000100:00100000:1.0:1782217039.424193:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43f43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713083392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782217039.424519:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43feb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713083264:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782217039.424544:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43e90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713083776:0@lo:400:kworker.0 00010000:00080000:3.0:1782217039.424557:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43e93800 x1868789713084288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217055 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217039.424568:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43e93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1868789713084288:0@lo:400:kworker.0 00010000:00080000:3.0:1782217039.424579:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43e91180 x1868789713084800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217055 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217039.424681:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43e91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1868789713084800:0@lo:400:kworker.0 00000100:00100000:2.0:1782217039.929373:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43e91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713085312:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782217039.929445:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217039.929623:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713085312 00000100:00100000:0.0:1782217039.929631:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713085312 00000100:00100000:0.0:1782217039.929883:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1782217039.929954:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43f43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713085312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782217039.929988:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1782217039.930042:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43f43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713085312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217039.930049:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1782217039.930134:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43e91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713085312:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1782217040.378201:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782217040.944064:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217040.944150:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693093888 00000100:00100000:2.0:1782217040.944160:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693093888 00000100:00100000:2.0:1782217040.944236:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 147 00000100:00100000:2.0:1782217040.944246:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43feed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+13:11079:x1868789693093888:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1782217040.944352:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43feed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+13:11079:x1868789693093888:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 Request processed in 108us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217040.944376:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 147 00000100:00080000:0.0:1782217040.944448:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782217040.951790:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217040.951883:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693094016 00000100:00100000:0.0:1782217040.951892:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693094016 00000100:00100000:0.0:1782217040.951962:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 148 00000100:00100000:0.0:1782217040.951971:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43f40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+5:11079:x1868789693094016:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1782217040.952086:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43f40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+5:11079:x1868789693094016:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 Request processed in 116us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217040.952107:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 148 00000100:00080000:1.0:1782217040.952248:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782217040.952841:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43e91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713085440:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782217040.952888:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217040.956476:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713085440 00000100:00100000:3.0:1782217040.956492:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713085440 00000100:00100000:3.0:1782217040.956711:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1782217040.956721:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713085440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782217040.956768:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1782217040.956869:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713085440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 149us (3980us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217040.956876:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1782217040.956962:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43e91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713085440:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782217040.962679:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217040.962762:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693094272 00000100:00100000:3.0:1782217040.962771:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693094272 00000100:00100000:3.0:1782217040.962938:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 35 00000100:00100000:3.0:1782217040.962950:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43f43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+13:11079:x1868789693094272:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1782217040.963207:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43f43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+14:11079:x1868789693094272:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 259us (536us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1782217040.963215:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 35 00000100:00100000:2.0:1782217041.153018:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217041.153181:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693094400 00000100:00100000:1.0:1782217041.153191:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693094400 00000100:00100000:1.0:1782217041.153274:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 149 00000100:00100000:1.0:1782217041.153285:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43f41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a927f5f6-9735-45e0-abce-963bd125e020+5:11893:x1868789693094400:12345-192.168.203.30@tcp:101:lsof.0 00010000:00010000:1.0:1782217041.153305:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217041.153323:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9d69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973579 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217041.153382:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9d70 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217041.153407:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9d70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217041.153419:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9d70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782217041.153464:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1782217041.153468:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782217041.153501:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9d70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217041.153526:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9d69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973579 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217041.153544:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9d70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973579 expref: 6 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217041.153552:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d410abd00) 00010000:00010000:1.0:1782217041.153554:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782217041.153557:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43073400, rc 0) 00000100:00100000:1.0:1782217041.153659:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43f41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a927f5f6-9735-45e0-abce-963bd125e020+6:11893:x1868789693094400:12345-192.168.203.30@tcp:101:lsof.0 Request processed in 375us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217041.153666:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 149 00000100:00080000:0.0:1782217041.154379:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782217041.400916:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217042.425125:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782217042.883667:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217042.883722:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217042.883763:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217042.883805:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217042.883939:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693094784 00000100:00100000:1.0:1782217042.883948:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693094784 00000100:00100000:1.0:1782217042.884004:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693095296 00000100:00100000:1.0:1782217042.884007:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693095296 00000100:00100000:1.0:1782217042.884032:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 319 00000100:00100000:1.0:1782217042.884041:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43f40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+5:2402:x1868789693094784:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782217042.884152:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693094528 00000100:00100000:0.0:1782217042.884157:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693094528 00000100:00100000:0.0:1782217042.884184:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 388 00000100:00100000:0.0:1782217042.884191:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:2402:x1868789693094528:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1782217042.886975:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693095040 00000100:00100000:3.0:1782217042.886989:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693095040 00000100:00100000:3.0:1782217042.887066:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 97 00000100:00100000:3.0:1782217042.887077:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43f42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:24a87249-c61f-41a1-85ec-9a313129e739+5:2402:x1868789693095040:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1782217042.893262:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 320 00000100:00100000:1.0:1782217042.893287:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a927f5f6-9735-45e0-abce-963bd125e020+5:2402:x1868789693095296:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1782217042.893369:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a927f5f6-9735-45e0-abce-963bd125e020+5:2402:x1868789693095296:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 94us (9562us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217042.893376:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 320 00000100:00100000:1.0:1782217042.893426:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43f40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+5:2402:x1868789693094784:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 9386us (9702us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217042.893432:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 319 00000100:00080000:1.0:1782217042.893467:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782217042.893472:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782217042.895892:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:2402:x1868789693094528:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 11691us (12224us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217042.895906:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 388 00000100:00100000:2.0:1782217042.896323:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217042.896355:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693094656 00000100:00100000:2.0:1782217042.896362:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693094656 00000100:00100000:2.0:1782217042.896406:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 321 00000100:00100000:2.0:1782217042.896413:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4368d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+14:2402:x1868789693094656:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1782217042.896457:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4368d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+14:2402:x1868789693094656:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 45us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217042.896464:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 321 00000100:00080000:2.0:1782217042.896479:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782217042.896528:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217042.896543:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693094912 00000100:00100000:2.0:1782217042.896546:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693094912 00000100:00100000:2.0:1782217042.896598:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 98 00000100:00100000:2.0:1782217042.896604:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72e8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:24a87249-c61f-41a1-85ec-9a313129e739+6:2402:x1868789693094912:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1782217042.896626:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72e8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:24a87249-c61f-41a1-85ec-9a313129e739+6:2402:x1868789693094912:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 23us (98us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217042.896631:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 98 00000100:00080000:2.0:1782217042.896655:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782217042.896697:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217042.900389:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693095168 00000100:00100000:1.0:1782217042.900405:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693095168 00000100:00100000:1.0:1782217042.900492:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 322 00000100:00100000:1.0:1782217042.900501:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d44400700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a927f5f6-9735-45e0-abce-963bd125e020+6:2402:x1868789693095168:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1782217042.900620:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d44400700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a927f5f6-9735-45e0-abce-963bd125e020+6:2402:x1868789693095168:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 119us (3921us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217042.900627:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 322 00000100:00100000:2.0:1782217042.903167:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43f42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:24a87249-c61f-41a1-85ec-9a313129e739+5:2402:x1868789693095040:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 16081us (19391us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217042.903181:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 97 00010000:00010000:3.0:1782217043.448799:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782217044.423560:0:14560:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 08:17:23 (1782217043) 00010000:00010000:2.0:1782217044.478005:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782217044.536784:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d44402680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713085824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782217044.536853:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217044.537182:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43fedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17bce19a-7a0f-4c9d-b31c-4e0155298487:3648:1868789713085952:0@lo:400:kworker.0 00000100:00100000:3.0:1782217044.537219:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217044.537322:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7f6c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1868789713086336:0@lo:400:kworker.0 00000100:00100000:2.0:1782217044.537348:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217044.537369:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4449e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713086848:0@lo:400:kworker.0 00000100:00100000:2.0:1782217044.537390:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217044.537405:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4449c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713087360:0@lo:400:kworker.0 00000100:00100000:2.0:1782217044.537421:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217044.537451:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713085824 00000100:00100000:2.0:1782217044.537459:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713085824 00000100:00100000:2.0:1782217044.537506:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1782217044.537515:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d44403800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713085824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782217044.537542:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1782217044.537600:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d44403800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713085824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217044.537607:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1782217044.537632:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713086336 00000100:00100000:2.0:1782217044.537635:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713086336 00000100:00100000:2.0:1782217044.537660:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1782217044.537674:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d44400a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1868789713086336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217044.537720:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d44400a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1868789713086336:12345-0@lo:400:kworker.0 Request processed in 47us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217044.537726:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1782217044.537744:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713086848 00000100:00100000:2.0:1782217044.537747:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713086848 00000100:00100000:2.0:1782217044.537771:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713087360 00000100:00100000:2.0:1782217044.537774:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713087360 00000100:00100000:2.0:1782217044.537792:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1782217044.537799:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d44401c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713086848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217044.537827:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d44401c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713086848:12345-0@lo:400:kworker.0 Request processed in 29us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217044.537833:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1782217044.537844:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1782217044.537849:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d44400000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713087360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217044.537887:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d44400000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713087360:12345-0@lo:400:kworker.0 Request processed in 38us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217044.537893:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:2.0:1782217044.537909:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782217044.537913:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782217044.537954:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7f6c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1868789713086336:0@lo:400:kworker.0 00000100:00100000:2.0:1782217044.537963:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4449e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713086848:0@lo:400:kworker.0 00000100:00100000:2.0:1782217044.537971:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4449c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713087360:0@lo:400:kworker.0 00000100:00100000:2.0:1782217044.537985:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d44402680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713085824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782217044.538091:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7f6c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713086464:0@lo:400:kworker.0 00000100:00100000:3.0:1782217044.538119:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217044.538138:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4449d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713086976:0@lo:400:kworker.0 00000100:00100000:3.0:1782217044.538157:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217044.538171:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4449e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713087488:0@lo:400:kworker.0 00000100:00100000:3.0:1782217044.538189:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217044.538215:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713086464 00000100:00100000:3.0:1782217044.538219:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713086464 00000100:00100000:3.0:1782217044.538245:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1782217044.538251:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713086464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217044.538286:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713086464:12345-0@lo:400:kworker.0 Request processed in 35us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217044.538296:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1782217044.538314:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713086976 00000100:00100000:3.0:1782217044.538317:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713086976 00000100:00100000:3.0:1782217044.538332:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713087488 00000100:00100000:3.0:1782217044.538334:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713087488 00000100:00100000:3.0:1782217044.538355:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1782217044.538368:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713086976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217044.538396:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713086976:12345-0@lo:400:kworker.0 Request processed in 29us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217044.538401:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1782217044.538413:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1782217044.538418:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713087488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217044.538442:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713087488:12345-0@lo:400:kworker.0 Request processed in 24us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217044.538447:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:3.0:1782217044.538462:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782217044.538478:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7f6c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713086464:0@lo:400:kworker.0 00000100:00100000:3.0:1782217044.538488:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4449d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713086976:0@lo:400:kworker.0 00000100:00100000:3.0:1782217044.538496:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4449e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713087488:0@lo:400:kworker.0 00000100:00100000:0.0:1782217044.539321:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43feb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713085568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782217044.539370:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217044.539402:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1868789713086080:0@lo:400:kworker.0 00000100:00100000:0.0:1782217044.539428:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217044.539448:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7f6c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1868789713086592:0@lo:400:kworker.0 00000100:00100000:0.0:1782217044.539468:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217044.539481:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4449c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1868789713087104:0@lo:400:kworker.0 00000100:00100000:0.0:1782217044.539502:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217044.539521:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1782217044.539528:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43feea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713085696:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782217044.539565:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217044.539603:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4263fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713086208:0@lo:400:kworker.0 00000100:00100000:0.0:1782217044.539626:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217044.539650:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4449ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1868789713086720:0@lo:400:kworker.0 00000100:00100000:0.0:1782217044.539672:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217044.539685:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4449f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1868789713087232:0@lo:400:kworker.0 00000100:00100000:0.0:1782217044.539716:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217044.539815:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713086080 00000100:00100000:2.0:1782217044.539830:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713086080 00000100:00100000:2.0:1782217044.539860:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713086592 00000100:00100000:2.0:1782217044.539863:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713086592 00000100:00100000:2.0:1782217044.539882:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713087104 00000100:00100000:2.0:1782217044.539884:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713087104 00000100:00100000:2.0:1782217044.539897:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713086720 00000100:00100000:2.0:1782217044.539899:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713086720 00000100:00100000:2.0:1782217044.539925:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713087232 00000100:00100000:2.0:1782217044.539928:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713087232 00000100:00100000:2.0:1782217044.539948:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1782217044.539957:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1868789713086080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217044.539960:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782217044.539971:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43cb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713087616:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782217044.540006:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1868789713086080:12345-0@lo:400:kworker.0 Request processed in 50us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217044.540014:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1782217044.540029:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1782217044.540035:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1868789713086592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217044.540062:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1868789713086592:12345-0@lo:400:kworker.0 Request processed in 28us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217044.540069:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1782217044.540084:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1782217044.540090:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217044.540093:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c795500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1868789713087104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217044.540134:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c795500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1868789713087104:12345-0@lo:400:kworker.0 Request processed in 44us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217044.540141:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1868789713086080:0@lo:400:kworker.0 00000100:00100000:2.0:1782217044.540143:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1782217044.540162:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7f6c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1868789713086592:0@lo:400:kworker.0 00000100:00100000:2.0:1782217044.540163:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1782217044.540176:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1868789713086720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217044.540180:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4449c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1868789713087104:0@lo:400:kworker.0 00000100:00100000:3.0:1782217044.540263:0:10535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713085568 00000100:00100000:3.0:1782217044.540268:0:10535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713085568 00000100:00100000:3.0:1782217044.540296:0:10535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713085696 00000100:00100000:3.0:1782217044.540300:0:10535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713085696 00000100:00100000:3.0:1782217044.540312:0:10535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713087616 00000100:00100000:3.0:1782217044.540315:0:10535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713087616 00000100:00100000:3.0:1782217044.540326:0:10535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1782217044.540332:0:10535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c671180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713085568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782217044.540353:0:10535:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782217044.540411:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1868789713086720:12345-0@lo:400:kworker.0 Request processed in 238us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217044.540437:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1782217044.540451:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1782217044.540457:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1868789713087232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217044.541098:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713085952 00000100:00100000:1.0:1782217044.541106:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713085952 00000100:00100000:1.0:1782217044.541142:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1782217044.541149:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3648:x1868789713085952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217044.541196:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3648:x1868789713085952:12345-0@lo:400:kworker.0 Request processed in 47us (3975us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217044.541202:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1782217044.541316:0:10535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c671180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713085568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 983us (1945us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217044.541324:0:10535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1782217044.541339:0:10535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1782217044.541354:0:10535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713085696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782217044.541367:0:10535:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1782217044.541400:0:10535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713085696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (1833us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217044.541405:0:10535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1782217044.541430:0:10535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1782217044.541438:0:10535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e75105c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713087616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782217044.541449:0:10535:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782217044.541533:0:10535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e75105c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713087616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (1443us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217044.541539:0:10535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1782217044.541750:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713086208 00000100:00100000:3.0:1782217044.541755:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713086208 00000100:00100000:3.0:1782217044.541785:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1782217044.541794:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713086208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217044.541823:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713086208:12345-0@lo:400:kworker.0 Request processed in 33us (2197us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217044.541829:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00080000:3.0:1782217044.541842:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782217044.541846:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782217044.541868:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43fedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17bce19a-7a0f-4c9d-b31c-4e0155298487:3648:1868789713085952:0@lo:400:kworker.0 00000100:00100000:1.0:1782217044.542397:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43cb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713087616:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782217044.542550:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1868789713087232:12345-0@lo:400:kworker.0 Request processed in 2091us (2830us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217044.542558:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1782217044.543028:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43feea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713085696:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782217044.543039:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4263fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713086208:0@lo:400:kworker.0 00010000:00080000:2.0:1782217044.543052:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4449ea00 x1868789713086720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782217044.543063:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4449ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1868789713086720:0@lo:400:kworker.0 00010000:00080000:2.0:1782217044.543073:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4449f480 x1868789713087232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782217044.543081:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4449f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1868789713087232:0@lo:400:kworker.0 00000100:00100000:2.0:1782217044.543094:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43feb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713085568:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782217045.049031:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782217045.049056:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43cb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713087744:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782217045.049122:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217045.049381:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713087744 00000100:00100000:1.0:1782217045.049390:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713087744 00000100:00100000:1.0:1782217045.049440:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1782217045.049449:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d44402680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713087744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782217045.049483:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1782217045.049539:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d44402680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713087744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217045.049547:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1782217045.049643:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43cb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713087744:0@lo:41:osp-pre-1-0.0 00000001:00080000:1.0:1782217045.050733:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967417 is committed 00000020:00080000:1.0:1782217045.050747:0:6498:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1782217045.051076:0:6551:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1782217045.051088:0:6551:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1782217045.501179:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782217045.548958:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217045.549115:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693095552 00000100:00100000:2.0:1782217045.549130:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693095552 00000100:00080000:3.0:1782217045.549193:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782217045.549345:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 150 00000100:00100000:2.0:1782217045.549357:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4449f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+13:12160:x1868789693095552:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782217045.549395:0:6548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217045.549416:0:6548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9d77 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973580 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217045.549486:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9d7e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217045.549500:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9d7e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217045.549522:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9d7e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217045.549538:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9d85 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217045.549545:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9d85 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217045.549552:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9d85 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217045.550024:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9d8c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217045.550035:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9d8c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217045.550043:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9d8c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217045.550053:0:6548:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1782217045.550146:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9d7e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217045.550154:0:6548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9d7e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217045.550160:0:6548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9d7e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217045.550334:0:6548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2c400 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782217045.550339:0:6548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9d7e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217045.550348:0:6548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9d7e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217045.550360:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff952d410ab800) 00010000:00010000:2.0:1782217045.550363:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217045.550368:0:6548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9d7e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217045.550375:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9d7e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217045.550390:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9d85 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217045.550396:0:6548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9d85 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217045.550402:0:6548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9d85 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217045.550420:0:6548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2c000 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782217045.550423:0:6548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9d85 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217045.550430:0:6548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9d85 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217045.550440:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff952d410a7600) 00010000:00010000:2.0:1782217045.550442:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217045.550445:0:6548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9d85 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217045.550451:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9d85 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217045.550912:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9d77 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973580 expref: 16 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217045.550928:0:6548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9d8c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973580 expref: 15 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217045.550936:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff952e7b201600) 00010000:00010000:2.0:1782217045.550938:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217045.550941:0:6548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2d000, rc 0) 00000100:00100000:2.0:1782217045.551013:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4449f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+15:12160:x1868789693095552:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 1658us (2062us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1782217045.551021:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 150 00000100:00100000:1.0:1782217045.559876:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217045.560107:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693095680 00000100:00100000:3.0:1782217045.560119:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693095680 00000100:00100000:3.0:1782217045.560177:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 151 00000100:00100000:3.0:1782217045.560187:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4449ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+15:12160:x1868789693095680:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1782217045.560306:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4449ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+15:12160:x1868789693095680:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 Request processed in 120us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217045.560314:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 151 00000100:00100000:0.0:1782217045.563311:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217045.563488:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693095808 00000100:00100000:3.0:1782217045.563497:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693095808 00000100:00100000:3.0:1782217045.563563:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 11 00000100:00100000:3.0:1782217045.563573:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e6f92f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:24a87249-c61f-41a1-85ec-9a313129e739+15:2402:x1868789693095808:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782217045.563613:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217045.563635:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9d8c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973580 expref: 15 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217045.563664:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff952e7b201600) 00010000:00010000:3.0:1782217045.563670:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217045.563905:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e6f92f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:24a87249-c61f-41a1-85ec-9a313129e739+14:2402:x1868789693095808:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 332us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217045.563913:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 11 00000100:00100000:1.0:1782217045.571032:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217045.571142:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693095936 00000100:00100000:2.0:1782217045.571165:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693095936 00000100:00100000:2.0:1782217045.571351:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 152 00000100:00100000:2.0:1782217045.571362:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4449dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+5:12160:x1868789693095936:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1782217045.571465:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4449dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+5:12160:x1868789693095936:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 Request processed in 105us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217045.571473:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 152 00000100:00080000:3.0:1782217045.575200:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:0.0:1782217046.008782:0:13796:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782217046.008795:0:13796:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782217046.009341:0:13796:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1782217046.009492:0:13796:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782217046.073440:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43e93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713087872:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782217046.073538:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217046.073880:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713087872 00000100:00100000:3.0:1782217046.073891:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713087872 00000100:00100000:3.0:1782217046.073961:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1782217046.073973:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d44401180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713087872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782217046.074036:0:7938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1782217046.074110:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d44401180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713087872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 138us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217046.074118:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1782217046.074370:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43e93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713087872:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1782217046.330855:0:13800:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1782217046.521919:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217047.546429:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782217047.550924:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217047.551351:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693096064 00000100:00100000:0.0:1782217047.551362:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693096064 00000100:00100000:0.0:1782217047.551467:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 153 00000100:00100000:0.0:1782217047.551478:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+14:12202:x1868789693096064:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1782217047.551498:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217047.551517:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9d9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973587 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217047.551617:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9da1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217047.551631:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9da1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217047.551641:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9da1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217047.551655:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f9da8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217047.551663:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f9da8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217047.551670:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f9da8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217047.551721:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9da1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217047.551728:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9da1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217047.551734:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9da1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217047.551740:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121c600 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782217047.551744:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9da1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217047.551820:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9da1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217047.551835:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d410abd00) 00010000:00010000:0.0:1782217047.551838:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217047.551843:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9da1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217047.551849:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9da1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217047.551860:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f9da8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217047.551865:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f9da8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217047.551871:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f9da8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217047.551876:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121ca00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782217047.551879:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f9da8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217047.551884:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f9da8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217047.551891:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff952d427f5700) 00010000:00010000:0.0:1782217047.551893:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217047.551895:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f9da8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217047.551910:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f9da8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217047.551938:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9d9a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973587 expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217047.551948:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d410abd00) 00010000:00010000:0.0:1782217047.551949:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217047.551953:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9d9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973587 expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217047.551962:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e4121d600, rc 0) 00000100:00100000:0.0:1782217047.552020:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+14:12202:x1868789693096064:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 543us (1102us total) trans 0 rc 301/301 00000100:00100000:0.0:1782217047.552027:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 153 00000100:00080000:3.0:1782217047.553135:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782217047.558209:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217047.558345:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693096320 00000100:00100000:2.0:1782217047.558354:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693096320 00000100:00100000:2.0:1782217047.558410:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 154 00000100:00100000:2.0:1782217047.558419:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+14:12202:x1868789693096320:12345-192.168.203.30@tcp:36:lfs.0 00010000:00010000:2.0:1782217047.558471:0:6548:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217047.558498:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5f96ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733ab expref: 14 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.558515:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d410abd00) 00010000:00010000:2.0:1782217047.558519:0:6548:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782217047.558846:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9daf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.558861:0:6548:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9d70 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973579 expref: 5 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.558870:0:6548:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9daf lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217047.559075:0:6548:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9d70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973579 expref: 5 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217047.559089:0:6548:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9d70 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973579 expref: 5 pid: 6519 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217047.559104:0:6548:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43cb2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6548:1868789713088000:192.168.203.30@tcp:104: 00000100:00100000:0.0:1782217047.559217:0:6548:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d426cc6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782217047.561693:0:6548:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43cb2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6548:1868789713088000:192.168.203.30@tcp:104: 00010000:00010000:1.0:1782217047.561722:0:6548:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9daf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217047.562497:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217047.562552:0:13731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693096448 00000100:00100000:2.0:1782217047.562559:0:13731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693096448 00010000:00010000:2.0:1782217047.562625:0:13731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9d70 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973579 expref: 6 pid: 6519 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217047.562655:0:13731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 79 00000100:00100000:2.0:1782217047.562663:0:13731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a927f5f6-9735-45e0-abce-963bd125e020+6:2402:x1868789693096448:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782217047.562684:0:13731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217047.562690:0:13731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9d70 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973579 expref: 6 pid: 6519 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.562701:0:13731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9d70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973579 expref: 6 pid: 6519 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.562721:0:13731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9d70 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973579 expref: 6 pid: 6519 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.562735:0:13731:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d410abd00) 00010000:00010000:2.0:1782217047.562740:0:13731:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9daf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.562750:0:13731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9daf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.562758:0:13731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9daf lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.562783:0:13731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217047.562831:0:13731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a927f5f6-9735-45e0-abce-963bd125e020+5:2402:x1868789693096448:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 168us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217047.562838:0:13731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 79 00010000:00010000:1.0:1782217047.562905:0:6548:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9daf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217047.562914:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9daf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217047.562937:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9db6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217047.562947:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9db6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217047.562964:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9db6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217047.563466:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5f9dbd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217047.563476:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5f9dbd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217047.563483:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5f9dbd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782217047.563495:0:6548:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d035e51d reply state 000000000f1720f5 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5f9dbd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217047.563505:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5f9dbd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217047.563511:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff952e6105c600) 00010000:00010000:1.0:1782217047.563514:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782217047.563516:0:6548:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1782217047.563521:0:6548:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1782217047.563527:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9daf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217047.563533:0:6548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9daf lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217047.563540:0:6548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9daf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217047.563545:0:6548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2d400 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217047.563553:0:6548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9daf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217047.563561:0:6548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9daf lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217047.563569:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d410abd00) 00010000:00010000:1.0:1782217047.563572:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217047.563575:0:6548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9daf lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217047.563607:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9daf lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782217047.563623:0:6548:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d035e51d reply state 000000000f1720f5 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9db6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217047.563631:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9db6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217047.563637:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff952e6105c200) 00010000:00010000:1.0:1782217047.563639:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782217047.563641:0:6548:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1782217047.563694:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+15:12202:x1868789693096320:12345-192.168.203.30@tcp:36:lfs.0 Request processed in 5275us (5492us total) trans 4294967419 rc 0/0 00000100:00100000:1.0:1782217047.563700:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 154 00000100:00080000:3.0:1782217047.563841:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782217047.657027:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217047.657475:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693096576 00000100:00100000:3.0:1782217047.657486:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693096576 00000100:00100000:3.0:1782217047.657548:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 155 00000100:00100000:3.0:1782217047.657559:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+15:12210:x1868789693096576:12345-192.168.203.30@tcp:101:lctl.0 00010000:00010000:3.0:1782217047.657829:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217047.657980:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5f9dc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be97358e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.658042:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f9dcb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.658056:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f9dcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.658066:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f9dcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217047.658112:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1782217047.658116:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782217047.658138:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f9dcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.658172:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5f9dc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97358e expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.658191:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f9dcb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97358e expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.658199:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d410a7100) 00010000:00010000:2.0:1782217047.658202:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782217047.658205:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2d200, rc 0) 00000100:00100000:2.0:1782217047.658307:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+16:12210:x1868789693096576:12345-192.168.203.30@tcp:101:lctl.0 Request processed in 749us (1288us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217047.658324:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 155 00000100:00100000:3.0:1782217047.733049:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217047.733150:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693096704 00000100:00100000:1.0:1782217047.733159:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693096704 00000100:00100000:1.0:1782217047.733282:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 156 00000100:00100000:1.0:1782217047.733293:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+16:12216:x1868789693096704:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:1.0:1782217047.733312:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217047.733343:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9dd2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973595 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217047.733905:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5f9dd9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217047.733919:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5f9dd9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217047.733931:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5f9dd9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217047.733942:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5f9de0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217047.733949:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5f9de0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217047.733956:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5f9de0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217047.734026:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072400/0x92b8e04cbf5f9de7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217047.734034:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072400/0x92b8e04cbf5f9de7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217047.734041:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072400/0x92b8e04cbf5f9de7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782217047.734073:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1782217047.734077:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782217047.734095:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072400/0x92b8e04cbf5f9de7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217047.734115:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5f9dd9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217047.734121:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5f9dd9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217047.734127:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5f9dd9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217047.734132:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43073600 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217047.734136:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5f9dd9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217047.734144:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5f9dd9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217047.734157:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d410a7100) 00010000:00010000:1.0:1782217047.734160:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217047.734163:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5f9dd9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217047.734169:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5f9dd9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217047.734293:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5f9de0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217047.734300:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5f9de0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217047.734305:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5f9de0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217047.734316:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43073000 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217047.734318:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5f9de0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217047.734325:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5f9de0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217047.734333:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff952e6105c200) 00010000:00010000:1.0:1782217047.734335:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217047.734338:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5f9de0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217047.734344:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5f9de0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217047.734438:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5f9dd2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973595 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217047.734452:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072400/0x92b8e04cbf5f9de7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973595 expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217047.734459:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff952e6105c600) 00010000:00010000:1.0:1782217047.734461:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1782217047.734464:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43072400, rc 0) 00000100:00100000:1.0:1782217047.734534:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+17:12216:x1868789693096704:12345-192.168.203.30@tcp:101:bash.0 Request processed in 1243us (1493us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217047.734541:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 156 00000100:00100000:0.0:1782217047.740055:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217047.740137:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693096960 00000100:00100000:2.0:1782217047.740145:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693096960 00000100:00100000:2.0:1782217047.740211:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 157 00000100:00100000:2.0:1782217047.740220:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+17:12216:x1868789693096960:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:2.0:1782217047.740239:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217047.740258:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9dee lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be97359c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.740570:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5f9df5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.740606:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5f9df5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.740617:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5f9df5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.740753:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9dfc lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.740762:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9dfc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.740771:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9dfc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782217047.741083:0:6518:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:2.0:1782217047.742790:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f9e03 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.742823:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f9e03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.742834:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f9e03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.742874:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5f9df5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.742882:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5f9df5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.742890:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5f9df5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.742897:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2ca00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782217047.742901:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5f9df5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.742908:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5f9df5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.742921:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff952e6105c600) 00010000:00010000:2.0:1782217047.742924:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217047.742929:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5f9df5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.742936:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5f9df5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782217047.742953:0:6518:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000172807f6 reply state 0000000035ba1ca1 transno 4294967420 ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9dfc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.742972:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9dfc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.742979:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff952d410a7700) 00010000:00010000:2.0:1782217047.742981:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1782217047.742984:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782217047.743020:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9dee lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97359c expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.743035:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f9e03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97359c expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.743043:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952d410a7900) 00010000:00010000:2.0:1782217047.743045:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782217047.743048:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2c800, rc 0) 00000100:00100000:2.0:1782217047.743122:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+20:12216:x1868789693096960:12345-192.168.203.30@tcp:101:bash.0 Request processed in 2902us (3073us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1782217047.743131:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 157 00000100:00100000:2.0:1782217047.749782:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217047.749952:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693097088 00000100:00100000:3.0:1782217047.749963:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693097088 00000100:00100000:3.0:1782217047.750035:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 55 00000100:00100000:3.0:1782217047.750044:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d44401500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24a87249-c61f-41a1-85ec-9a313129e739+5:2403:x1868789693097088:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:3.0:1782217047.750061:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217047.750085:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002483e12d/0x92b8e04cbf5f9e11 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9735a3 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782217047.750109:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782217047.750125:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=410s v=(0 0) 00010000:00010000:3.0:1782217047.750130:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217047.750139:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002483e12d/0x92b8e04cbf5f9e11 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735a3 expref: 6 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217047.750158:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002483e12d/0x92b8e04cbf5f9e11 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735a3 expref: 6 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217047.750201:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b362a00, rc 0) 00000100:00100000:3.0:1782217047.750266:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d44401500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24a87249-c61f-41a1-85ec-9a313129e739+6:2403:x1868789693097088:12345-192.168.203.30@tcp:101:bash.0 Request processed in 221us (491us total) trans 0 rc 0/0 00000100:00080000:0.0:1782217047.750271:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782217047.750274:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 55 00000100:00100000:3.0:1782217047.765822:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217047.766125:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693097216 00000100:00100000:2.0:1782217047.766134:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693097216 00000100:00100000:2.0:1782217047.766208:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 56 00000100:00100000:2.0:1782217047.766218:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:24a87249-c61f-41a1-85ec-9a313129e739+6:12216:x1868789693097216:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:2.0:1782217047.766237:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217047.766255:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ebd05488/0x92b8e04cbf5f9e18 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9735aa expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.766307:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002483e12d/0x92b8e04cbf5f9e11 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735a3 expref: 7 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.766317:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782217047.766320:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782217047.766326:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebd05488/0x92b8e04cbf5f9e18 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735aa expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.766360:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002483e12d/0x92b8e04cbf5f9e11 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735a3 expref: 7 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.766372:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002483e12d/0x92b8e04cbf5f9e11 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735a3 expref: 7 pid: 8432 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217047.766385:0:8435:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d44403b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8435:1868789713088128:192.168.203.30@tcp:104: 00000100:00100000:2.0:1782217047.766532:0:8435:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e51f750c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782217047.772334:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217047.772542:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693097344 00000100:00100000:0.0:1782217047.772551:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693097344 00010000:00010000:0.0:1782217047.772632:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002483e12d/0x92b8e04cbf5f9e11 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735a3 expref: 8 pid: 8432 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217047.772683:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 80 00000100:00100000:0.0:1782217047.772693:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4449c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24a87249-c61f-41a1-85ec-9a313129e739+8:2402:x1868789693097344:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782217047.772709:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217047.772730:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002483e12d/0x92b8e04cbf5f9e11 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735a3 expref: 8 pid: 8432 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217047.772743:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002483e12d/0x92b8e04cbf5f9e11 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735a3 expref: 8 pid: 8432 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217047.772775:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217047.772779:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217047.772787:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ebd05488/0x92b8e04cbf5f9e18 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735aa expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217047.772797:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebd05488/0x92b8e04cbf5f9e18 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735aa expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217047.772844:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ebd05488/0x92b8e04cbf5f9e18 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735aa expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217047.772872:0:6505:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43cb0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6505:1868789713088256:192.168.203.30@tcp:105: 00000100:00100000:0.0:1782217047.772951:0:6505:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d426cc240 going to sleep for 11 seconds 00010000:00010000:2.0:1782217047.773314:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002483e12d/0x92b8e04cbf5f9e11 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735a3 expref: 8 pid: 8432 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217047.773330:0:8435:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d44403b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8435:1868789713088128:192.168.203.30@tcp:104: 00010000:00010000:2.0:1782217047.773354:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ebd05488/0x92b8e04cbf5f9e18 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735aa expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.773364:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2d800, rc 0) 00000100:00100000:2.0:1782217047.773403:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:24a87249-c61f-41a1-85ec-9a313129e739+7:12216:x1868789693097216:12345-192.168.203.30@tcp:101:bash.0 Request processed in 7187us (7591us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217047.773411:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 56 00000100:00100000:0.0:1782217047.778244:0:6505:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43cb0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6505:1868789713088256:192.168.203.30@tcp:105: 00010000:00010000:0.0:1782217047.778272:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217047.778329:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4449c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24a87249-c61f-41a1-85ec-9a313129e739+6:2402:x1868789693097344:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 5638us (6005us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217047.778341:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 80 00000100:00100000:1.0:1782217047.779807:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217047.779863:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693097600 00000100:00100000:3.0:1782217047.779872:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693097600 00000100:00100000:3.0:1782217047.779928:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 36 00000100:00100000:3.0:1782217047.779937:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4449d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+20:12216:x1868789693097600:12345-192.168.203.30@tcp:35:bash.0 00000100:00100000:3.0:1782217047.780305:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4449d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+21:12216:x1868789693097600:12345-192.168.203.30@tcp:35:bash.0 Request processed in 368us (503us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1782217047.780313:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 36 00000100:00100000:1.0:1782217047.857683:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217047.857804:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693097856 00000100:00100000:0.0:1782217047.857814:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693097856 00000100:00100000:0.0:1782217047.857932:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 158 00000100:00100000:0.0:1782217047.857941:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4449d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+21:12226:x1868789693097856:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1782217047.857974:0:6548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217047.857995:0:6548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f9e1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9735b1 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782217047.858095:0:6548:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1782217047.858187:0:6548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f9e1f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735b1 expref: 23 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217047.858201:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d410a7100) 00010000:00010000:0.0:1782217047.858204:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782217047.858401:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f9e1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735b1 expref: 23 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217047.858418:0:6548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e4121ca00, rc 0) 00000100:00100000:0.0:1782217047.858491:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4449d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+22:12226:x1868789693097856:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 551us (826us total) trans 4294967422 rc 301/301 00000100:00100000:0.0:1782217047.858500:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 158 00000100:00100000:2.0:1782217047.866662:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217047.866769:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693098112 00000100:00100000:0.0:1782217047.866779:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693098112 00000100:00100000:0.0:1782217047.866844:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 37 00000100:00100000:0.0:1782217047.866853:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d44403b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24a87249-c61f-41a1-85ec-9a313129e739+22:12226:x1868789693098112:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:0.0:1782217047.867331:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d44403b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24a87249-c61f-41a1-85ec-9a313129e739+23:12226:x1868789693098112:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 477us (680us total) trans 4294967423 rc 0/0 00000100:00100000:0.0:1782217047.867341:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 37 00000100:00100000:3.0:1782217047.943082:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217047.943182:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693098240 00000100:00100000:2.0:1782217047.943193:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693098240 00000100:00100000:2.0:1782217047.943298:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 159 00000100:00100000:2.0:1782217047.943310:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+23:12232:x1868789693098240:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1782217047.943333:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217047.943353:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9e2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9735b8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.943414:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9e34 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.943427:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9e34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.943439:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9e34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217047.943479:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1782217047.943483:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782217047.943500:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9e34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.943525:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9e2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735b8 expref: 25 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.943544:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9e34 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735b8 expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.943566:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff952e6105c600) 00010000:00010000:2.0:1782217047.943569:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782217047.943573:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2c000, rc 0) 00000100:00100000:2.0:1782217047.943741:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+24:12232:x1868789693098240:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 431us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217047.943749:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 159 00000100:00100000:1.0:1782217047.949687:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217047.950074:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693098496 00000100:00100000:2.0:1782217047.950093:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693098496 00000100:00100000:2.0:1782217047.950154:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 160 00000100:00100000:2.0:1782217047.950165:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4449fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+24:12232:x1868789693098496:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1782217047.950185:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217047.950957:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9e3b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9735bf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.951069:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9e42 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.951481:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9e42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.951496:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9e42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217047.951508:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1782217047.951640:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9e3b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735bf expref: 27 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.951690:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9e42 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735bf expref: 26 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.951699:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952d410a7900) 00010000:00010000:2.0:1782217047.951702:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782217047.951705:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2d000, rc 0) 00000100:00100000:2.0:1782217047.952118:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4449fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+26:12232:x1868789693098496:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 1953us (2448us total) trans 4294967424 rc 0/0 00000100:00100000:2.0:1782217047.952127:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 160 00000100:00100000:0.0:1782217047.956007:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217047.956629:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693098752 00000100:00100000:1.0:1782217047.956639:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693098752 00000100:00100000:1.0:1782217047.956703:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 161 00000100:00100000:1.0:1782217047.956713:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+26:12232:x1868789693098752:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1782217047.956736:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217047.956767:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9e50 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9735c6 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217047.956866:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5f9e57 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217047.956881:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5f9e57 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217047.956893:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5f9e57 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782217047.956904:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1782217047.956999:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9e50 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735c6 expref: 29 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217047.957016:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5f9e57 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735c6 expref: 28 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217047.957025:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952d410a7900) 00010000:00010000:1.0:1782217047.957028:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1782217047.957042:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43073800, rc 0) 00000100:00100000:1.0:1782217047.957103:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+28:12232:x1868789693098752:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 392us (1106us total) trans 4294967425 rc 0/0 00000100:00100000:1.0:1782217047.957110:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 161 00000100:00100000:3.0:1782217047.963309:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217047.963346:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217047.963442:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693099008 00000100:00100000:0.0:1782217047.963451:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693099008 00000100:00100000:0.0:1782217047.963517:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 12 00000100:00100000:0.0:1782217047.963527:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24a87249-c61f-41a1-85ec-9a313129e739+28:2404:x1868789693099008:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782217047.963542:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217047.963567:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9e42 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735bf expref: 28 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217047.963620:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952d410a7900) 00010000:00010000:0.0:1782217047.963626:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217047.963684:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24a87249-c61f-41a1-85ec-9a313129e739+27:2404:x1868789693099008:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 150us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217047.963693:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 12 00000100:00100000:1.0:1782217047.964439:0:10025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693098880 00000100:00100000:1.0:1782217047.964447:0:10025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693098880 00000100:00100000:1.0:1782217047.964635:0:10025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 57 00000100:00100000:1.0:1782217047.964646:0:10025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e74f8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:24a87249-c61f-41a1-85ec-9a313129e739+6:2403:x1868789693098880:12345-192.168.203.30@tcp:1:lfs.0 00010000:00010000:1.0:1782217047.964695:0:10025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f12237b9/0x92b8e04cbf5f9e65 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217047.964714:0:10025:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ebd05488/0x92b8e04cbf5f9e18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735aa expref: 6 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217047.964723:0:10025:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217047.964727:0:10025:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782217047.964732:0:10025:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f12237b9/0x92b8e04cbf5f9e65 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217047.964782:0:10025:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ebd05488/0x92b8e04cbf5f9e18 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735aa expref: 6 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217047.964797:0:10025:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ebd05488/0x92b8e04cbf5f9e18 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735aa expref: 6 pid: 8435 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217047.964809:0:10025:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4449f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10025:1868789713088384:192.168.203.30@tcp:104: 00000100:00100000:1.0:1782217047.964880:0:10025:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43787d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782217047.968159:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217047.968238:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693099136 00000100:00100000:3.0:1782217047.968246:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693099136 00002000:00100000:3.0:1782217047.968290:0:8439:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff952d4449ce00 x1868789693099136/t0(0) o4->24a87249-c61f-41a1-85ec-9a313129e739@192.168.203.30@tcp:298/0 lens 504/0 e 0 to 0 dl 1782217058 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782217047.968301:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff952d4449ce00 with x1868789693099136 ext(0->12) 00010000:00010000:3.0:1782217047.968311:0:8439:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ebd05488/0x92b8e04cbf5f9e18 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735aa expref: 7 pid: 8435 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217047.968327:0:8439:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ebd05488/0x92b8e04cbf5f9e18 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735aa expref: 7 pid: 8435 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782217047.968349:0:8439:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff952d4449ce00 00000100:00100000:3.0:1782217047.968382:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2 00000100:00100000:3.0:1782217047.968391:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4449ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:24a87249-c61f-41a1-85ec-9a313129e739+7:2403:x1868789693099136:12345-192.168.203.30@tcp:4:lfs.0 00000100:00100000:3.0:1782217047.969644:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4449ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:24a87249-c61f-41a1-85ec-9a313129e739+9:2403:x1868789693099136:12345-192.168.203.30@tcp:4:lfs.0 Request processed in 1247us (1487us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1782217047.969655:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2 00002000:00100000:3.0:1782217047.969662:0:8439:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff952d4449ce00 x1868789693099136/t4294967306(0) o4->24a87249-c61f-41a1-85ec-9a313129e739@192.168.203.30@tcp:298/0 lens 504/448 e 0 to 0 dl 1782217058 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782217047.969671:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff952d4449ce00 with x1868789693099136 ext(0->12) 00010000:00010000:3.0:1782217047.969689:0:8439:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ebd05488/0x92b8e04cbf5f9e18 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735aa expref: 9 pid: 8435 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217047.969702:0:8439:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ebd05488/0x92b8e04cbf5f9e18 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735aa expref: 9 pid: 8435 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782217047.969709:0:8439:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff952d4449ce00 00000100:00100000:0.0:1782217047.972198:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217047.972429:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693099264 00000100:00100000:3.0:1782217047.972439:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693099264 00010000:00010000:3.0:1782217047.972478:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ebd05488/0x92b8e04cbf5f9e18 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735aa expref: 9 pid: 8435 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217047.972521:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 81 00000100:00100000:3.0:1782217047.972532:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24a87249-c61f-41a1-85ec-9a313129e739+9:2404:x1868789693099264:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782217047.972564:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1782217047.972837:0:6504:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1782217047.972842:0:6504:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1782217047 00002000:00010000:3.0:1782217047.972844:0:6504:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1782217047 00002000:00010000:3.0:1782217047.972846:0:6504:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1782217047 00002000:00010000:3.0:1782217047.972848:0:6504:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1782217047.972856:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ebd05488/0x92b8e04cbf5f9e18 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735aa expref: 9 pid: 8435 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217047.972871:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ebd05488/0x92b8e04cbf5f9e18 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735aa expref: 9 pid: 8435 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217047.972898:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782217047.972902:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782217047.972907:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f12237b9/0x92b8e04cbf5f9e65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217047.972918:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f12237b9/0x92b8e04cbf5f9e65 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217047.972939:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217047.973037:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24a87249-c61f-41a1-85ec-9a313129e739+9:2404:x1868789693099264:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 506us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217047.973046:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 81 00010000:00010000:2.0:1782217047.973251:0:10025:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ebd05488/0x92b8e04cbf5f9e18 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735aa expref: 8 pid: 8435 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217047.973267:0:10025:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4449f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10025:1868789713088384:192.168.203.30@tcp:104: 00010000:00010000:2.0:1782217047.973287:0:10025:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f12237b9/0x92b8e04cbf5f9e65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.973299:0:10025:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f12237b9/0x92b8e04cbf5f9e65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.973305:0:10025:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f12237b9/0x92b8e04cbf5f9e65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.973324:0:10025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f12237b9/0x92b8e04cbf5f9e65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.973343:0:10025:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f12237b9/0x92b8e04cbf5f9e65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.973350:0:10025:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f12237b9/0x92b8e04cbf5f9e65 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.973357:0:10025:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43072e00 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:2.0:1782217047.973361:0:10025:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f12237b9/0x92b8e04cbf5f9e65 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.973370:0:10025:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f12237b9/0x92b8e04cbf5f9e65 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.973382:0:10025:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f12237b9/0x92b8e04cbf5f9e65 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.973389:0:10025:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f12237b9/0x92b8e04cbf5f9e65 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217047.973441:0:10025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e74f8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:24a87249-c61f-41a1-85ec-9a313129e739+7:2403:x1868789693098880:12345-192.168.203.30@tcp:1:lfs.0 Request processed in 8796us (10139us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217047.973449:0:10025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 57 00000100:00100000:3.0:1782217047.976086:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217047.976164:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693099520 00000100:00100000:2.0:1782217047.976173:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693099520 00000100:00100000:2.0:1782217047.976429:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 38 00000100:00100000:2.0:1782217047.976452:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e64f08450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+27:12232:x1868789693099520:12345-192.168.203.30@tcp:35:lfs.0 00000004:00010000:2.0:1782217047.976514:0:6521:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5f9e57 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735c6 expref: 27 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782217047.976723:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1782217047.976770:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:2.0:1782217047.977036:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00010000:00010000:2.0:1782217047.977067:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9e6c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.977081:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f9e03 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97359c expref: 31 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.977091:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9e6c lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.977124:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f9e03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97359c expref: 31 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217047.977139:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f9e03 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97359c expref: 31 pid: 6518 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217047.977154:0:6521:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d44401c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1868789713088512:192.168.203.30@tcp:104: 00000100:00100000:2.0:1782217047.977240:0:6521:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e51f750c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782217047.983747:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217047.984920:0:6521:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d44401c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1868789713088512:192.168.203.30@tcp:104: 00010000:00010000:2.0:1782217047.984953:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9e6c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217047.985074:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693099648 00000100:00100000:0.0:1782217047.985086:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693099648 00010000:00010000:0.0:1782217047.985133:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f9e03 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97359c expref: 32 pid: 6518 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217047.985172:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 82 00000100:00100000:0.0:1782217047.985182:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4449df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24a87249-c61f-41a1-85ec-9a313129e739+32:2402:x1868789693099648:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782217047.985198:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217047.985206:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f9e03 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97359c expref: 32 pid: 6518 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217047.985218:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f9e03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97359c expref: 32 pid: 6518 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217047.985241:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f9e03 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97359c expref: 32 pid: 6518 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217047.985255:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952d410a7900) 00010000:00010000:0.0:1782217047.985260:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9e6c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217047.985269:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9e6c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217047.985277:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9e6c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217047.985306:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217047.985365:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4449df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24a87249-c61f-41a1-85ec-9a313129e739+31:2402:x1868789693099648:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 180us (1623us total) trans 0 rc 0/0 00010000:00010000:3.0:1782217047.985372:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9e6c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217047.985391:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 82 00010000:00010000:3.0:1782217047.985403:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9e6c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782217047.985511:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000001:00080000:3.0:1782217047.985746:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:3.0:1782217047.985837:0:6521:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43e91880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1868789713088640:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1782217047.985889:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217047.985926:0:6521:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43721a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782217047.986097:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713088640 00000100:00100000:2.0:1782217047.986103:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713088640 00000100:00100000:2.0:1782217047.986155:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1782217047.986164:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6521:x1868789713088640:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1782217047.986269:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6521:x1868789713088640:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 104us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217047.986276:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1782217047.986416:0:6521:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43e91880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1868789713088640:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1782217047.986531:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00000100:00100000:1.0:1782217047.986574:0:6521:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4449ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1868789713088768:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1782217047.986647:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217047.986662:0:6521:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43787d80 going to sleep for 11 seconds 00000100:00080000:0.0:1782217047.986928:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782217047.987015:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713088768 00000100:00100000:2.0:1782217047.987021:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713088768 00000100:00100000:2.0:1782217047.987057:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1782217047.987066:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4449f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6521:x1868789713088768:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1782217047.987190:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4449f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6521:x1868789713088768:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 124us (540us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1782217047.987198:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1782217047.987262:0:6521:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4449ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1868789713088768:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1782217047.987304:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:3.0:1782217047.987338:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9e6c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217047.987348:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9e6c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217047.987356:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9e6c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217047.987362:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2c400 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217047.987366:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9e6c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217047.987374:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9e6c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217047.987388:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952d410a7900) 00010000:00010000:3.0:1782217047.987392:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1782217047.987396:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9e6c lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217047.987414:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9e6c lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782217047.987507:0:6521:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1782217047.987908:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:3.0:1782217047.987925:0:6521:0:(osp_sync.c:1862:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 410971341819ns, next at 411971339106ns, rc = 0 00000001:00080000:3.0:1782217047.987933:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967433 00010000:00010000:3.0:1782217047.987960:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952d410a7900) 00010000:00010000:3.0:1782217047.987963:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1782217047.987970:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5f9e57 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735c6 expref: 35 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217047.988070:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e64f08450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+34:12232:x1868789693099520:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 11619us (11992us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1782217047.988079:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 38 00000020:00080000:3.0:1782217047.988083:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1782217047.992068:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217047.992154:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693099776 00000100:00100000:0.0:1782217047.992163:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693099776 00000100:00100000:0.0:1782217047.992223:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 162 00000100:00100000:0.0:1782217047.992233:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4449f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+34:12232:x1868789693099776:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1782217047.992373:0:6548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217047.992395:0:6548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9e73 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9735cd expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217047.992448:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9e73 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735cd expref: 35 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217047.992463:0:6548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9e73 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735cd expref: 35 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217047.992478:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952d427f5700) 00010000:00010000:0.0:1782217047.992482:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782217047.992485:0:6548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e4121c600, rc 0) 00000100:00100000:0.0:1782217047.992831:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4449f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+35:12232:x1868789693099776:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 598us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217047.992839:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 162 00000100:00100000:0.0:1782217048.000835:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217048.000890:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217048.000930:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217048.000966:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217048.001000:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693100032 00000100:00100000:0.0:1782217048.001022:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693100032 00000100:00100000:0.0:1782217048.001072:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693100288 00000100:00100000:0.0:1782217048.001075:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693100288 00000100:00100000:0.0:1782217048.001099:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 329 00000100:00100000:0.0:1782217048.001108:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+5:2402:x1868789693100032:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782217048.001185:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+5:2402:x1868789693100032:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 71us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217048.001193:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 329 00000100:00100000:0.0:1782217048.001211:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 330 00000100:00100000:0.0:1782217048.001218:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a927f5f6-9735-45e0-abce-963bd125e020+5:2402:x1868789693100288:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782217048.001245:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a927f5f6-9735-45e0-abce-963bd125e020+5:2402:x1868789693100288:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 28us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217048.001251:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 330 00000100:00080000:0.0:1782217048.001268:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782217048.001620:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693099904 00000100:00100000:1.0:1782217048.001626:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693099904 00000100:00100000:1.0:1782217048.001655:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 390 00000100:00100000:1.0:1782217048.001663:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:2402:x1868789693099904:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1782217048.001702:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:2402:x1868789693099904:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 40us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217048.001709:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 390 00000100:00100000:1.0:1782217048.002354:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217048.002439:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693100160 00000100:00100000:2.0:1782217048.002445:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693100160 00000100:00100000:2.0:1782217048.002499:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 103 00000100:00100000:2.0:1782217048.002507:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:24a87249-c61f-41a1-85ec-9a313129e739+6:2402:x1868789693100160:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1782217048.002549:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:24a87249-c61f-41a1-85ec-9a313129e739+6:2402:x1868789693100160:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 43us (1658us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217048.002556:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 103 00000100:00100000:0.0:1782217048.002833:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693100544 00000100:00100000:0.0:1782217048.002837:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693100544 00000100:00100000:0.0:1782217048.002868:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 39 00000100:00100000:0.0:1782217048.002874:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4449ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24a87249-c61f-41a1-85ec-9a313129e739+35:12232:x1868789693100544:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:0.0:1782217048.003058:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4449ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24a87249-c61f-41a1-85ec-9a313129e739+36:12232:x1868789693100544:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 183us (705us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1782217048.003067:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 39 00000100:00080000:1.0:1782217048.003220:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1782217048.061738:0:13796:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782217048.061747:0:13796:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782217048.061841:0:13796:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1782217048.061848:0:13796:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1782217048.081514:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217048.081620:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693100800 00000100:00100000:0.0:1782217048.081631:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693100800 00000100:00100000:0.0:1782217048.081706:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 163 00000100:00100000:0.0:1782217048.081716:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4449c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+36:12242:x1868789693100800:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1782217048.081740:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217048.081782:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f9e7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9735d4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782217048.081875:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1782217048.081972:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f9e7a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735d4 expref: 38 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217048.081986:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d410a7100) 00010000:00010000:0.0:1782217048.081990:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782217048.081995:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f9e7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735d4 expref: 38 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217048.082008:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e4121ca00, rc 0) 00000100:00100000:0.0:1782217048.082066:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4449c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+37:12242:x1868789693100800:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 352us (563us total) trans 4294967436 rc 301/301 00000100:00100000:0.0:1782217048.082073:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 163 00000100:00100000:2.0:1782217048.087975:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217048.088075:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693100928 00000100:00100000:3.0:1782217048.088085:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693100928 00000100:00100000:3.0:1782217048.088140:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 164 00000100:00100000:3.0:1782217048.088150:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d44401c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+37:12242:x1868789693100928:12345-192.168.203.30@tcp:34:lfs.0 00010000:00010000:3.0:1782217048.088232:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5f9e88 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.088249:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5f9e88 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.088262:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5f9e88 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.088291:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f9e8f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.088299:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f9e8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.088305:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f9e8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.088378:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f9e96 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.088387:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f9e96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.088395:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f9e96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782217048.088443:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f9e96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.088455:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5f9e88 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.088461:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5f9e88 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.088469:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5f9e88 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.088475:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b363e00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217048.088479:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5f9e88 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.088493:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5f9e88 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.088505:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff952e6105c600) 00010000:00010000:3.0:1782217048.088509:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217048.088513:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5f9e88 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.088520:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5f9e88 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.088533:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f9e8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.088538:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f9e8f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.088544:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f9e8f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.088549:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362000 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217048.088551:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f9e8f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.088556:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f9e8f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.088562:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff952d410a7700) 00010000:00010000:3.0:1782217048.088564:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217048.088567:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f9e8f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.088607:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f9e8f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.088619:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f9e96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.088624:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f9e96 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.088629:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f9e96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.088633:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362400 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217048.088636:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f9e96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.088641:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f9e96 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.088649:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952d427f5700) 00010000:00010000:3.0:1782217048.088651:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217048.088654:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f9e96 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.088660:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f9e96 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217048.088740:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d44401c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+37:12242:x1868789693100928:12345-192.168.203.30@tcp:34:lfs.0 Request processed in 589us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217048.088748:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 164 00000100:00100000:1.0:1782217048.093543:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217048.093729:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693101184 00000100:00100000:0.0:1782217048.093741:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693101184 00000100:00100000:0.0:1782217048.093799:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 40 00000100:00100000:0.0:1782217048.093810:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4449e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24a87249-c61f-41a1-85ec-9a313129e739+37:12242:x1868789693101184:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:0.0:1782217048.094024:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4449e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24a87249-c61f-41a1-85ec-9a313129e739+38:12242:x1868789693101184:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 216us (490us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1782217048.094032:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 40 00000100:00100000:0.0:1782217048.129926:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217048.130000:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693101440 00000100:00100000:2.0:1782217048.130010:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693101440 00000100:00100000:2.0:1782217048.130070:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 165 00000100:00100000:2.0:1782217048.130079:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+38:12245:x1868789693101440:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1782217048.130103:0:6548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217048.130122:0:6548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f9e9d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9735db expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.130197:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9ea4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.130221:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9ea4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.130233:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9ea4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.130245:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9eab lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.130252:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9eab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.130259:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9eab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.130373:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9eb2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.130383:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.130403:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217048.130413:0:6548:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1782217048.130495:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9ea4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.130502:0:6548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9ea4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.130515:0:6548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9ea4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.130522:0:6548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2cc00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782217048.130526:0:6548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9ea4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.130533:0:6548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9ea4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.130544:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff952e6105c600) 00010000:00010000:2.0:1782217048.130547:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217048.130552:0:6548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9ea4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.130557:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9ea4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.130570:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9eab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.130576:0:6548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9eab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.130637:0:6548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9eab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.130642:0:6548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2c200 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782217048.130644:0:6548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9eab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.131353:0:6548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9eab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.131365:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff952d410a7700) 00010000:00010000:2.0:1782217048.131368:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217048.131371:0:6548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9eab lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.131376:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9eab lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.131418:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f9e9d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735db expref: 41 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.131431:0:6548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9eb2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735db expref: 40 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.131438:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952d427f5700) 00010000:00010000:2.0:1782217048.131440:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782217048.131443:0:6548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2d800, rc 0) 00000100:00100000:2.0:1782217048.133971:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+40:12245:x1868789693101440:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 3879us (4040us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1782217048.133999:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 165 00000100:00100000:2.0:1782217048.137318:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217048.137388:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693101568 00000100:00100000:3.0:1782217048.137398:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693101568 00000100:00100000:3.0:1782217048.137456:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 166 00000100:00100000:3.0:1782217048.137467:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d44400000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+40:12245:x1868789693101568:12345-192.168.203.30@tcp:54:lfs.0 00010000:00010000:3.0:1782217048.137533:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f9ec0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.137551:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f9ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.137562:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f9ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.137632:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f9ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.137639:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f9ec0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.137646:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f9ec0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.137652:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362400 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217048.137657:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f9ec0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.137665:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f9ec0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.137686:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952d427f5700) 00010000:00010000:3.0:1782217048.137689:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782217048.137694:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f9ec0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.137716:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f9ec0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217048.137792:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d44400000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+40:12245:x1868789693101568:12345-192.168.203.30@tcp:54:lfs.0 Request processed in 327us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217048.137800:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 166 00000100:00100000:1.0:1782217048.140951:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217048.141045:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693101824 00000100:00100000:0.0:1782217048.141055:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693101824 00000100:00100000:0.0:1782217048.141136:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 41 00000100:00100000:0.0:1782217048.141146:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4449d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24a87249-c61f-41a1-85ec-9a313129e739+40:12245:x1868789693101824:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:0.0:1782217048.142562:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4449d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24a87249-c61f-41a1-85ec-9a313129e739+41:12245:x1868789693101824:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 1409us (1610us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1782217048.142575:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 41 00000040:00080000:1.0:1782217048.377296:0:13800:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1782217048.455741:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217048.455899:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693102080 00000100:00100000:2.0:1782217048.455910:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693102080 00000100:00100000:2.0:1782217048.455985:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 167 00000100:00100000:2.0:1782217048.455995:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+41:12276:x1868789693102080:12345-192.168.203.30@tcp:101:cat.0 00010000:00010000:2.0:1782217048.456021:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217048.456043:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9ec7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9735e2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.456161:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9ece lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.456176:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9ece lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.456187:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9ece lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217048.456197:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1782217048.456300:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9ec7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735e2 expref: 44 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.456319:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9ece lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735e2 expref: 43 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.456328:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952d427f5700) 00010000:00010000:2.0:1782217048.456330:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782217048.456347:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2cc00, rc 0) 00000100:00100000:2.0:1782217048.456409:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+43:12276:x1868789693102080:12345-192.168.203.30@tcp:101:cat.0 Request processed in 416us (677us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1782217048.456417:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 167 00000100:00100000:2.0:1782217048.467698:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217048.467789:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693102336 00000100:00100000:3.0:1782217048.467800:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693102336 00000100:00100000:3.0:1782217048.467857:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 42 00000100:00100000:3.0:1782217048.467867:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d44401500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+43:12276:x1868789693102336:12345-192.168.203.30@tcp:35:cat.0 00000100:00100000:3.0:1782217048.468101:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d44401500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+44:12276:x1868789693102336:12345-192.168.203.30@tcp:35:cat.0 Request processed in 235us (412us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1782217048.468110:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 42 00000100:00100000:1.0:1782217048.474917:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217048.475840:0:13731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693102464 00000100:00100000:2.0:1782217048.475851:0:13731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693102464 00000100:00100000:2.0:1782217048.475924:0:13731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 13 00000100:00100000:2.0:1782217048.475935:0:13731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4449c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:24a87249-c61f-41a1-85ec-9a313129e739+44:2402:x1868789693102464:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782217048.475951:0:13731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217048.475975:0:13731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9ece lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735e2 expref: 44 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.475993:0:13731:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952d427f5700) 00010000:00010000:2.0:1782217048.475998:0:13731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217048.476127:0:13731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4449c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:24a87249-c61f-41a1-85ec-9a313129e739+43:2402:x1868789693102464:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 193us (1218us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217048.476136:0:13731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 13 00000100:00100000:3.0:1782217048.522129:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217048.522403:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693102720 00000100:00100000:1.0:1782217048.522414:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693102720 00000100:00100000:1.0:1782217048.522476:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 168 00000100:00100000:1.0:1782217048.522486:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+43:12282:x1868789693102720:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:1.0:1782217048.522509:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217048.522525:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1782217048.522551:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9e34 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735b8 expref: 43 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217048.522571:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff952e6105c600) 00010000:00010000:1.0:1782217048.522576:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782217048.522637:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9edc lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9735e9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217048.522763:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9ee3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217048.522777:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9eb2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735db expref: 43 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217048.522786:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9ee3 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217048.522817:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9eb2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735db expref: 43 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217048.522829:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9eb2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735db expref: 43 pid: 6548 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217048.522842:0:6520:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4449e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1868789713088896:192.168.203.30@tcp:104: 00000100:00100000:1.0:1782217048.523057:0:6520:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43787b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782217048.530870:0:6520:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4449e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1868789713088896:192.168.203.30@tcp:104: 00010000:00010000:1.0:1782217048.530899:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9ee3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217048.532737:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217048.533043:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693102848 00000100:00100000:0.0:1782217048.533052:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693102848 00010000:00010000:0.0:1782217048.533091:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9eb2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735db expref: 44 pid: 6548 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217048.533132:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 83 00000100:00100000:0.0:1782217048.533142:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e6f92d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24a87249-c61f-41a1-85ec-9a313129e739+44:2403:x1868789693102848:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782217048.533159:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217048.533165:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9eb2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735db expref: 44 pid: 6548 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217048.533186:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9eb2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735db expref: 44 pid: 6548 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217048.533217:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9eb2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735db expref: 44 pid: 6548 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217048.533233:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952d427f5700) 00010000:00010000:0.0:1782217048.533238:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9ee3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217048.533247:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9ee3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217048.533270:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9ee3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217048.533301:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217048.533352:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e6f92d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24a87249-c61f-41a1-85ec-9a313129e739+43:2403:x1868789693102848:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 210us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217048.533360:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 83 00010000:00010000:3.0:1782217048.533991:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9ee3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.534002:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9ee3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217048.534022:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1782217048.534147:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9edc lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735e9 expref: 44 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.534164:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9ee3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735e9 expref: 43 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.534196:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952d427f5700) 00010000:00010000:3.0:1782217048.534199:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1782217048.534201:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43072200, rc 0) 00000100:00100000:3.0:1782217048.534290:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+43:12282:x1868789693102720:12345-192.168.203.30@tcp:101:dd.0 Request processed in 11805us (12170us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1782217048.534297:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 168 00000100:00100000:0.0:1782217048.539157:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217048.539429:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693102976 00000100:00100000:2.0:1782217048.539439:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693102976 00000100:00100000:2.0:1782217048.539496:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 169 00000100:00100000:2.0:1782217048.539506:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+43:12282:x1868789693102976:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:2.0:1782217048.539527:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217048.539546:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9ef1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9735f0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.539613:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f9ef8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.539641:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f9ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.539652:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f9ef8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.539790:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9ef1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735f0 expref: 45 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.539809:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f9ef8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735f0 expref: 44 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.539819:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952d427f5700) 00010000:00010000:2.0:1782217048.539822:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782217048.539826:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2c800, rc 0) 00000100:00100000:2.0:1782217048.539887:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+44:12282:x1868789693102976:12345-192.168.203.30@tcp:101:dd.0 Request processed in 382us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217048.539895:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 169 00000100:00100000:2.0:1782217048.543396:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217048.543475:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693103232 00000100:00100000:0.0:1782217048.543484:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693103232 00000100:00100000:0.0:1782217048.543535:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 170 00000100:00100000:0.0:1782217048.543543:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d44403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+44:12282:x1868789693103232:12345-192.168.203.30@tcp:36:dd.0 00010000:00010000:0.0:1782217048.543809:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d800/0x92b8e04cbf5f9eff lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217048.543827:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d800/0x92b8e04cbf5f9eff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217048.543838:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d800/0x92b8e04cbf5f9eff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782217048.543882:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1782217048.543904:0:6519:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009bf63af9 reply state 00000000a1b2e0e5 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d800/0x92b8e04cbf5f9eff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217048.543916:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d800/0x92b8e04cbf5f9eff lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217048.543923:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952d427f5700) 00010000:00010000:0.0:1782217048.543939:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782217048.543955:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782217048.544041:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d44403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+47:12282:x1868789693103232:12345-192.168.203.30@tcp:36:dd.0 Request processed in 497us (651us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1782217048.544048:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 170 00000020:00080000:0.0:1782217048.544053:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1782217048.569240:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782217048.852644:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217048.852767:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693103360 00000100:00100000:2.0:1782217048.852777:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693103360 00000100:00100000:2.0:1782217048.852839:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 171 00000100:00100000:2.0:1782217048.852850:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4449e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+47:12296:x1868789693103360:12345-192.168.203.30@tcp:101:stat.0 00010000:00010000:2.0:1782217048.852875:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217048.852896:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9f06 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9735f7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.853657:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9f0d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.853684:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9f0d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.853697:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9f0d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.853710:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5f9f14 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.853717:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5f9f14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.853723:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5f9f14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.853797:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9f1b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.853811:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9ee3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735e9 expref: 48 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.853820:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9f1b lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.853859:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9ee3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735e9 expref: 48 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.853888:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9ee3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735e9 expref: 48 pid: 6520 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217048.853904:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d44400e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1868789713089024:192.168.203.30@tcp:104: 00000100:00100000:2.0:1782217048.854572:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e51f75000 going to sleep for 11 seconds 00000100:00100000:2.0:1782217048.863564:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d44400e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1868789713089024:192.168.203.30@tcp:104: 00000100:00100000:1.0:1782217048.863824:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217048.863953:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693103616 00000100:00100000:3.0:1782217048.863971:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693103616 00010000:00010000:2.0:1782217048.864166:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9f1b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217048.864290:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 43 00000100:00100000:3.0:1782217048.864302:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4449c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+49:6171:x1868789693103616:12345-192.168.203.30@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1782217048.864572:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4449c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+50:6171:x1868789693103616:12345-192.168.203.30@tcp:35:ldlm_bl.0 Request processed in 271us (747us total) trans 4294967445 rc 0/0 00000100:00100000:3.0:1782217048.864612:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 43 00000100:00100000:1.0:1782217048.868597:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217048.868774:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693103744 00000100:00100000:2.0:1782217048.868783:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693103744 00010000:00010000:2.0:1782217048.868824:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9ee3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735e9 expref: 50 pid: 6520 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217048.868868:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 84 00000100:00100000:2.0:1782217048.868878:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4449df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24a87249-c61f-41a1-85ec-9a313129e739+50:2403:x1868789693103744:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782217048.868894:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217048.868900:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9ee3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735e9 expref: 50 pid: 6520 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.868914:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9ee3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735e9 expref: 50 pid: 6520 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.869111:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9ee3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735e9 expref: 50 pid: 6520 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.869145:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952d427f5700) 00010000:00010000:2.0:1782217048.869150:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9f1b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.869159:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9f1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.869166:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9f1b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217048.869201:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217048.869255:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4449df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24a87249-c61f-41a1-85ec-9a313129e739+49:2403:x1868789693103744:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 378us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217048.869263:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 84 00010000:00010000:3.0:1782217048.870781:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9f1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.870795:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9f1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217048.870851:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1782217048.870855:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782217048.870879:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9f1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.870891:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9f1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.871798:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9f0d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.871810:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9f0d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.871817:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9f0d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.871823:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2d000 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217048.871827:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9f0d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.871835:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9f0d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.871851:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff952e6105c600) 00010000:00010000:3.0:1782217048.871854:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217048.871859:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9f0d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.871865:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9f0d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.871881:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5f9f14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.871887:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5f9f14 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.871892:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5f9f14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.871909:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2ca00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217048.871912:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5f9f14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.872102:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5f9f14 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.872113:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff952d410a7700) 00010000:00010000:3.0:1782217048.872115:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217048.872118:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5f9f14 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.872123:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5f9f14 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.872166:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9f06 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735f7 expref: 49 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.872181:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9f1b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735f7 expref: 48 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217048.872188:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952d427f5700) 00010000:00010000:3.0:1782217048.872191:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782217048.872194:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2d800, rc 0) 00000100:00100000:3.0:1782217048.872301:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4449e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+48:12296:x1868789693103360:12345-192.168.203.30@tcp:101:stat.0 Request processed in 19450us (19664us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217048.872310:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 171 00000100:00100000:1.0:1782217048.966240:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217048.966502:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693104000 00000100:00100000:0.0:1782217048.966512:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693104000 00000100:00100000:0.0:1782217048.966570:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 172 00000100:00100000:0.0:1782217048.966623:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4449c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+48:12302:x1868789693104000:12345-192.168.203.30@tcp:36:truncate.0 00010000:00010000:0.0:1782217048.966690:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217048.966717:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5f9f1b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735f7 expref: 48 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217048.966735:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952d427f5700) 00010000:00010000:0.0:1782217048.966740:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782217048.966905:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d000/0x92b8e04cbf5f9f22 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217048.966919:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d000/0x92b8e04cbf5f9f22 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217048.966929:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d000/0x92b8e04cbf5f9f22 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782217048.967094:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967446 00000004:00010000:0.0:1782217048.967118:0:6519:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005ab1d817 reply state 00000000b89c7f6b transno 4294967447 ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d000/0x92b8e04cbf5f9f22 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217048.967131:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d000/0x92b8e04cbf5f9f22 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217048.967151:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952d427f5700) 00010000:00010000:0.0:1782217048.967154:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782217048.967157:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782217048.967318:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4449c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+50:12302:x1868789693104000:12345-192.168.203.30@tcp:36:truncate.0 Request processed in 696us (1086us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1782217048.967326:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 172 00000020:00080000:0.0:1782217048.967331:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1782217049.100118:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217049.100227:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693104128 00000100:00100000:0.0:1782217049.100236:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693104128 00000100:00100000:0.0:1782217049.100314:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 173 00000100:00100000:0.0:1782217049.100324:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d44400e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+50:12316:x1868789693104128:12345-192.168.203.30@tcp:101:stat.0 00010000:00010000:0.0:1782217049.100346:0:6548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217049.100365:0:6548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121dc00/0x92b8e04cbf5f9f29 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9735fe expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217049.100424:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c400/0x92b8e04cbf5f9f30 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217049.100437:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c400/0x92b8e04cbf5f9f30 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217049.100449:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c400/0x92b8e04cbf5f9f30 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217049.100459:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f9f37 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217049.100466:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f9f37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217049.100490:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f9f37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217049.100563:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9f3e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217049.100572:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9f3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217049.100578:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9f3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782217049.100651:0:6548:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1782217049.100656:0:6548:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782217049.100684:0:6548:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9f3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217049.100696:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9f3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217049.100703:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c400/0x92b8e04cbf5f9f30 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217049.100709:0:6548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c400/0x92b8e04cbf5f9f30 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217049.100716:0:6548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c400/0x92b8e04cbf5f9f30 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217049.100721:0:6548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121c400 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782217049.100725:0:6548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c400/0x92b8e04cbf5f9f30 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217049.100738:0:6548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c400/0x92b8e04cbf5f9f30 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217049.100762:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff952e6105c600) 00010000:00010000:0.0:1782217049.100765:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217049.100770:0:6548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c400/0x92b8e04cbf5f9f30 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217049.100775:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c400/0x92b8e04cbf5f9f30 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217049.100789:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f9f37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217049.100794:0:6548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f9f37 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217049.100799:0:6548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f9f37 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217049.100803:0:6548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121ca00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782217049.100806:0:6548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f9f37 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217049.100811:0:6548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f9f37 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217049.100818:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff952d410a7700) 00010000:00010000:0.0:1782217049.100820:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217049.100823:0:6548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f9f37 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217049.100838:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5f9f37 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217049.100864:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121dc00/0x92b8e04cbf5f9f29 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735fe expref: 52 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217049.100874:0:6548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9f3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735fe expref: 51 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217049.100881:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952d427f5700) 00010000:00010000:0.0:1782217049.100883:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782217049.100885:0:6548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e4121d600, rc 0) 00000100:00100000:0.0:1782217049.100949:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d44400e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+51:12316:x1868789693104128:12345-192.168.203.30@tcp:101:stat.0 Request processed in 627us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217049.100956:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 173 00000100:00080000:1.0:1782217049.101171:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782217049.163248:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217049.163366:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693104384 00000100:00100000:2.0:1782217049.163377:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693104384 00000100:00100000:2.0:1782217049.163430:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 174 00000100:00100000:2.0:1782217049.163439:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4449d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+51:12326:x1868789693104384:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1782217049.163459:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217049.163479:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f9f45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973605 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217049.163619:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1782217049.163876:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f9f45 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973605 expref: 53 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217049.163907:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d410a7100) 00010000:00010000:2.0:1782217049.163910:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782217049.164014:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f9f45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973605 expref: 53 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217049.164030:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2c600, rc 0) 00000100:00100000:2.0:1782217049.164087:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4449d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+52:12326:x1868789693104384:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 649us (847us total) trans 4294967448 rc 301/301 00000100:00100000:2.0:1782217049.164095:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 174 00000100:00100000:2.0:1782217049.168391:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217049.168558:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693104640 00000100:00100000:0.0:1782217049.168568:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693104640 00000100:00100000:0.0:1782217049.168882:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 44 00000100:00100000:0.0:1782217049.168893:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e50127850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24a87249-c61f-41a1-85ec-9a313129e739+52:12326:x1868789693104640:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:0.0:1782217049.169105:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e50127850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24a87249-c61f-41a1-85ec-9a313129e739+53:12326:x1868789693104640:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 214us (723us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1782217049.169113:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 44 00000100:00100000:0.0:1782217049.233832:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217049.233940:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693104896 00000100:00100000:2.0:1782217049.233950:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693104896 00000100:00100000:2.0:1782217049.234012:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 175 00000100:00100000:2.0:1782217049.234022:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+53:12332:x1868789693104896:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:2.0:1782217049.234045:0:6548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217049.234065:0:6548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f9f53 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be97360c expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217049.234186:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9f5a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217049.234200:0:6548:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9f3e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735fe expref: 54 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217049.234209:0:6548:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9f5a lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217049.234260:0:6548:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9f3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735fe expref: 54 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217049.234272:0:6548:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9f3e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735fe expref: 54 pid: 6548 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217049.234286:0:6548:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d44401f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6548:1868789713089152:192.168.203.30@tcp:104: 00000100:00100000:2.0:1782217049.234386:0:6548:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e51f75000 going to sleep for 11 seconds 00000100:00100000:2.0:1782217049.240131:0:6548:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d44401f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6548:1868789713089152:192.168.203.30@tcp:104: 00010000:00010000:2.0:1782217049.240158:0:6548:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9f5a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217049.255075:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217049.259164:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693105024 00000100:00100000:3.0:1782217049.259300:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693105024 00010000:00010000:3.0:1782217049.259349:0:8449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9f3e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735fe expref: 55 pid: 6548 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217049.259467:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 85 00000100:00100000:3.0:1782217049.259486:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:24a87249-c61f-41a1-85ec-9a313129e739+55:2402:x1868789693105024:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782217049.259502:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217049.259510:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9f3e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735fe expref: 55 pid: 6548 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.259524:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9f3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735fe expref: 55 pid: 6548 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.259547:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5f9f3e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735fe expref: 55 pid: 6548 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.259563:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952d427f5700) 00010000:00010000:3.0:1782217049.259568:0:8449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9f5a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.259578:0:8449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9f5a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.259625:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9f5a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.259661:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217049.259728:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:24a87249-c61f-41a1-85ec-9a313129e739+54:2402:x1868789693105024:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 243us (4662us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217049.259746:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 85 00010000:00010000:1.0:1782217049.259810:0:6548:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9f5a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217049.259830:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9f5a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782217049.259849:0:6548:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1782217049.259974:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5f9f53 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97360c expref: 55 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217049.259991:0:6548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9f5a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97360c expref: 54 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217049.259998:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952d427f5700) 00010000:00010000:1.0:1782217049.260001:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782217049.260003:0:6548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2cc00, rc 0) 00000100:00100000:1.0:1782217049.260027:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+54:12332:x1868789693104896:12345-192.168.203.30@tcp:101:bash.0 Request processed in 26008us (26206us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1782217049.260034:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 175 00000100:00100000:1.0:1782217049.271006:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217049.273457:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693105280 00000100:00100000:2.0:1782217049.273480:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693105280 00000100:00100000:2.0:1782217049.273558:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 176 00000100:00100000:2.0:1782217049.273568:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4449ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+54:12332:x1868789693105280:12345-192.168.203.30@tcp:36:bash.0 00010000:00010000:2.0:1782217049.274012:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9f68 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217049.274028:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9f68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217049.274037:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9f68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782217049.274091:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967451 00000004:00010000:2.0:1782217049.274114:0:6519:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f8b103aa reply state 00000000af28e5e2 transno 4294967452 ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9f68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217049.274137:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9f68 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217049.274145:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952d427f5700) 00010000:00010000:2.0:1782217049.274148:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1782217049.274150:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782217049.274392:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4449ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+57:12332:x1868789693105280:12345-192.168.203.30@tcp:36:bash.0 Request processed in 823us (3394us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1782217049.274399:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 176 00000020:00080000:2.0:1782217049.274405:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1782217049.280868:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217049.281004:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693105408 00000100:00100000:3.0:1782217049.281014:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693105408 00000100:00100000:3.0:1782217049.281083:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 177 00000100:00100000:3.0:1782217049.281093:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d44401f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+57:12332:x1868789693105408:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:3.0:1782217049.281116:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217049.281135:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f9f6f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973613 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.281467:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f9f76 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.281495:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9f5a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97360c expref: 58 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.281505:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f9f76 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.281788:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9f5a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97360c expref: 58 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.281803:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9f5a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97360c expref: 58 pid: 6548 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217049.281818:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43e90700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1868789713089280:192.168.203.30@tcp:104: 00000100:00100000:3.0:1782217049.281923:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d437216c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782217049.286209:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217049.286996:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693105536 00000100:00100000:1.0:1782217049.287020:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693105536 00010000:00010000:1.0:1782217049.287075:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9f5a lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97360c expref: 59 pid: 6548 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217049.287119:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 86 00000100:00100000:1.0:1782217049.287129:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24a87249-c61f-41a1-85ec-9a313129e739+59:2403:x1868789693105536:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782217049.287143:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782217049.287150:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9f5a lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97360c expref: 59 pid: 6548 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217049.287163:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9f5a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97360c expref: 59 pid: 6548 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217049.287295:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952d427f5700) 00010000:00010000:1.0:1782217049.287301:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f9f76 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217049.287312:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f9f76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217049.287320:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f9f76 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217049.287340:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782217049.287407:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24a87249-c61f-41a1-85ec-9a313129e739+59:2403:x1868789693105536:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 278us (1205us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217049.287415:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 86 00010000:00010000:3.0:1782217049.287636:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5f9f5a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97360c expref: 58 pid: 6548 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217049.287670:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43e90700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1868789713089280:192.168.203.30@tcp:104: 00010000:00010000:3.0:1782217049.287694:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f9f76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.287704:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f9f76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.287710:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f9f76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217049.287776:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1782217049.287781:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782217049.287803:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f9f76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.287836:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f9f6f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973613 expref: 58 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.287851:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f9f76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973613 expref: 57 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.287857:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952d427f5700) 00010000:00010000:3.0:1782217049.287860:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782217049.287862:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b362000, rc 0) 00000100:00100000:3.0:1782217049.287889:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d44401f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+57:12332:x1868789693105408:12345-192.168.203.30@tcp:101:bash.0 Request processed in 6798us (7030us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217049.287896:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 177 00000100:00100000:0.0:1782217049.294104:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217049.294207:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693105792 00000100:00100000:3.0:1782217049.294216:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693105792 00000100:00100000:3.0:1782217049.294267:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 45 00000100:00100000:3.0:1782217049.294277:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+57:12332:x1868789693105792:12345-192.168.203.30@tcp:35:bash.0 00000100:00100000:3.0:1782217049.294501:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+58:12332:x1868789693105792:12345-192.168.203.30@tcp:35:bash.0 Request processed in 225us (407us total) trans 4294967453 rc 0/0 00000100:00100000:3.0:1782217049.294509:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 45 00000100:00100000:0.0:1782217049.410262:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217049.410428:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693106048 00000100:00100000:2.0:1782217049.410438:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693106048 00000100:00100000:2.0:1782217049.410494:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 178 00000100:00100000:2.0:1782217049.410502:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+58:12342:x1868789693106048:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1782217049.410524:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217049.410543:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9f7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be97361a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217049.410688:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1782217049.410792:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9f7d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97361a expref: 60 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217049.410807:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d410a7100) 00010000:00010000:2.0:1782217049.410810:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782217049.410815:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9f7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97361a expref: 60 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217049.410843:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2d000, rc 0) 00000100:00100000:2.0:1782217049.410888:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+59:12342:x1868789693106048:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 387us (636us total) trans 4294967454 rc 301/301 00000100:00100000:2.0:1782217049.410896:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 178 00000100:00100000:2.0:1782217049.421206:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217049.421360:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693106176 00000100:00100000:1.0:1782217049.421371:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693106176 00000100:00100000:1.0:1782217049.421447:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 179 00000100:00100000:1.0:1782217049.421456:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d44402d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+59:12342:x1868789693106176:12345-192.168.203.30@tcp:34:lfs.0 00010000:00010000:1.0:1782217049.421533:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9f8b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217049.421549:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9f8b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217049.421560:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9f8b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217049.421571:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5f9f92 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217049.421577:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5f9f92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217049.421605:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5f9f92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217049.421694:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9f99 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217049.421704:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9f99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217049.421712:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9f99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782217049.421774:0:6548:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9f99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217049.421787:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9f8b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217049.421801:0:6548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9f8b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217049.421808:0:6548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9f8b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217049.421814:0:6548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43072200 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217049.421818:0:6548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9f8b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217049.421826:0:6548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9f8b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217049.421839:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff952e6105c600) 00010000:00010000:1.0:1782217049.421842:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217049.421847:0:6548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9f8b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217049.421852:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5f9f8b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217049.421865:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5f9f92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217049.421872:0:6548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5f9f92 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217049.421877:0:6548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5f9f92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217049.421883:0:6548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43073800 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217049.421892:0:6548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5f9f92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217049.421899:0:6548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5f9f92 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217049.421907:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff952d410a7700) 00010000:00010000:1.0:1782217049.421910:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217049.421913:0:6548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5f9f92 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217049.422045:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5f9f92 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217049.422056:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9f99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217049.422062:0:6548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9f99 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217049.422068:0:6548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9f99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217049.422073:0:6548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43072e00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217049.422076:0:6548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9f99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217049.422081:0:6548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9f99 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217049.422090:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952d427f5700) 00010000:00010000:1.0:1782217049.422093:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217049.422102:0:6548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9f99 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217049.422108:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5f9f99 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217049.422365:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d44402d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+59:12342:x1868789693106176:12345-192.168.203.30@tcp:34:lfs.0 Request processed in 909us (1167us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217049.422375:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 179 00000100:00100000:0.0:1782217049.425172:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217049.425228:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693106432 00000100:00100000:3.0:1782217049.425235:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693106432 00000100:00100000:3.0:1782217049.425276:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 46 00000100:00100000:3.0:1782217049.425283:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+59:12342:x1868789693106432:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:3.0:1782217049.425457:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+60:12342:x1868789693106432:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 174us (301us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1782217049.425462:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 46 00000100:00100000:0.0:1782217049.459160:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217049.459330:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693106688 00000100:00100000:2.0:1782217049.459340:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693106688 00000100:00100000:2.0:1782217049.459395:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 180 00000100:00100000:2.0:1782217049.459404:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+60:12345:x1868789693106688:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1782217049.459426:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217049.459445:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9fa0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973621 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217049.459515:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9fa7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217049.459529:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9fa7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217049.459539:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9fa7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217049.459552:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9fae lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217049.459559:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9fae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217049.459621:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9fae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217049.459805:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5f9fb5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217049.459815:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5f9fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217049.459823:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5f9fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217049.459834:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1782217049.459910:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9fa7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217049.459918:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9fa7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217049.459923:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9fa7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217049.459929:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2c200 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782217049.459933:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9fa7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217049.459939:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9fa7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217049.459950:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff952e6105c600) 00010000:00010000:2.0:1782217049.459953:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217049.459962:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9fa7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217049.459968:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5f9fa7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217049.459981:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9fae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217049.459987:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9fae lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217049.459993:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9fae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217049.459998:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2d000 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782217049.460001:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9fae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217049.460007:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9fae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217049.460014:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff952d410a7700) 00010000:00010000:2.0:1782217049.460016:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217049.460020:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9fae lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217049.460025:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5f9fae lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217049.460061:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9fa0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973621 expref: 63 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217049.460089:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5f9fb5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973621 expref: 62 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217049.460096:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952d427f5700) 00010000:00010000:2.0:1782217049.460098:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782217049.460101:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2ca00, rc 0) 00000100:00100000:2.0:1782217049.460247:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+62:12345:x1868789693106688:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 843us (1096us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1782217049.460255:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 180 00000100:00100000:2.0:1782217049.464175:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217049.464281:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693106816 00000100:00100000:3.0:1782217049.464290:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693106816 00000100:00100000:3.0:1782217049.464344:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 181 00000100:00100000:3.0:1782217049.464352:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d44402a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+62:12345:x1868789693106816:12345-192.168.203.30@tcp:54:lfs.0 00010000:00010000:3.0:1782217049.464415:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f9fc3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.464431:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f9fc3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.464441:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f9fc3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.464472:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f9fc3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.464491:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f9fc3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.464498:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f9fc3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.464503:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362400 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217049.464507:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f9fc3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.464514:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f9fc3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.464525:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952d427f5700) 00010000:00010000:3.0:1782217049.464528:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782217049.464532:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f9fc3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.464538:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f9fc3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217049.464640:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d44402a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+62:12345:x1868789693106816:12345-192.168.203.30@tcp:54:lfs.0 Request processed in 287us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217049.464648:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 181 00000100:00100000:1.0:1782217049.465464:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217049.465568:0:13731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693106944 00000100:00100000:2.0:1782217049.465577:0:13731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693106944 00000100:00100000:2.0:1782217049.465654:0:13731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 14 00000100:00100000:2.0:1782217049.465672:0:13731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4449e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:24a87249-c61f-41a1-85ec-9a313129e739+62:2405:x1868789693106944:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782217049.465686:0:13731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217049.465705:0:13731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5f9fb5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973621 expref: 62 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217049.465721:0:13731:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952d427f5700) 00010000:00010000:2.0:1782217049.465725:0:13731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217049.465767:0:13731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4449e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:24a87249-c61f-41a1-85ec-9a313129e739+61:2405:x1868789693106944:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 105us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217049.465774:0:13731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 14 00000100:00100000:1.0:1782217049.469620:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217049.469779:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693107200 00000100:00100000:3.0:1782217049.469789:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693107200 00000100:00100000:3.0:1782217049.469842:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 47 00000100:00100000:3.0:1782217049.469851:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4449d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+61:12345:x1868789693107200:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:3.0:1782217049.470052:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4449d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+62:12345:x1868789693107200:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 201us (479us total) trans 4294967457 rc 0/0 00000100:00100000:3.0:1782217049.470072:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 47 00000100:00100000:0.0:1782217049.592328:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217049.592405:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693107456 00000100:00100000:2.0:1782217049.592415:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693107456 00000100:00100000:2.0:1782217049.592498:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 182 00000100:00100000:2.0:1782217049.592508:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+62:12363:x1868789693107456:12345-192.168.203.30@tcp:101:cat.0 00010000:00010000:2.0:1782217049.592531:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217049.592552:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5f9fca lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973628 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217049.592704:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9fd1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217049.592719:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9fd1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217049.592731:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9fd1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217049.592755:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1782217049.592859:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5f9fca lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973628 expref: 65 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217049.592877:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9fd1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973628 expref: 64 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217049.592885:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952d427f5700) 00010000:00010000:2.0:1782217049.592888:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1782217049.592891:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2c000, rc 0) 00000100:00100000:2.0:1782217049.592953:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+64:12363:x1868789693107456:12345-192.168.203.30@tcp:101:cat.0 Request processed in 446us (633us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1782217049.592960:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 182 00010000:00010000:1.0:1782217049.593619:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782217049.624567:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217049.624731:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693107584 00000100:00100000:3.0:1782217049.624754:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693107584 00000100:00100000:3.0:1782217049.624809:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 183 00000100:00100000:3.0:1782217049.624819:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4449c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+64:12364:x1868789693107584:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1782217049.624840:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217049.624859:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f9fdf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be97362f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.624925:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5f9fe6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.624942:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5f9fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.624953:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5f9fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217049.624995:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1782217049.624999:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782217049.625019:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5f9fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.625043:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f9fdf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97362f expref: 66 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.625061:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5f9fe6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97362f expref: 65 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.625089:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff952e6105c600) 00010000:00010000:3.0:1782217049.625102:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782217049.625106:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b363e00, rc 0) 00000100:00100000:3.0:1782217049.625154:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4449c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+65:12364:x1868789693107584:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 337us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217049.625159:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 183 00000100:00100000:1.0:1782217049.633019:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217049.633324:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693107968 00000100:00100000:3.0:1782217049.633335:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693107968 00000100:00100000:3.0:1782217049.633399:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 48 00000100:00100000:3.0:1782217049.633409:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4368c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+65:12364:x1868789693107968:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:3.0:1782217049.633845:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4368c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+66:12364:x1868789693107968:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 436us (833us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1782217049.633854:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 48 00000100:00100000:0.0:1782217049.636181:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217049.636442:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693108096 00000100:00100000:3.0:1782217049.636452:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693108096 00000100:00100000:3.0:1782217049.636520:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 15 00000100:00100000:3.0:1782217049.636530:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:24a87249-c61f-41a1-85ec-9a313129e739+66:12364:x1868789693108096:12345-192.168.203.30@tcp:103:lfs.0 00010000:00010000:3.0:1782217049.636545:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1782217049.636568:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f9f76 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973613 expref: 66 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.636617:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5f9fd1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973628 expref: 65 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.636631:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5f9e73 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735cd expref: 64 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.636654:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952d427f5700) 00010000:00010000:3.0:1782217049.636659:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217049.636731:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:24a87249-c61f-41a1-85ec-9a313129e739+63:12364:x1868789693108096:12345-192.168.203.30@tcp:103:lfs.0 Request processed in 201us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217049.636818:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 15 00000100:00100000:1.0:1782217049.639260:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217049.639365:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693108224 00000100:00100000:2.0:1782217049.639386:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693108224 00000100:00100000:2.0:1782217049.639484:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 184 00000100:00100000:2.0:1782217049.639495:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4368ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+63:12364:x1868789693108224:12345-192.168.203.30@tcp:58:lfs.0 00010000:00010000:2.0:1782217049.639991:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5f9fed lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217049.640007:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5f9fed lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217049.640017:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5f9fed lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782217049.640121:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1782217049.640324:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4368ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+63:12364:x1868789693108224:12345-192.168.203.30@tcp:58:lfs.0 Request processed in 829us (1070us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217049.640332:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 184 00000100:00100000:0.0:1782217049.652679:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217049.652822:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693108352 00000100:00100000:3.0:1782217049.652832:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693108352 00000100:00100000:3.0:1782217049.652891:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 185 00000100:00100000:3.0:1782217049.652901:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+63:12366:x1868789693108352:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1782217049.652923:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217049.652945:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f9ff4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973636 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.653010:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f9ffb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.653024:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f9ffb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.653035:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f9ffb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.653046:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5fa002 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.653052:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5fa002 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.653076:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5fa002 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.653150:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5fa009 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.653160:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5fa009 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.653167:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5fa009 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217049.653532:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1782217049.653537:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782217049.653557:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5fa009 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.653568:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5fa009 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.653577:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f9ffb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.653619:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f9ffb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.653625:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f9ffb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.653631:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362400 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217049.653634:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f9ffb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.653651:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f9ffb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.653674:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff952e6105c600) 00010000:00010000:3.0:1782217049.653678:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217049.653683:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f9ffb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.653689:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5f9ffb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.653705:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5fa002 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.653710:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5fa002 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.653716:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5fa002 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.653721:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362a00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217049.653724:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5fa002 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.653730:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5fa002 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.653737:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff952d410a7700) 00010000:00010000:3.0:1782217049.653854:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217049.653859:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5fa002 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.653876:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5fa002 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.653908:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5f9ff4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973636 expref: 65 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.653922:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5fa009 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973636 expref: 64 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217049.653930:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952d427f5700) 00010000:00010000:3.0:1782217049.653932:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782217049.653934:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b362c00, rc 0) 00000100:00100000:3.0:1782217049.654038:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+64:12366:x1868789693108352:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 1137us (1378us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217049.654045:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 185 00000100:00100000:2.0:1782217049.657032:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782217049.657056:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d44402300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713089408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782217049.657130:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217049.657427:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4368ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713089536:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782217049.657458:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217049.657496:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713089408 00000100:00100000:1.0:1782217049.657504:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713089408 00000100:00100000:1.0:1782217049.657545:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713089536 00000100:00100000:1.0:1782217049.657547:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713089536 00000100:00100000:1.0:1782217049.657563:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1782217049.657570:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d44401880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713089408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782217049.657611:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1782217049.657650:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d44401880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713089408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217049.657658:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1782217049.657686:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1782217049.657692:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4379ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713089536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782217049.657716:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1782217049.657756:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4379ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713089536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217049.657763:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:1.0:1782217049.657778:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782217049.657808:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4368ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713089536:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782217049.657839:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d44402300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713089408:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782217049.657930:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17bce19a-7a0f-4c9d-b31c-4e0155298487:3650:1868789713089664:0@lo:400:kworker.0 00000100:00100000:1.0:1782217049.657959:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217049.657979:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4368ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713090176:0@lo:400:kworker.0 00000100:00100000:1.0:1782217049.658001:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217049.658017:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1868789713090688:0@lo:400:kworker.0 00000100:00100000:1.0:1782217049.658039:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217049.658055:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1782217049.658059:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4379b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1868789713090048:0@lo:400:kworker.0 00000100:00100000:1.0:1782217049.658078:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217049.658092:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d410b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1868789713090560:0@lo:400:kworker.0 00000100:00100000:1.0:1782217049.658111:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217049.658132:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713089664 00000100:00100000:1.0:1782217049.658136:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713089664 00000100:00100000:1.0:1782217049.658161:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1782217049.658167:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3650:x1868789713089664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217049.658199:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3650:x1868789713089664:12345-0@lo:400:kworker.0 Request processed in 32us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217049.658216:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1782217049.658247:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713090176 00000100:00100000:1.0:1782217049.658251:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713090176 00000100:00100000:1.0:1782217049.658276:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1782217049.658282:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4360d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713090176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217049.658314:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4360d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713090176:12345-0@lo:400:kworker.0 Request processed in 32us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217049.658319:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1782217049.658341:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4379b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1868789713089792:0@lo:400:kworker.0 00000100:00100000:1.0:1782217049.658364:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217049.658379:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1868789713090304:0@lo:400:kworker.0 00000100:00100000:1.0:1782217049.658398:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217049.658406:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4360ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713090816:0@lo:400:kworker.0 00000100:00100000:1.0:1782217049.658425:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217049.658440:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1782217049.658445:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713089920:0@lo:400:kworker.0 00000100:00100000:1.0:1782217049.658464:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217049.658477:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1868789713090432:0@lo:400:kworker.0 00000100:00100000:1.0:1782217049.658496:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217049.658505:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4360f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713090944:0@lo:400:kworker.0 00000100:00100000:1.0:1782217049.658522:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217049.658544:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713089920 00000100:00100000:1.0:1782217049.658548:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713089920 00000100:00100000:1.0:1782217049.658578:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1782217049.658615:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713089920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217049.658672:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713089920:12345-0@lo:400:kworker.0 Request processed in 47us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217049.658679:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1782217049.658709:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17bce19a-7a0f-4c9d-b31c-4e0155298487:3650:1868789713089664:0@lo:400:kworker.0 00000100:00100000:1.0:1782217049.658720:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4368ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713090176:0@lo:400:kworker.0 00000100:00100000:1.0:1782217049.658750:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713089920:0@lo:400:kworker.0 00000100:00100000:1.0:1782217049.658773:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713090688 00000100:00100000:1.0:1782217049.658777:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713090688 00000100:00100000:3.0:1782217049.658778:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713090816 00000100:00100000:3.0:1782217049.658785:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713090816 00000100:00100000:1.0:1782217049.658810:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713090048 00000100:00100000:1.0:1782217049.658815:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713090048 00000100:00100000:3.0:1782217049.658823:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713090944 00000100:00100000:3.0:1782217049.658828:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713090944 00000100:00100000:1.0:1782217049.658835:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713090560 00000100:00100000:1.0:1782217049.658840:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713090560 00000100:00100000:3.0:1782217049.658855:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1782217049.658862:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713089792 00000100:00100000:3.0:1782217049.658866:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c694000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713090816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217049.658867:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713089792 00000100:00100000:1.0:1782217049.658883:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713090304 00000100:00100000:1.0:1782217049.658887:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713090304 00000100:00100000:1.0:1782217049.658900:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713090432 00000100:00100000:1.0:1782217049.658903:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713090432 00000100:00100000:1.0:1782217049.658917:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1782217049.658924:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1868789713090688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217049.658958:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1868789713090688:12345-0@lo:400:kworker.0 Request processed in 34us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217049.658965:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1782217049.658978:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1782217049.658985:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42738700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1868789713090048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217049.659011:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42738700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1868789713090048:12345-0@lo:400:kworker.0 Request processed in 27us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217049.659028:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1782217049.659042:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1782217049.659047:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1868789713090560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217049.659076:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1868789713090560:12345-0@lo:400:kworker.0 Request processed in 29us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217049.659082:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1782217049.659093:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1782217049.659099:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c695c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1868789713089792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217049.659128:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c695c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1868789713089792:12345-0@lo:400:kworker.0 Request processed in 30us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217049.659134:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1782217049.659146:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1782217049.659151:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c695880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1868789713090304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217049.659175:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c695880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1868789713090304:12345-0@lo:400:kworker.0 Request processed in 25us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217049.659181:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1782217049.659194:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1782217049.659202:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c696d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1868789713090432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217049.659210:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c694000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713090816:12345-0@lo:400:kworker.0 Request processed in 346us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217049.659219:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1782217049.659236:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1782217049.659243:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c696d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1868789713090432:12345-0@lo:400:kworker.0 Request processed in 41us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217049.659246:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1868789713090944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217049.659256:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00080000:1.0:1782217049.659278:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782217049.659285:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782217049.659288:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782217049.659308:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4379b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1868789713090048:0@lo:400:kworker.0 00000100:00100000:1.0:1782217049.659328:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1868789713090560:0@lo:400:kworker.0 00010000:00080000:1.0:1782217049.659340:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d410b2680 x1868789713090688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782217049.659350:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d410b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1868789713090688:0@lo:400:kworker.0 00010000:00080000:1.0:1782217049.659378:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7c692680 x1868789713090432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782217049.659387:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1868789713090432:0@lo:400:kworker.0 00000100:00100000:1.0:1782217049.659398:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4360f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713090944:0@lo:400:kworker.0 00000100:00100000:1.0:1782217049.659407:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4379b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1868789713089792:0@lo:400:kworker.0 00000100:00100000:1.0:1782217049.659416:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1868789713090304:0@lo:400:kworker.0 00000100:00100000:1.0:1782217049.659424:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4360ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713090816:0@lo:400:kworker.0 00000100:00100000:3.0:1782217049.659514:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1868789713090944:12345-0@lo:400:kworker.0 Request processed in 270us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217049.659521:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000004:00080000:0.0:1782217049.660926:0:10021:0:(osp_sync.c:1862:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 412644341285ns, next at 413644338413ns, rc = 0 00000100:00100000:3.0:1782217049.660953:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782217049.660971:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713091072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782217049.661022:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217049.661109:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d44400380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713091200:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782217049.661139:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217049.661872:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713091072 00000100:00100000:0.0:1782217049.661880:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713091072 00000100:00100000:0.0:1782217049.661927:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713091200 00000100:00100000:0.0:1782217049.661931:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713091200 00000100:00100000:0.0:1782217049.661946:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1782217049.661955:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1868789713091072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782217049.661983:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:0.0:1782217049.662030:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1868789713091072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (1008us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217049.662038:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1782217049.662054:0:10535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1782217049.662064:0:10535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d44403480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713091200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782217049.662075:0:10535:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:2.0:1782217049.662130:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713091072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782217049.664806:0:10535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d44403480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713091200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2734us (3657us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217049.664821:0:10535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1782217049.667968:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d44400380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713091200:0@lo:13:osp-pre-1-1.0 00000040:00080000:2.0:1782217050.106868:0:13796:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782217050.106882:0:13796:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782217050.106908:0:13796:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1782217050.106921:0:13796:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782217050.108277:0:13796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d44400380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13796:1868789713091328:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1782217050.108390:0:13796:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e52b6ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782217050.110682:0:13796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d44400380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13796:1868789713091328:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1782217050.115373:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217050.115576:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693108480 00000100:00100000:3.0:1782217050.115616:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693108480 00000100:00100000:3.0:1782217050.115684:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 186 00000100:00100000:3.0:1782217050.115694:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4360ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+64:12377:x1868789693108480:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1782217050.115726:0:6548:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1782217050.115842:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4360ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+64:12377:x1868789693108480:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 148us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217050.115850:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 186 00000100:00100000:2.0:1782217050.119938:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217050.120309:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693108608 00000100:00100000:3.0:1782217050.120318:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693108608 00000100:00100000:3.0:1782217050.120381:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 187 00000100:00100000:3.0:1782217050.120391:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d44400380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+64:12377:x1868789693108608:12345-192.168.203.30@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1782217050.120469:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5fa010 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.120485:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5fa010 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.120498:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5fa010 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.120546:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5fa017 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.120554:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5fa017 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.120560:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5fa017 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.120615:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa01e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.120624:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa01e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.120631:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa01e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217050.120684:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1782217050.120688:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782217050.120700:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa01e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.120710:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5fa010 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.120723:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5fa010 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.120730:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5fa010 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.121716:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362000 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217050.121723:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5fa010 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.121814:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5fa010 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.121834:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff952e7b201600) 00010000:00010000:3.0:1782217050.121837:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217050.121842:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5fa010 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.121848:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5fa010 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.121861:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5fa017 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.121867:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5fa017 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.121873:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5fa017 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.121879:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362a00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217050.121891:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5fa017 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.121899:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5fa017 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.121907:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff952e7c43ee00) 00010000:00010000:3.0:1782217050.121910:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217050.121913:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5fa017 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.121919:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5fa017 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.121935:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa01e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.121941:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa01e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.121946:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa01e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.121951:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362400 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217050.121954:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa01e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.121959:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa01e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.121967:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952d427f5700) 00010000:00010000:3.0:1782217050.121969:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217050.121979:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa01e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.121986:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa01e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217050.122077:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d44400380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+64:12377:x1868789693108608:12345-192.168.203.30@tcp:34:lhsmtool_posix.0 Request processed in 1684us (2143us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217050.122087:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 187 00000100:00100000:3.0:1782217050.125196:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217050.125272:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693108864 00000100:00100000:1.0:1782217050.125282:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693108864 00000100:00100000:1.0:1782217050.125345:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 188 00000100:00100000:1.0:1782217050.125355:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+64:12377:x1868789693108864:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782217050.125375:0:6548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217050.125395:0:6548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fa025 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be97363d expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.125502:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5fa02c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.125532:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5fa02c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.125543:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5fa02c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782217050.125556:0:6548:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1782217050.125678:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5fa02c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.125686:0:6548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5fa02c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.125692:0:6548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5fa02c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.125697:0:6548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43073000 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217050.125702:0:6548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5fa02c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.125708:0:6548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5fa02c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.125720:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952d427f5700) 00010000:00010000:1.0:1782217050.125724:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782217050.125728:0:6548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5fa02c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.125843:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5fa02c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.125889:0:6548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fa025 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97363d expref: 66 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.125905:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff952e7b201600) 00010000:00010000:1.0:1782217050.125907:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782217050.125911:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fa025 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97363d expref: 66 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.125920:0:6548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43073400, rc 0) 00000100:00100000:1.0:1782217050.126017:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+65:12377:x1868789693108864:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 663us (830us total) trans 4294967460 rc 301/301 00000100:00100000:1.0:1782217050.126026:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 188 00000100:00100000:1.0:1782217050.133389:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217050.133510:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693108992 00000100:00100000:3.0:1782217050.133520:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693108992 00000100:00100000:3.0:1782217050.133579:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 189 00000100:00100000:3.0:1782217050.133615:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4360f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+65:12377:x1868789693108992:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1782217050.133654:0:6519:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1782217050.133975:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4360f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+65:12377:x1868789693108992:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 360us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217050.133983:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 189 00000100:00100000:0.0:1782217050.137009:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217050.137205:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693109248 00000100:00100000:1.0:1782217050.137214:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693109248 00000100:00100000:1.0:1782217050.137272:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 190 00000100:00100000:1.0:1782217050.137282:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+65:12377:x1868789693109248:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782217050.137301:0:6548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217050.137305:0:6548:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1782217050.137332:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5f9fe6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97362f expref: 65 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.137350:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff952e6105c600) 00010000:00010000:1.0:1782217050.137355:0:6548:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782217050.137369:0:6548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fa03a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973644 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782217050.137765:0:6548:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:1.0:1782217050.137914:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5fa041 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.137927:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5fa041 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.137937:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5fa041 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.137988:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fa03a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973644 expref: 67 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.138004:0:6548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5fa041 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973644 expref: 66 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.138011:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff952e6105c100) 00010000:00010000:1.0:1782217050.138014:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782217050.138016:0:6548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43073000, rc 0) 00000100:00100000:1.0:1782217050.138071:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+66:12377:x1868789693109248:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 790us (1070us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1782217050.138079:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 190 00000100:00100000:0.0:1782217050.145464:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217050.146845:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693109504 00000100:00100000:1.0:1782217050.146857:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693109504 00000100:00100000:1.0:1782217050.146955:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 191 00000100:00100000:1.0:1782217050.146966:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+66:12377:x1868789693109504:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1782217050.147036:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782217050.147064:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5fa041 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973644 expref: 66 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.147096:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff952e6105c100) 00010000:00010000:1.0:1782217050.147108:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782217050.147128:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5fa04f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.147141:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5fa04f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.147149:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5fa04f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.147173:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa056 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xef791dd6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.147182:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa056 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xef791dd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.147189:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa056 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xef791dd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.148180:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5fa04f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.148191:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5fa04f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.148198:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5fa04f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.148204:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43073800 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217050.148221:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5fa04f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.148236:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5fa04f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.148248:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff952e6105c600) 00010000:00010000:1.0:1782217050.148251:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217050.148255:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5fa04f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.148261:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5fa04f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.148273:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa056 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xef791dd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.148278:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa056 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xef791dd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.148284:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa056 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xef791dd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.148289:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43072200 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217050.148292:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa056 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xef791dd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.148299:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa056 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xef791dd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.148306:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xef791dd6 (ffff952e6105cd00) 00010000:00010000:1.0:1782217050.148308:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217050.148311:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa056 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xef791dd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.148328:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa056 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xef791dd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217050.148423:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+65:12377:x1868789693109504:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 1457us (2966us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782217050.148432:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 191 00000100:00100000:1.0:1782217050.152685:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217050.152767:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693109632 00000100:00100000:2.0:1782217050.152778:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693109632 00000100:00100000:2.0:1782217050.152835:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 192 00000100:00100000:2.0:1782217050.152847:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+65:12377:x1868789693109632:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782217050.152866:0:6548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217050.152888:0:6548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5fa05d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be97364b expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.152926:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5fa064 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.152939:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5fa064 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.152952:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5fa064 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.153057:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5fa05d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97364b expref: 67 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.153073:0:6548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5fa064 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97364b expref: 66 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.153082:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff952d410a7b00) 00010000:00010000:2.0:1782217050.153085:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782217050.153088:0:6548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2d800, rc 0) 00000100:00100000:2.0:1782217050.153145:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+66:12377:x1868789693109632:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 301us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217050.153159:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 192 00000100:00100000:0.0:1782217050.164354:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217050.164816:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693109888 00000100:00100000:0.0:1782217050.164825:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693109888 00000100:00100000:0.0:1782217050.164882:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 193 00000100:00100000:0.0:1782217050.164893:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+66:12377:x1868789693109888:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1782217050.164975:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121dc00/0x92b8e04cbf5fa06b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.164992:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121dc00/0x92b8e04cbf5fa06b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.165013:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121dc00/0x92b8e04cbf5fa06b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782217050.165240:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:0.0:1782217050.165253:0:6519:0:(osp_sync.c:1862:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 413148669562ns, next at 414148666817ns, rc = 0 00000004:00010000:0.0:1782217050.165302:0:6519:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b09d3ec4 reply state 00000000a9cbd401 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121dc00/0x92b8e04cbf5fa06b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.165315:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121dc00/0x92b8e04cbf5fa06b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.165322:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff952d410a7b00) 00010000:00010000:0.0:1782217050.165325:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1782217050.165329:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782217050.165425:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+68:12377:x1868789693109888:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 534us (1081us total) trans 4294967462 rc 0/0 00000100:00100000:0.0:1782217050.165433:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 193 00000100:00100000:0.0:1782217050.168817:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782217050.168838:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d42612d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713091456:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782217050.168898:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217050.169083:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713091456 00000100:00100000:1.0:1782217050.169091:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713091456 00000100:00100000:1.0:1782217050.169142:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1782217050.169150:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713091456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782217050.169192:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1782217050.169247:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713091456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217050.169254:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1782217050.169394:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d42612d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713091456:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782217050.170751:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217050.170856:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693110016 00000100:00100000:2.0:1782217050.170864:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693110016 00000100:00100000:2.0:1782217050.170914:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 194 00000100:00100000:2.0:1782217050.170923:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+68:12377:x1868789693110016:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782217050.170942:0:6548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217050.170963:0:6548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5fa072 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973652 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.171016:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5fa072 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973652 expref: 69 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.171030:0:6548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5fa072 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973652 expref: 69 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.171048:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff952d410a7b00) 00010000:00010000:2.0:1782217050.171052:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782217050.171055:0:6548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2cc00, rc 0) 00000100:00100000:2.0:1782217050.171107:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+69:12377:x1868789693110016:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 185us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217050.171115:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 194 00000100:00100000:1.0:1782217050.175975:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217050.176051:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693110144 00000100:00100000:3.0:1782217050.176060:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693110144 00000100:00100000:3.0:1782217050.176135:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 58 00000100:00100000:3.0:1782217050.176147:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d410b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:24a87249-c61f-41a1-85ec-9a313129e739+6:2403:x1868789693110144:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1782217050.176367:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d410b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:24a87249-c61f-41a1-85ec-9a313129e739+7:2403:x1868789693110144:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 Request processed in 221us (399us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1782217050.176375:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 58 00000100:00080000:1.0:1782217050.177402:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782217050.182852:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217050.182935:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693110400 00000100:00100000:1.0:1782217050.182945:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693110400 00000100:00100000:1.0:1782217050.183001:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 49 00000100:00100000:1.0:1782217050.183011:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24a87249-c61f-41a1-85ec-9a313129e739+69:12377:x1868789693110400:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1782217050.183232:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24a87249-c61f-41a1-85ec-9a313129e739+70:12377:x1868789693110400:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 221us (387us total) trans 4294967463 rc 0/0 00000100:00100000:1.0:1782217050.183240:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 49 00000100:00100000:2.0:1782217050.186232:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217050.186313:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693110656 00000100:00100000:0.0:1782217050.186323:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693110656 00000100:00100000:0.0:1782217050.186384:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 195 00000100:00100000:0.0:1782217050.186393:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d44402300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+70:12377:x1868789693110656:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1782217050.186505:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d44402300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+70:12377:x1868789693110656:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 113us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217050.186528:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 195 00000100:00100000:2.0:1782217050.189317:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217050.189396:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693110784 00000100:00100000:1.0:1782217050.189416:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693110784 00000100:00100000:1.0:1782217050.189477:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 196 00000100:00100000:1.0:1782217050.189487:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d44401500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+70:12377:x1868789693110784:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782217050.189507:0:6548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217050.189527:0:6548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa079 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973659 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.189629:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5fa080 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.189643:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5fa080 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.189654:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5fa080 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782217050.189711:0:6548:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782217050.189729:0:6548:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5fa080 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.189764:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa079 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973659 expref: 72 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.189780:0:6548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5fa080 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973659 expref: 71 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.189789:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff952d410a7b00) 00010000:00010000:1.0:1782217050.189791:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1782217050.189794:0:6548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43073800, rc 0) 00000100:00100000:1.0:1782217050.189842:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d44401500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+71:12377:x1868789693110784:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 357us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217050.189858:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 196 00000100:00100000:2.0:1782217050.192986:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217050.193249:0:10025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693110912 00000100:00100000:3.0:1782217050.193259:0:10025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693110912 00000100:00100000:3.0:1782217050.193317:0:10025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 59 00000100:00100000:3.0:1782217050.193341:0:10025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d44403b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:24a87249-c61f-41a1-85ec-9a313129e739+7:2402:x1868789693110912:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782217050.193362:0:10025:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217050.193380:0:10025:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d7576ff/0x92b8e04cbf5fa087 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973660 expref: -99 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782217050.193404:0:10025:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a3a795a, blocks: 0x0 00010000:00010000:3.0:1782217050.193424:0:10025:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=413s v=(0 0) 00010000:00010000:3.0:1782217050.193428:0:10025:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217050.193437:0:10025:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d7576ff/0x92b8e04cbf5fa087 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973660 expref: 8 pid: 10025 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.193455:0:10025:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d7576ff/0x92b8e04cbf5fa087 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973660 expref: 8 pid: 10025 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.193468:0:10025:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b362000, rc 0) 00000100:00100000:3.0:1782217050.193526:0:10025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d44403b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:24a87249-c61f-41a1-85ec-9a313129e739+8:2402:x1868789693110912:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 187us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217050.193533:0:10025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 59 00000100:00100000:2.0:1782217050.196692:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217050.196860:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693111168 00000100:00100000:0.0:1782217050.196870:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693111168 00000100:00100000:0.0:1782217050.196927:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 197 00000100:00100000:0.0:1782217050.196936:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d44403800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+71:12377:x1868789693111168:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1782217050.197033:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d44403800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+71:12377:x1868789693111168:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 97us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217050.197041:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 197 00000100:00100000:1.0:1782217050.200297:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217050.200395:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693111296 00000100:00100000:2.0:1782217050.200404:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693111296 00000100:00100000:2.0:1782217050.200494:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 60 00000100:00100000:2.0:1782217050.200503:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d410b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:24a87249-c61f-41a1-85ec-9a313129e739+8:12377:x1868789693111296:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782217050.200520:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217050.200541:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f84b776/0x92b8e04cbf5fa08e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973667 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.200568:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d7576ff/0x92b8e04cbf5fa087 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973660 expref: 9 pid: 10025 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.200577:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782217050.200618:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782217050.200625:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f84b776/0x92b8e04cbf5fa08e lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973667 expref: 9 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.200670:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008d7576ff/0x92b8e04cbf5fa087 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973660 expref: 9 pid: 10025 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.200683:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008d7576ff/0x92b8e04cbf5fa087 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973660 expref: 9 pid: 10025 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217050.200696:0:8434:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4330d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8434:1868789713091584:192.168.203.30@tcp:104: 00000100:00100000:2.0:1782217050.200794:0:8434:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e52b6eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1782217050.204009:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217050.204340:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693111424 00000100:00100000:3.0:1782217050.204351:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693111424 00010000:00010000:3.0:1782217050.204391:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008d7576ff/0x92b8e04cbf5fa087 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973660 expref: 10 pid: 10025 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217050.204432:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 87 00000100:00100000:3.0:1782217050.204442:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24a87249-c61f-41a1-85ec-9a313129e739+10:2403:x1868789693111424:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782217050.204475:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217050.204497:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008d7576ff/0x92b8e04cbf5fa087 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973660 expref: 10 pid: 10025 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.204512:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008d7576ff/0x92b8e04cbf5fa087 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973660 expref: 10 pid: 10025 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.204537:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217050.204542:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217050.204552:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006f84b776/0x92b8e04cbf5fa08e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973667 expref: 10 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.204562:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f84b776/0x92b8e04cbf5fa08e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973667 expref: 10 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.204937:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006f84b776/0x92b8e04cbf5fa08e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973667 expref: 10 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217050.204962:0:6506:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43e90a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6506:1868789713091712:192.168.203.30@tcp:105: 00000100:00100000:2.0:1782217050.205045:0:6506:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d437216c0 going to sleep for 11 seconds 00010000:00010000:0.0:1782217050.206305:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d7576ff/0x92b8e04cbf5fa087 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973660 expref: 10 pid: 10025 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217050.206324:0:8434:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4330d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8434:1868789713091584:192.168.203.30@tcp:104: 00010000:00010000:0.0:1782217050.206354:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006f84b776/0x92b8e04cbf5fa08e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973667 expref: 9 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.206368:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2d000, rc 0) 00000100:00100000:0.0:1782217050.206453:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d410b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:24a87249-c61f-41a1-85ec-9a313129e739+9:12377:x1868789693111296:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 5951us (6165us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217050.206462:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 60 00000100:00100000:3.0:1782217050.211890:0:6506:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43e90a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6506:1868789713091712:192.168.203.30@tcp:105: 00010000:00010000:3.0:1782217050.211917:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217050.212134:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217050.212256:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24a87249-c61f-41a1-85ec-9a313129e739+8:2403:x1868789693111424:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 7814us (8254us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217050.212269:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 87 00000100:00100000:3.0:1782217050.213315:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693111552 00000100:00100000:3.0:1782217050.213328:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693111552 00002000:00100000:3.0:1782217050.213377:0:8438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff952d42612d80 x1868789693111552/t0(0) o4->24a87249-c61f-41a1-85ec-9a313129e739@192.168.203.30@tcp:301/0 lens 504/0 e 0 to 0 dl 1782217061 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782217050.213388:0:8438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff952d42612d80 with x1868789693111552 ext(0->8) 00002000:00010000:3.0:1782217050.213393:0:8438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff952d42612d80 00000100:00100000:3.0:1782217050.213429:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 4 00000100:00100000:3.0:1782217050.213437:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42612d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:24a87249-c61f-41a1-85ec-9a313129e739+8:2403:x1868789693111552:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1782217050.222712:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42612d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:24a87249-c61f-41a1-85ec-9a313129e739+10:2403:x1868789693111552:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 Request processed in 9264us (10567us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1782217050.222728:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 4 00002000:00100000:2.0:1782217050.222741:0:8438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff952d42612d80 x1868789693111552/t4294967315(0) o4->24a87249-c61f-41a1-85ec-9a313129e739@192.168.203.30@tcp:301/0 lens 504/448 e 0 to 0 dl 1782217061 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782217050.222750:0:8438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff952d42612d80 with x1868789693111552 ext(0->8) 00002000:00010000:2.0:1782217050.222757:0:8438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff952d42612d80 00000100:00100000:1.0:1782217050.226502:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217050.226576:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693111680 00000100:00100000:2.0:1782217050.226604:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693111680 00000100:00100000:2.0:1782217050.226675:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 198 00000100:00100000:2.0:1782217050.226686:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4368ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+71:12377:x1868789693111680:12345-192.168.203.30@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1782217050.232859:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967463 is committed 00000004:00080000:0.0:1782217050.232877:0:6498:0:(osp_sync.c:1827:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000004:00080000:0.0:1782217050.232893:0:6498:0:(osp_sync.c:1827:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:0.0:1782217050.232936:0:6498:0:(osp_sync.c:1827:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1782217050.232945:0:6498:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff952d437876c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1782217050.232958:0:6498:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff952e7c650000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff952d43787e40 00000020:00080000:0.0:1782217050.232961:0:6498:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff952e7c650c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff952d43762c00 00000020:00080000:0.0:1782217050.233001:0:6551:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1782217050.233059:0:6551:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1782217050.233187:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4368ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+25:12377:x1868789693111680:12345-192.168.203.30@tcp:44:lhsmtool_posix.0 Request processed in 6498us (6685us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217050.233197:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 198 00010000:00010000:1.0:1782217050.235308:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9db6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.235325:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9db6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.235333:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9db6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.235339:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43073a00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217050.235343:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9db6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.235351:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9db6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.235368:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff952e6105c200) 00010000:00010000:1.0:1782217050.235371:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217050.235376:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9db6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.235382:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073a00/0x92b8e04cbf5f9db6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.235404:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5f9dbd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.235409:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5f9dbd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.235431:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5f9dbd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.235436:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43073e00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217050.235438:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5f9dbd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.235444:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5f9dbd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.235452:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff952e6105c600) 00010000:00010000:1.0:1782217050.235454:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217050.235456:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5f9dbd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.235461:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5f9dbd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.235475:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9dfc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.235481:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9dfc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.235485:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9dfc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.235490:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2d400 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217050.235492:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9dfc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.235507:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9dfc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.235515:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff952d410a7700) 00010000:00010000:1.0:1782217050.235518:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217050.235521:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9dfc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.235527:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5f9dfc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.235546:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d800/0x92b8e04cbf5f9eff lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.235552:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d800/0x92b8e04cbf5f9eff lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.235557:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d800/0x92b8e04cbf5f9eff lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.235562:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121d800 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217050.235565:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d800/0x92b8e04cbf5f9eff lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.235570:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d800/0x92b8e04cbf5f9eff lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.235578:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952d427f5700) 00010000:00010000:1.0:1782217050.235615:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217050.235618:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d800/0x92b8e04cbf5f9eff lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.235634:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d800/0x92b8e04cbf5f9eff lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.235647:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d000/0x92b8e04cbf5f9f22 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.235653:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d000/0x92b8e04cbf5f9f22 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.235670:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d000/0x92b8e04cbf5f9f22 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.235676:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121d000 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217050.235679:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d000/0x92b8e04cbf5f9f22 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.235684:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d000/0x92b8e04cbf5f9f22 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.235693:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952d427f5700) 00010000:00010000:1.0:1782217050.235695:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217050.235697:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d000/0x92b8e04cbf5f9f22 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.235703:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d000/0x92b8e04cbf5f9f22 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.235712:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9f68 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.235717:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9f68 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.235728:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9f68 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.235733:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2c400 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217050.235736:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9f68 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.235808:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9f68 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.235818:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952d427f5700) 00010000:00010000:1.0:1782217050.235820:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217050.235823:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9f68 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.235829:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5f9f68 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.235842:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121dc00/0x92b8e04cbf5fa06b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.235848:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121dc00/0x92b8e04cbf5fa06b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.235853:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121dc00/0x92b8e04cbf5fa06b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.235858:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121dc00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217050.235860:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121dc00/0x92b8e04cbf5fa06b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.235877:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121dc00/0x92b8e04cbf5fa06b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.235886:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff952d410a7b00) 00010000:00010000:1.0:1782217050.235888:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782217050.235891:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121dc00/0x92b8e04cbf5fa06b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.235896:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121dc00/0x92b8e04cbf5fa06b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217050.236005:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782217050.236022:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4379b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713091840:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782217050.236085:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217050.236141:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713091840 00000100:00100000:1.0:1782217050.236147:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713091840 00000100:00100000:1.0:1782217050.236355:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1782217050.236365:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4379b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1868789713091840:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782217050.236391:0:8432:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:1.0:1782217050.236419:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a3a7957, atime: 0x6a3a7957, ctime: 0x6a3a7957, blocks: 0x8 00010000:00010000:1.0:1782217050.236427:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca9ba059/0x92b8e04cbf5fa095 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.236441:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=413s v=(0 0) 00010000:00010000:1.0:1782217050.236445:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217050.236451:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca9ba059/0x92b8e04cbf5fa095 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.236477:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca9ba059/0x92b8e04cbf5fa095 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.236486:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca9ba059/0x92b8e04cbf5fa095 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.236494:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca9ba059/0x92b8e04cbf5fa095 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.236511:0:8432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782217050.236678:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4379b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3647:x1868789713091840:12345-0@lo:6:osp-syn-1-0.0 Request processed in 313us (591us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1782217050.236686:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1782217050.238109:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782217050.238123:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713091968:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1782217050.238169:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217050.238676:0:10025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713091968 00000100:00100000:0.0:1782217050.238683:0:10025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713091968 00000100:00100000:0.0:1782217050.238744:0:10025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1782217050.238754:0:10025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713091968:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1782217050.238864:0:10025:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1782217050.238868:0:10025:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1782217050 00002000:00010000:0.0:1782217050.238870:0:10025:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1782217050.238872:0:10025:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1782217050 -> 1782217050 00002000:00010000:0.0:1782217050.238874:0:10025:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1782217050.238919:0:10025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3650:x1868789713091968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 165us (749us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1782217050.238927:0:10025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000004:00080000:0.0:1782217050.238969:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff952d43e90a80/2, rc 0, transno 4294967316 00000100:00100000:0.0:1782217050.238975:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713091968:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1782217050.239101:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217050.239120:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693111808 00000100:00100000:0.0:1782217050.239123:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693111808 00000100:00100000:0.0:1782217050.239143:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 63 00000100:00100000:0.0:1782217050.239148:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4330d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:24a87249-c61f-41a1-85ec-9a313129e739+10:2405:x1868789693111808:12345-192.168.203.30@tcp:16:lhsmtool_posix.0 00000004:00080000:0.0:1782217050.240885:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff952d4379b100/2, rc 0, transno 4294967308 00000100:00100000:0.0:1782217050.240897:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4379b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713091840:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782217050.240919:0:10337:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782217050.240926:0:10337:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca9ba059/0x92b8e04cbf5fa095 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.240937:0:10337:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43073000 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:0.0:1782217050.240941:0:10337:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca9ba059/0x92b8e04cbf5fa095 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.240951:0:10337:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca9ba059/0x92b8e04cbf5fa095 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.240968:0:10337:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca9ba059/0x92b8e04cbf5fa095 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.240974:0:10337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca9ba059/0x92b8e04cbf5fa095 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.240994:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217050.240995:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217050.240997:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1782217050.243474:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:1.0:1782217050.243491:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:3.0:1782217050.243668:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4330d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:24a87249-c61f-41a1-85ec-9a313129e739+7:2405:x1868789693111808:12345-192.168.203.30@tcp:16:lhsmtool_posix.0 Request processed in 4504us (4554us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217050.243680:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 63 00000100:00100000:0.0:1782217050.250309:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217050.250345:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693112064 00000100:00100000:0.0:1782217050.250354:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693112064 00000100:00100000:0.0:1782217050.250406:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 199 00000100:00100000:0.0:1782217050.250415:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+19:12377:x1868789693112064:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1782217050.250478:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217050.250505:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5fa080 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973659 expref: 19 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.250525:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff952d410a7b00) 00010000:00010000:0.0:1782217050.250529:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782217050.250562:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c400/0x92b8e04cbf5fa09c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.250579:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c400/0x92b8e04cbf5fa09c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.250765:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c400/0x92b8e04cbf5fa09c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782217050.250884:0:6519:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a7e07679 reply state 000000009f1c13ce transno 4294967464 ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c400/0x92b8e04cbf5fa09c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.250897:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c400/0x92b8e04cbf5fa09c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.250903:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff952d410a7b00) 00010000:00010000:0.0:1782217050.250905:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782217050.250907:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782217050.251006:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+20:12377:x1868789693112064:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 590us (706us total) trans 4294967464 rc 0/0 00000100:00100000:0.0:1782217050.251015:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 199 00000100:00100000:0.0:1782217050.253321:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217050.253355:0:10025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693112192 00000100:00100000:0.0:1782217050.253363:0:10025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693112192 00000100:00100000:0.0:1782217050.253425:0:10025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 64 00000100:00100000:0.0:1782217050.253434:0:10025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:24a87249-c61f-41a1-85ec-9a313129e739+7:2403:x1868789693112192:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1782217050.253605:0:10025:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1782217050.253609:0:10025:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1782217050 -> 1782217049 00002000:00010000:0.0:1782217050.253611:0:10025:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1782217047 00002000:00010000:0.0:1782217050.253613:0:10025:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1782217050 -> 1782217049 00002000:00010000:0.0:1782217050.253615:0:10025:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1782217050.253672:0:10025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:24a87249-c61f-41a1-85ec-9a313129e739+8:2403:x1868789693112192:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 Request processed in 239us (358us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1782217050.253679:0:10025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 64 00000100:00100000:3.0:1782217050.263682:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217050.263718:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693112448 00000100:00100000:3.0:1782217050.263727:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693112448 00000100:00100000:3.0:1782217050.263781:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 200 00000100:00100000:3.0:1782217050.263791:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+20:12377:x1868789693112448:12345-192.168.203.30@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1782217050.263853:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa0a3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.263868:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5fa064 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97364b expref: 20 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.263877:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa0a3 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.263905:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5fa064 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97364b expref: 20 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.263918:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5fa064 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97364b expref: 20 pid: 6548 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217050.263931:0:6520:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43e91880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1868789713092096:192.168.203.30@tcp:104: 00000100:00100000:3.0:1782217050.264014:0:6520:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e44f51b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782217050.270318:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217050.272713:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693112576 00000100:00100000:2.0:1782217050.272727:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693112576 00010000:00010000:2.0:1782217050.272779:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5fa064 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97364b expref: 21 pid: 6548 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217050.272827:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 88 00000100:00100000:2.0:1782217050.272837:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e6f92cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24a87249-c61f-41a1-85ec-9a313129e739+21:2403:x1868789693112576:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782217050.272861:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217050.272868:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5fa064 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97364b expref: 21 pid: 6548 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.272882:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5fa064 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97364b expref: 21 pid: 6548 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.272904:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff952d410a7b00) 00010000:00010000:2.0:1782217050.272910:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa0a3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.272920:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa0a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.272927:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa0a3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.272945:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217050.273006:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e6f92cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24a87249-c61f-41a1-85ec-9a313129e739+21:2403:x1868789693112576:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 170us (2697us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217050.273014:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 88 00010000:00010000:1.0:1782217050.275921:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5fa064 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97364b expref: 20 pid: 6548 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217050.275941:0:6520:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43e91880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1868789713092096:192.168.203.30@tcp:104: 00010000:00010000:1.0:1782217050.275963:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa0a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.279301:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa0a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.279315:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa0a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.279356:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa0a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.279364:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa0a3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.279371:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa0a3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.279377:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362400 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782217050.279382:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa0a3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.279402:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa0a3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.279419:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff952d410a7b00) 00010000:00010000:0.0:1782217050.279423:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1782217050.279427:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa0a3 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.279433:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa0a3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217050.279523:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+19:12377:x1868789693112448:12345-192.168.203.30@tcp:55:lhsmtool_posix.0 Request processed in 15728us (15844us total) trans 0 rc -22/-22 00000100:00100000:0.0:1782217050.279533:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 200 00000100:00100000:2.0:1782217050.286124:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217050.286236:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693112704 00000100:00100000:3.0:1782217050.286246:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693112704 00000100:00100000:3.0:1782217050.286301:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 65 00000100:00100000:3.0:1782217050.286312:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:24a87249-c61f-41a1-85ec-9a313129e739+8:2402:x1868789693112704:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1782217050.286352:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009662639c/0x92b8e04cbf5fa0aa lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.286371:0:14273:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006f84b776/0x92b8e04cbf5fa08e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973667 expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.286379:0:14273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217050.286383:0:14273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782217050.286387:0:14273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009662639c/0x92b8e04cbf5fa0aa lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.286418:0:14273:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006f84b776/0x92b8e04cbf5fa08e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973667 expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.286430:0:14273:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006f84b776/0x92b8e04cbf5fa08e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973667 expref: 8 pid: 8434 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217050.286443:0:14273:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43e90380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14273:1868789713092224:192.168.203.30@tcp:104: 00000100:00100000:3.0:1782217050.286523:0:14273:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e44f51b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782217050.291579:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217050.291756:0:14273:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43e90380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14273:1868789713092224:192.168.203.30@tcp:104: 00010000:00010000:0.0:1782217050.291784:0:14273:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009662639c/0x92b8e04cbf5fa0aa lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217050.291973:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693112832 00000100:00100000:1.0:1782217050.291980:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693112832 00010000:00010000:1.0:1782217050.292020:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006f84b776/0x92b8e04cbf5fa08e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973667 expref: 9 pid: 8434 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217050.292082:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 89 00000100:00100000:1.0:1782217050.292092:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24a87249-c61f-41a1-85ec-9a313129e739+9:2403:x1868789693112832:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782217050.292108:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782217050.292129:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006f84b776/0x92b8e04cbf5fa08e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973667 expref: 9 pid: 8434 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.292142:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006f84b776/0x92b8e04cbf5fa08e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973667 expref: 9 pid: 8434 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.292165:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f84b776/0x92b8e04cbf5fa08e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973667 expref: 9 pid: 8434 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.292180:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782217050.292184:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782217050.292189:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009662639c/0x92b8e04cbf5fa0aa lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.292200:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009662639c/0x92b8e04cbf5fa0aa lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.292237:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782217050.292288:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24a87249-c61f-41a1-85ec-9a313129e739+8:2403:x1868789693112832:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 196us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217050.292295:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 89 00010000:00010000:1.0:1782217050.292420:0:14273:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009662639c/0x92b8e04cbf5fa0aa lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.292430:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009662639c/0x92b8e04cbf5fa0aa lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.292449:0:14273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009662639c/0x92b8e04cbf5fa0aa lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.292458:0:14273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009662639c/0x92b8e04cbf5fa0aa lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.292466:0:14273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009662639c/0x92b8e04cbf5fa0aa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.292474:0:14273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362e00 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:1.0:1782217050.292479:0:14273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009662639c/0x92b8e04cbf5fa0aa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.292489:0:14273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009662639c/0x92b8e04cbf5fa0aa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.292502:0:14273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009662639c/0x92b8e04cbf5fa0aa lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.292510:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009662639c/0x92b8e04cbf5fa0aa lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217050.292578:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:24a87249-c61f-41a1-85ec-9a313129e739+7:2402:x1868789693112704:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 Request processed in 6267us (6463us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217050.292613:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 65 00000100:00100000:3.0:1782217050.295558:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217050.295714:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693113088 00000100:00100000:0.0:1782217050.295724:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693113088 00000100:00100000:0.0:1782217050.295795:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 201 00000100:00100000:0.0:1782217050.295805:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+19:12377:x1868789693113088:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1782217050.295883:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121dc00/0x92b8e04cbf5fa0b1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.295902:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f9ef8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735f0 expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.295924:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121dc00/0x92b8e04cbf5fa0b1 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.295957:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f9ef8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735f0 expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.295970:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f9ef8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735f0 expref: 19 pid: 6518 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217050.295985:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43605880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1868789713092352:192.168.203.30@tcp:104: 00000100:00100000:0.0:1782217050.296065:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d426cc6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782217050.298416:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43605880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1868789713092352:192.168.203.30@tcp:104: 00010000:00010000:0.0:1782217050.298443:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121dc00/0x92b8e04cbf5fa0b1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217050.308119:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217050.308898:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693113216 00000100:00100000:2.0:1782217050.308909:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693113216 00010000:00010000:2.0:1782217050.308949:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f9ef8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735f0 expref: 20 pid: 6518 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217050.308984:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 90 00000100:00100000:2.0:1782217050.308993:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24a87249-c61f-41a1-85ec-9a313129e739+20:2402:x1868789693113216:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782217050.309017:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217050.309025:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f9ef8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735f0 expref: 20 pid: 6518 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.309038:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f9ef8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735f0 expref: 20 pid: 6518 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.309058:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5f9ef8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9735f0 expref: 20 pid: 6518 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.309072:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952d427f5700) 00010000:00010000:2.0:1782217050.309076:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121dc00/0x92b8e04cbf5fa0b1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.309085:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121dc00/0x92b8e04cbf5fa0b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.309091:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121dc00/0x92b8e04cbf5fa0b1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.309124:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217050.309184:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24a87249-c61f-41a1-85ec-9a313129e739+19:2402:x1868789693113216:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 178us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217050.309192:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 90 00010000:00010000:1.0:1782217050.309845:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121dc00/0x92b8e04cbf5fa0b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.309854:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121dc00/0x92b8e04cbf5fa0b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.310018:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5fa0b8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.310031:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5fa072 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973652 expref: 19 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.310039:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5fa0b8 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.310070:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5fa072 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973652 expref: 19 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.310082:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5fa072 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973652 expref: 19 pid: 6548 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217050.310095:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43799880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1868789713092480:192.168.203.30@tcp:104: 00000100:00100000:1.0:1782217050.310171:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d437870c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782217050.314403:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217050.314467:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43799880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1868789713092480:192.168.203.30@tcp:104: 00010000:00010000:3.0:1782217050.314495:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5fa0b8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217050.316989:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693113344 00000100:00100000:0.0:1782217050.317003:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693113344 00010000:00010000:0.0:1782217050.317048:0:8449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5fa072 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973652 expref: 20 pid: 6548 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217050.317085:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 91 00000100:00100000:0.0:1782217050.317095:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:24a87249-c61f-41a1-85ec-9a313129e739+20:2402:x1868789693113344:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782217050.317110:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217050.317115:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5fa072 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973652 expref: 20 pid: 6548 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.317141:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5fa072 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973652 expref: 20 pid: 6548 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.317171:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5fa072 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973652 expref: 20 pid: 6548 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.317186:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff952d410a7b00) 00010000:00010000:0.0:1782217050.317191:0:8449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5fa0b8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.317199:0:8449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5fa0b8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.317206:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5fa0b8 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.317231:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217050.317284:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:24a87249-c61f-41a1-85ec-9a313129e739+19:2402:x1868789693113344:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 190us (2889us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217050.317291:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 91 00010000:00010000:0.0:1782217050.317318:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5fa0b8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.317325:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5fa0b8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782217050.317427:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:0.0:1782217050.317537:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000001:00080000:0.0:1782217050.317573:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:0.0:1782217050.317869:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43605880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6519:1868789713092608:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1782217050.317921:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217050.317951:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d426cce40 going to sleep for 11 seconds 00000100:00100000:0.0:1782217050.317970:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713092608 00000100:00100000:0.0:1782217050.317974:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713092608 00000100:00100000:0.0:1782217050.318005:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1782217050.318010:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43605180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6519:x1868789713092608:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1782217050.318074:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43605180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6519:x1868789713092608:12345-0@lo:1000:mdt00_001.0 Request processed in 63us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217050.318080:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1782217050.318115:0:6519:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:0.0:1782217050.318120:0:6519:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff952d43e90a80, transno 4294967316 00000100:00100000:0.0:1782217050.318129:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43605880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6519:1868789713092608:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1782217050.318224:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00000100:00100000:0.0:1782217050.318258:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43605880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6519:1868789713092736:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1782217050.318285:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217050.318300:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d426cc180 going to sleep for 11 seconds 00000100:00100000:0.0:1782217050.318314:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713092736 00000100:00100000:0.0:1782217050.318317:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713092736 00000100:00100000:0.0:1782217050.318338:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1782217050.318343:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6519:x1868789713092736:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1782217050.318421:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6519:x1868789713092736:12345-0@lo:1000:mdt00_001.0 Request processed in 77us (134us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1782217050.318427:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1782217050.318453:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43605880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6519:1868789713092736:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1782217050.318476:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5fa0b8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.318490:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5fa0b8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.318497:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5fa0b8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.318503:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43073600 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782217050.318507:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5fa0b8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.318514:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5fa0b8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.318525:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff952d410a7b00) 00010000:00010000:0.0:1782217050.318528:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782217050.318532:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5fa0b8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.318538:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5fa0b8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.318558:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5f9fed lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.318564:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5f9fed lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.318570:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5f9fed lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.318575:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2ca00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782217050.318602:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5f9fed lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.318609:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5f9fed lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.318618:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952d427f5700) 00010000:00010000:0.0:1782217050.318621:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782217050.318624:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5f9fed lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.318629:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5f9fed lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.318667:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d000/0x92b8e04cbf5fa0bf lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.318680:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5fa009 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973636 expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.318689:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d000/0x92b8e04cbf5fa0bf lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.318713:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5fa009 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973636 expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.318725:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5fa009 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973636 expref: 22 pid: 6518 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217050.318736:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43fef800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1868789713092864:192.168.203.30@tcp:104: 00000100:00100000:0.0:1782217050.318777:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e583f16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782217050.324471:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217050.325426:0:13731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693113472 00000100:00100000:2.0:1782217050.325435:0:13731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693113472 00010000:00010000:2.0:1782217050.325471:0:13731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5fa009 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973636 expref: 23 pid: 6518 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217050.325518:0:13731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 92 00000100:00100000:2.0:1782217050.325527:0:13731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:24a87249-c61f-41a1-85ec-9a313129e739+23:2402:x1868789693113472:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782217050.325541:0:13731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217050.325548:0:13731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5fa009 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973636 expref: 23 pid: 6518 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.325560:0:13731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5fa009 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973636 expref: 23 pid: 6518 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.325595:0:13731:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952d427f5700) 00010000:00010000:2.0:1782217050.325601:0:13731:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d000/0x92b8e04cbf5fa0bf lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.325610:0:13731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d000/0x92b8e04cbf5fa0bf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.325618:0:13731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d000/0x92b8e04cbf5fa0bf lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.325634:0:13731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217050.325695:0:13731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:24a87249-c61f-41a1-85ec-9a313129e739+23:2402:x1868789693113472:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 168us (1232us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217050.325703:0:13731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 92 00010000:00010000:0.0:1782217050.326134:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5fa009 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973636 expref: 22 pid: 6518 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217050.326149:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43fef800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1868789713092864:192.168.203.30@tcp:104: 00010000:00010000:0.0:1782217050.326178:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d000/0x92b8e04cbf5fa0bf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.326188:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d000/0x92b8e04cbf5fa0bf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.326193:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d000/0x92b8e04cbf5fa0bf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.326206:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d000/0x92b8e04cbf5fa0bf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.326211:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d000/0x92b8e04cbf5fa0bf lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.326218:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d000/0x92b8e04cbf5fa0bf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.326223:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121d000 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782217050.326228:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d000/0x92b8e04cbf5fa0bf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.326234:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d000/0x92b8e04cbf5fa0bf lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.326244:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952d427f5700) 00010000:00010000:0.0:1782217050.326247:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217050.326259:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d000/0x92b8e04cbf5fa0bf lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.326266:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d000/0x92b8e04cbf5fa0bf lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.326277:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121dc00/0x92b8e04cbf5fa0b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.326284:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121dc00/0x92b8e04cbf5fa0b1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.326289:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121dc00/0x92b8e04cbf5fa0b1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.326294:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121dc00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782217050.326297:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121dc00/0x92b8e04cbf5fa0b1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.326302:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121dc00/0x92b8e04cbf5fa0b1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.326310:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952d427f5700) 00010000:00010000:0.0:1782217050.326312:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782217050.326314:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121dc00/0x92b8e04cbf5fa0b1 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.326320:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121dc00/0x92b8e04cbf5fa0b1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217050.326474:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+21:12377:x1868789693113088:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 30669us (30922us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1782217050.326483:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 201 00000020:00080000:0.0:1782217050.326494:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1782217050.326838:0:13796:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782217050.326844:0:13796:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782217050.327291:0:13796:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1782217050.327299:0:13796:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782217050.337023:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217050.337077:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693113728 00000100:00100000:1.0:1782217050.337093:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693113728 00000100:00100000:1.0:1782217050.337152:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 50 00000100:00100000:1.0:1782217050.337162:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e50124050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24a87249-c61f-41a1-85ec-9a313129e739+21:12377:x1868789693113728:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1782217050.337632:0:6522:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1782217050.337678:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967470 00010000:00010000:1.0:1782217050.337711:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5fa0c6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.337743:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5fa0c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.337755:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5fa0c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.337764:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5fa0c6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.337771:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5fa0c6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.337777:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5fa0c6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.337796:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782217050.337885:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e50124050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24a87249-c61f-41a1-85ec-9a313129e739+23:12377:x1868789693113728:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 724us (869us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1782217050.337893:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 50 00000020:00080000:1.0:1782217050.337899:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1782217050.337948:0:10336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782217050.337954:0:10336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5fa0c6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.337972:0:10336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43073e00 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:1.0:1782217050.337976:0:10336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5fa0c6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.337984:0:10336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5fa0c6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.337998:0:10336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff952d410a7b00) 00010000:00010000:1.0:1782217050.338002:0:10336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782217050.338007:0:10336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5fa0c6 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.338014:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5fa0c6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.338025:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217050.338027:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217050.338029:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782217050.381291:0:14708:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782217050.381300:0:14708:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782217050.381325:0:14708:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1782217050.381332:0:14708:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1782217050.484112:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217050.484282:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693113984 00000100:00100000:3.0:1782217050.484293:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693113984 00000100:00100000:3.0:1782217050.484353:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 202 00000100:00100000:3.0:1782217050.484362:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+23:12387:x1868789693113984:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1782217050.484386:0:6548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217050.484405:0:6548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5fa0cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be97366e expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.484503:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5fa0d4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.484517:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5fa0d4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.484530:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5fa0d4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217050.484541:0:6548:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1782217050.484673:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5fa0cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97366e expref: 26 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.484692:0:6548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5fa0d4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97366e expref: 25 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.484710:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff952e6105c600) 00010000:00010000:3.0:1782217050.484714:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1782217050.484717:0:6548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b363a00, rc 0) 00000100:00100000:3.0:1782217050.484770:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+25:12387:x1868789693113984:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 408us (665us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1782217050.484777:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 202 00000100:00100000:0.0:1782217050.488102:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217050.489675:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693114112 00000100:00100000:3.0:1782217050.489688:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693114112 00000100:00100000:3.0:1782217050.489754:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 203 00000100:00100000:3.0:1782217050.489765:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+25:12387:x1868789693114112:12345-192.168.203.30@tcp:34:lfs.0 00010000:00010000:3.0:1782217050.489841:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5fa0e2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.489858:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5fa0e2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.489870:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5fa0e2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.489885:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5fa0e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.489891:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5fa0e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.489898:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5fa0e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.490013:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa0f0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.490021:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa0f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.490029:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa0f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782217050.490073:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa0f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.490086:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5fa0e2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.490101:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5fa0e2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.490109:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5fa0e2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.490115:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b363c00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217050.490119:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5fa0e2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.490128:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5fa0e2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.490139:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff952e6105c600) 00010000:00010000:3.0:1782217050.490142:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217050.490146:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5fa0e2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.490159:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5fa0e2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.490173:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5fa0e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.490179:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5fa0e9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.490186:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5fa0e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.490192:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362c00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217050.490195:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5fa0e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.490202:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5fa0e9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.490210:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff952e46d74200) 00010000:00010000:3.0:1782217050.490213:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217050.490217:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5fa0e9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.490223:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5fa0e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.490238:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa0f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.490244:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa0f0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.490256:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa0f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.490261:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362e00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217050.490265:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa0f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.490271:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa0f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.490279:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952e46d74100) 00010000:00010000:3.0:1782217050.490281:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217050.490283:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa0f0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.490289:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa0f0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217050.490370:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+25:12387:x1868789693114112:12345-192.168.203.30@tcp:34:lfs.0 Request processed in 606us (2281us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217050.490379:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 203 00000100:00100000:2.0:1782217050.547022:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217050.547148:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693114368 00000100:00100000:3.0:1782217050.547158:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693114368 00000100:00100000:3.0:1782217050.549914:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 204 00000100:00100000:3.0:1782217050.549938:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+25:12390:x1868789693114368:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1782217050.549960:0:6548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217050.549980:0:6548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa0f7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973675 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.550066:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa0fe lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.550079:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa0fe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.550091:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa0fe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.550104:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5fa105 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.550112:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5fa105 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.550119:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5fa105 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.550222:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5fa10c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.550231:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5fa10c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.550239:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5fa10c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217050.550249:0:6548:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1782217050.550324:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa0fe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.550332:0:6548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa0fe lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.550346:0:6548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa0fe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.550353:0:6548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362e00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217050.550358:0:6548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa0fe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.550366:0:6548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa0fe lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.550379:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff952e6105c600) 00010000:00010000:3.0:1782217050.550382:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217050.550387:0:6548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa0fe lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.550394:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa0fe lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.550408:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5fa105 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.550415:0:6548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5fa105 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.550422:0:6548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5fa105 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.550428:0:6548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362c00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217050.550432:0:6548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5fa105 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.550448:0:6548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5fa105 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.550457:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff952e46d74100) 00010000:00010000:3.0:1782217050.550460:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217050.550463:0:6548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5fa105 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.550469:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5fa105 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.550508:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa0f7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973675 expref: 28 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.550519:0:6548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5fa10c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973675 expref: 27 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.550526:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952e46d74200) 00010000:00010000:3.0:1782217050.550528:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782217050.550531:0:6548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b363c00, rc 0) 00000100:00100000:3.0:1782217050.550624:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+27:12390:x1868789693114368:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 689us (3600us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1782217050.550632:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 204 00000100:00100000:2.0:1782217050.567731:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217050.567812:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693114496 00000100:00100000:3.0:1782217050.567821:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693114496 00000100:00100000:3.0:1782217050.567873:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 205 00000100:00100000:3.0:1782217050.567883:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+27:12390:x1868789693114496:12345-192.168.203.30@tcp:54:lfs.0 00010000:00010000:3.0:1782217050.568111:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa11a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.568127:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa11a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.568138:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa11a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.568171:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa11a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.568178:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa11a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.568185:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa11a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.568191:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362400 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217050.568195:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa11a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.568202:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa11a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.568212:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952e46d74200) 00010000:00010000:3.0:1782217050.568215:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782217050.568219:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa11a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.568225:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa11a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217050.568683:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+27:12390:x1868789693114496:12345-192.168.203.30@tcp:54:lfs.0 Request processed in 800us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217050.568692:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 205 00000100:00100000:3.0:1782217050.573951:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217050.574175:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693114752 00000100:00100000:2.0:1782217050.574186:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693114752 00000100:00100000:2.0:1782217050.574245:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 51 00000100:00100000:2.0:1782217050.574254:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+27:12390:x1868789693114752:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:2.0:1782217050.574487:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+28:12390:x1868789693114752:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 234us (546us total) trans 4294967474 rc 0/0 00000100:00100000:2.0:1782217050.574496:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 51 00000100:00100000:2.0:1782217050.615008:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217050.618128:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693115008 00000100:00100000:0.0:1782217050.618142:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693115008 00010000:00010000:2.0:1782217050.620423:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782217050.623955:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 206 00000100:00100000:1.0:1782217050.623971:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+28:11923:x1868789693115008:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:1.0:1782217050.624006:0:6548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217050.624028:0:6548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5fa121 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be97367c expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.624134:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fa128 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.624149:0:6548:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5fa10c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973675 expref: 29 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.624172:0:6548:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fa128 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.624208:0:6548:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5fa10c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973675 expref: 29 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.624223:0:6548:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5fa10c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973675 expref: 29 pid: 6548 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217050.624237:0:6548:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43799880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6548:1868789713092992:192.168.203.30@tcp:104: 00000100:00100000:1.0:1782217050.624426:0:6548:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d427fbe40 going to sleep for 11 seconds 00000100:00100000:2.0:1782217050.627700:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217050.627767:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693115136 00000100:00100000:3.0:1782217050.627776:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693115136 00010000:00010000:3.0:1782217050.627816:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5fa10c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973675 expref: 30 pid: 6548 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217050.627858:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 93 00000100:00100000:3.0:1782217050.627869:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24a87249-c61f-41a1-85ec-9a313129e739+30:2402:x1868789693115136:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782217050.627883:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217050.627890:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5fa10c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973675 expref: 30 pid: 6548 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.627903:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5fa10c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973675 expref: 30 pid: 6548 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.627924:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952e46d74200) 00010000:00010000:3.0:1782217050.627930:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fa128 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.627940:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fa128 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.627960:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fa128 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.627999:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217050.628058:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24a87249-c61f-41a1-85ec-9a313129e739+30:2402:x1868789693115136:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 191us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217050.628067:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 93 00010000:00010000:1.0:1782217050.630356:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5fa10c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973675 expref: 29 pid: 6548 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217050.630384:0:6548:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43799880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6548:1868789713092992:192.168.203.30@tcp:104: 00010000:00010000:1.0:1782217050.630409:0:6548:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fa128 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.630420:0:6548:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fa128 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.630427:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fa128 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782217050.630448:0:6548:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1782217050.630733:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5fa121 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97367c expref: 30 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.630771:0:6548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fa128 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97367c expref: 29 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.630780:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952e46d74200) 00010000:00010000:1.0:1782217050.630784:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782217050.630787:0:6548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43073400, rc 0) 00000100:00100000:1.0:1782217050.630927:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+29:11923:x1868789693115008:12345-192.168.203.30@tcp:101:bash.0 Request processed in 6951us (15919us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1782217050.630937:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 206 00000100:00100000:2.0:1782217050.636724:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217050.636826:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693115264 00000100:00100000:0.0:1782217050.636835:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693115264 00000100:00100000:0.0:1782217050.636893:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 207 00000100:00100000:0.0:1782217050.636902:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4449d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+29:11923:x1868789693115264:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:0.0:1782217050.636926:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217050.636942:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121de00/0x92b8e04cbf5fa136 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973683 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.636968:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5fa13d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.636978:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5fa13d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.636986:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5fa13d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.637165:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121de00/0x92b8e04cbf5fa136 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973683 expref: 31 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.637183:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5fa13d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973683 expref: 30 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.637190:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952e46d74200) 00010000:00010000:0.0:1782217050.637193:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782217050.637203:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e4121da00, rc 0) 00000100:00100000:0.0:1782217050.637263:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4449d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+30:11923:x1868789693115264:12345-192.168.203.30@tcp:101:bash.0 Request processed in 361us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217050.637270:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 207 00000100:00100000:3.0:1782217050.640900:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217050.641008:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693115520 00000100:00100000:1.0:1782217050.641018:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693115520 00000100:00100000:1.0:1782217050.641080:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 208 00000100:00100000:1.0:1782217050.641090:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+30:11923:x1868789693115520:12345-192.168.203.30@tcp:36:bash.0 00010000:00010000:2.0:1782217050.641459:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5fa144 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.641478:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5fa144 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.641490:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5fa144 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782217050.641534:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000004:00010000:2.0:1782217050.641557:0:6520:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000029551371 reply state 00000000859ae588 transno 4294967477 ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5fa144 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.641620:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5fa144 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.641628:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952e46d74200) 00010000:00010000:2.0:1782217050.641631:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1782217050.641634:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1782217050.641685:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967477 00000100:00100000:2.0:1782217050.641795:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+34:11923:x1868789693115520:12345-192.168.203.30@tcp:36:bash.0 Request processed in 705us (902us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1782217050.641802:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 208 00000020:00080000:2.0:1782217050.641807:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1782217050.644129:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217050.646445:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693115648 00000100:00100000:1.0:1782217050.646458:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693115648 00000100:00100000:2.0:1782217050.646705:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 209 00000100:00100000:2.0:1782217050.646717:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+34:11923:x1868789693115648:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:2.0:1782217050.646742:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217050.646762:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5fa14b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be97368a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.646828:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5fa14b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97368a expref: 35 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.646842:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5fa14b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97368a expref: 35 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.646860:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952e46d74200) 00010000:00010000:2.0:1782217050.646863:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782217050.646867:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2d400, rc 0) 00000100:00100000:2.0:1782217050.646932:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+35:11923:x1868789693115648:12345-192.168.203.30@tcp:101:bash.0 Request processed in 217us (2817us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217050.646953:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 209 00000100:00100000:2.0:1782217050.650945:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217050.651055:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693115776 00000100:00100000:3.0:1782217050.651065:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693115776 00000100:00100000:3.0:1782217050.651124:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 66 00000100:00100000:3.0:1782217050.651135:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4449df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:24a87249-c61f-41a1-85ec-9a313129e739+7:11923:x1868789693115776:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:3.0:1782217050.651152:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217050.651172:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005da6ed1a/0x92b8e04cbf5fa152 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973691 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782217050.651195:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a3a7959, atime: 0x6a3a7957, ctime: 0x6a3a7959, blocks: 0x8 00010000:00010000:3.0:1782217050.651217:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=413s v=(0 0) 00010000:00010000:3.0:1782217050.651222:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217050.651229:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005da6ed1a/0x92b8e04cbf5fa152 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973691 expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.651245:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005da6ed1a/0x92b8e04cbf5fa152 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973691 expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.651258:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b362c00, rc 0) 00000100:00100000:3.0:1782217050.651307:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4449df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:24a87249-c61f-41a1-85ec-9a313129e739+8:11923:x1868789693115776:12345-192.168.203.30@tcp:101:bash.0 Request processed in 174us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217050.651329:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 66 00000100:00100000:3.0:1782217050.654249:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217050.654355:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693115904 00000100:00100000:1.0:1782217050.654364:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693115904 00002000:00010000:1.0:1782217050.654398:0:8439:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:1.0:1782217050.654403:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff952d43d91500 with x1868789693115904 ext(0->18446744073709551615) 00002000:00010000:1.0:1782217050.654414:0:8439:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff952d43d91500. 00000100:00100000:1.0:1782217050.654445:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5 00000100:00100000:1.0:1782217050.654455:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:24a87249-c61f-41a1-85ec-9a313129e739+8:2402:x1868789693115904:12345-192.168.203.30@tcp:10:bash.0 00002000:00010000:1.0:1782217050.654916:0:8439:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1782217050.654921:0:8439:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1782217049 -> 1782217050 00002000:00010000:1.0:1782217050.654924:0:8439:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1782217047 -> 1782217047 00002000:00010000:1.0:1782217050.654936:0:8439:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1782217049 -> 1782217050 00002000:00010000:1.0:1782217050.654938:0:8439:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1782217050.655044:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:24a87249-c61f-41a1-85ec-9a313129e739+9:2402:x1868789693115904:12345-192.168.203.30@tcp:10:bash.0 Request processed in 589us (802us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1782217050.655053:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5 00002000:00010000:1.0:1782217050.655057:0:8439:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:1.0:1782217050.655059:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff952d43d91500 with x1868789693115904 ext(0->18446744073709551615) 00002000:00010000:1.0:1782217050.655064:0:8439:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff952d43d91500. 00000100:00100000:3.0:1782217050.758754:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217050.759634:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693116032 00000100:00100000:1.0:1782217050.759645:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693116032 00000100:00100000:1.0:1782217050.759760:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 210 00000100:00100000:1.0:1782217050.759770:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+35:12405:x1868789693116032:12345-192.168.203.30@tcp:34:lfs.0 00010000:00010000:1.0:1782217050.759837:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5fa159 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.759855:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5fa159 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.759866:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5fa159 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.759879:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa160 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.759887:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa160 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.759895:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa160 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.759983:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5fa167 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.759994:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5fa167 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.760002:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5fa167 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782217050.760058:0:6548:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5fa167 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.760070:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5fa159 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.760076:0:6548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5fa159 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.760084:0:6548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5fa159 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.760090:0:6548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43073000 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217050.760094:0:6548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5fa159 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.760102:0:6548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5fa159 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.760113:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff952e6105c600) 00010000:00010000:1.0:1782217050.760116:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217050.760120:0:6548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5fa159 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.760143:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5fa159 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.760166:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa160 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.760173:0:6548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa160 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.760183:0:6548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa160 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.760189:0:6548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43072200 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217050.760192:0:6548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa160 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.760199:0:6548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa160 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.760208:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff952e6105c200) 00010000:00010000:1.0:1782217050.760211:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217050.760214:0:6548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa160 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.760220:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa160 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.760234:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5fa167 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.760249:0:6548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5fa167 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.760262:0:6548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5fa167 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.760266:0:6548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43072e00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217050.760269:0:6548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5fa167 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.760275:0:6548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5fa167 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.760283:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952e46d74200) 00010000:00010000:1.0:1782217050.760286:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217050.760289:0:6548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5fa167 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.760295:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5fa167 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217050.760373:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+35:12405:x1868789693116032:12345-192.168.203.30@tcp:34:lfs.0 Request processed in 604us (1637us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217050.760382:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 210 00000100:00100000:2.0:1782217050.810651:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217050.811460:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693116288 00000100:00100000:3.0:1782217050.811471:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693116288 00000100:00100000:3.0:1782217050.811537:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 211 00000100:00100000:3.0:1782217050.811547:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4449e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+35:12408:x1868789693116288:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1782217050.811569:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217050.811624:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa16e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973698 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.811705:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa175 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.811719:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa175 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.811855:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa175 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.811874:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5fa17c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.811882:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5fa17c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.811890:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5fa17c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.811992:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5fa183 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.812015:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5fa183 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.812024:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5fa183 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217050.812036:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1782217050.812114:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa175 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.812122:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa175 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.812129:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa175 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.812135:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362e00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217050.812141:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa175 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.812148:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa175 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.812160:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff952e6105c600) 00010000:00010000:3.0:1782217050.812163:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217050.812166:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa175 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.812173:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa175 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.812250:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5fa17c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.812262:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5fa17c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.812267:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5fa17c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.812272:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362a00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217050.812274:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5fa17c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.812280:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5fa17c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.812288:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff952e46d74f00) 00010000:00010000:3.0:1782217050.812291:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217050.812293:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5fa17c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.812298:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5fa17c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.812427:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa16e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973698 expref: 38 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.812442:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5fa183 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973698 expref: 37 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.812449:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952e46d74200) 00010000:00010000:3.0:1782217050.812451:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1782217050.812462:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b362000, rc 0) 00000100:00100000:3.0:1782217050.812683:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4449e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+37:12408:x1868789693116288:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 1136us (2039us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1782217050.812692:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 211 00000100:00100000:3.0:1782217050.815978:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217050.816169:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693116416 00000100:00100000:2.0:1782217050.816189:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693116416 00000100:00100000:2.0:1782217050.816313:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 212 00000100:00100000:2.0:1782217050.816324:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+37:12408:x1868789693116416:12345-192.168.203.30@tcp:54:lfs.0 00010000:00010000:2.0:1782217050.816386:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5fa191 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.816403:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fa128 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97367c expref: 37 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.816413:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5fa191 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.816446:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fa128 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97367c expref: 37 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.816461:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fa128 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97367c expref: 37 pid: 6548 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217050.816476:0:6520:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1868789713093120:192.168.203.30@tcp:104: 00000100:00100000:2.0:1782217050.816577:0:6520:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e52b6ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782217050.819319:0:6520:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1868789713093120:192.168.203.30@tcp:104: 00010000:00010000:2.0:1782217050.819349:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5fa191 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217050.821094:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217050.821171:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693116672 00000100:00100000:2.0:1782217050.821180:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693116672 00000100:00100000:2.0:1782217050.821279:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 52 00000100:00100000:2.0:1782217050.821289:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+38:6170:x1868789693116672:12345-192.168.203.30@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1782217050.821573:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+39:6170:x1868789693116672:12345-192.168.203.30@tcp:35:ldlm_bl.0 Request processed in 283us (484us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1782217050.821624:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 52 00000100:00100000:3.0:1782217050.823473:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217050.823621:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693116800 00000100:00100000:0.0:1782217050.823629:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693116800 00010000:00010000:0.0:1782217050.823673:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fa128 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97367c expref: 39 pid: 6548 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217050.823705:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 94 00000100:00100000:0.0:1782217050.823714:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24a87249-c61f-41a1-85ec-9a313129e739+39:2402:x1868789693116800:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782217050.823727:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217050.823745:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fa128 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97367c expref: 39 pid: 6548 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.823759:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fa128 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97367c expref: 39 pid: 6548 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.823781:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fa128 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97367c expref: 39 pid: 6548 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.823798:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952e46d74200) 00010000:00010000:0.0:1782217050.823803:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5fa191 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.823812:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5fa191 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.823819:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5fa191 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217050.823861:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217050.823901:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24a87249-c61f-41a1-85ec-9a313129e739+38:2402:x1868789693116800:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 188us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217050.823909:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 94 00010000:00010000:3.0:1782217050.824170:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5fa191 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.824179:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5fa191 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.824214:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5fa191 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.824221:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5fa191 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.824228:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5fa191 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.824234:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2c000 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217050.824238:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5fa191 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.824245:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5fa191 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.824255:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952e46d74200) 00010000:00010000:3.0:1782217050.824258:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782217050.824268:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5fa191 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.824274:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5fa191 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217050.824329:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+37:12408:x1868789693116416:12345-192.168.203.30@tcp:54:lfs.0 Request processed in 8007us (8360us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217050.824338:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 212 00000100:00100000:3.0:1782217050.826929:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217050.827164:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693117056 00000100:00100000:1.0:1782217050.827174:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693117056 00000100:00100000:1.0:1782217050.827233:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 53 00000100:00100000:1.0:1782217050.827244:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24a87249-c61f-41a1-85ec-9a313129e739+37:12408:x1868789693117056:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:1.0:1782217050.827467:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24a87249-c61f-41a1-85ec-9a313129e739+38:12408:x1868789693117056:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 224us (546us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1782217050.827476:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 53 00000100:00100000:0.0:1782217050.909467:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217050.909636:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693117312 00000100:00100000:2.0:1782217050.909647:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693117312 00000100:00100000:2.0:1782217050.909717:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 213 00000100:00100000:2.0:1782217050.909728:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+38:12419:x1868789693117312:12345-192.168.203.30@tcp:101:cat.0 00010000:00010000:2.0:1782217050.909755:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217050.909777:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5fa198 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be97369f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.909851:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5fa19f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.909866:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5fa19f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.909877:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5fa19f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.909888:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5fa1a6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.909895:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5fa1a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.909914:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5fa1a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.910022:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5fa1ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.910031:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5fa1ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.910038:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5fa1ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217050.910047:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:2.0:1782217050.910118:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5fa19f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.910126:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5fa19f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.910133:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5fa19f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.910139:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2d800 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782217050.910142:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5fa19f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.910150:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5fa19f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.910162:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff952e6105c600) 00010000:00010000:2.0:1782217050.910165:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217050.910176:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5fa19f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.910183:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5fa19f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.910197:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5fa1a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.910203:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5fa1a6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.910209:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5fa1a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.910214:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2c800 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782217050.910216:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5fa1a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.910222:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5fa1a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.910230:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff952d410a7f00) 00010000:00010000:2.0:1782217050.910232:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217050.910235:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5fa1a6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.910241:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5fa1a6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.910281:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5fa198 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97369f expref: 41 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.910308:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5fa1ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97369f expref: 40 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217050.910316:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952e46d74200) 00010000:00010000:2.0:1782217050.910318:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782217050.910321:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2c600, rc 0) 00000100:00100000:2.0:1782217050.910383:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+40:12419:x1868789693117312:12345-192.168.203.30@tcp:101:cat.0 Request processed in 656us (926us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1782217050.910391:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 213 00000100:00100000:3.0:1782217050.919369:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217050.920350:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693117568 00000100:00100000:1.0:1782217050.920360:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693117568 00000100:00100000:1.0:1782217050.920436:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 54 00000100:00100000:1.0:1782217050.920446:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43315180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24a87249-c61f-41a1-85ec-9a313129e739+40:12419:x1868789693117568:12345-192.168.203.30@tcp:35:cat.0 00000100:00100000:1.0:1782217050.920762:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43315180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24a87249-c61f-41a1-85ec-9a313129e739+41:12419:x1868789693117568:12345-192.168.203.30@tcp:35:cat.0 Request processed in 317us (1399us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1782217050.920770:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 54 00000100:00100000:3.0:1782217050.957552:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217050.957662:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693117824 00000100:00100000:1.0:1782217050.957673:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693117824 00000100:00100000:1.0:1782217050.957734:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 214 00000100:00100000:1.0:1782217050.957744:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43316a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+41:12420:x1868789693117824:12345-192.168.203.30@tcp:36:rm.0 00010000:00010000:1.0:1782217050.957800:0:6548:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1782217050.957835:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5fa14b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97368a expref: 41 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.957859:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5fa1ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97369f expref: 40 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.957870:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5fa183 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973698 expref: 39 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.957883:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5fa13d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973683 expref: 38 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.957892:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952e46d74200) 00010000:00010000:1.0:1782217050.957896:0:6548:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782217050.957915:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa1bb lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.957941:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa1bb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.957950:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa1bb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.957965:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5fa1c2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.957971:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5fa1c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.957976:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5fa1c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.958045:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fa1c9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.958053:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fa1c9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.958400:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fa1c9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782217050.958700:0:6548:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00010000:00010000:1.0:1782217050.958744:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5fa1d0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.958754:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5fa1d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.958761:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5fa1d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.958776:0:6548:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5fa1d0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.958782:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5fa1d0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.958787:0:6548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5fa1d0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.958811:0:6548:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782217050.958840:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fa1c9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.958845:0:6548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fa1c9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.958850:0:6548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fa1c9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.958855:0:6548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43073400 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217050.958859:0:6548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fa1c9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.958865:0:6548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fa1c9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.958874:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952e46d74200) 00010000:00010000:1.0:1782217050.958877:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782217050.958881:0:6548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fa1c9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.958895:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fa1c9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.958910:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa1bb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.958916:0:6548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa1bb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.958922:0:6548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa1bb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.958925:0:6548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43072200 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217050.958928:0:6548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa1bb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.958934:0:6548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa1bb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.958940:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff952e6105c600) 00010000:00010000:1.0:1782217050.958942:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217050.958945:0:6548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa1bb lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.958949:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa1bb lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782217050.958957:0:6548:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000054ac020d reply state 0000000074b7fb5f transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5fa1c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.958967:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5fa1c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217050.958978:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff952e6105c200) 00010000:00010000:1.0:1782217050.958980:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782217050.958983:0:6548:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782217050.959120:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43316a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+39:12420:x1868789693117824:12345-192.168.203.30@tcp:36:rm.0 Request processed in 1313us (1513us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1782217050.959129:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 214 00010000:00010000:3.0:1782217050.960475:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782217050.960486:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5fa1d0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.960495:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43072e00 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:3.0:1782217050.960498:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5fa1d0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.960506:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5fa1d0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.960521:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952e46d74200) 00010000:00010000:3.0:1782217050.960524:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782217050.960527:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5fa1d0 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.960532:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5fa1d0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217050.960544:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217050.960559:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217050.960561:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782217051.029343:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217051.034834:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693118080 00000100:00100000:3.0:1782217051.034849:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693118080 00000100:00100000:3.0:1782217051.035279:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 215 00000100:00100000:3.0:1782217051.035293:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+39:12426:x1868789693118080:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:3.0:1782217051.035320:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217051.035342:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5fa1d7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9736a6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.035450:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa1de lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.035465:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa1de lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.035477:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa1de lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.035489:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5fa1e5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.035497:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5fa1e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.035504:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5fa1e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782217051.035870:0:6519:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:3.0:1782217051.036015:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa1ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.036042:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa1ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.036050:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa1ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.036085:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa1de lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.036093:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa1de lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.036099:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa1de lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.036105:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362400 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217051.036109:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa1de lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.036116:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa1de lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.036128:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff952e6105c600) 00010000:00010000:3.0:1782217051.036131:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217051.036135:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa1de lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.036141:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa1de lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1782217051.036196:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:3.0:1782217051.039147:0:6519:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002b406e97 reply state 000000000a9b3c97 transno 4294967485 ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5fa1e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.039531:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5fa1e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.039541:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff952e6105c200) 00010000:00010000:3.0:1782217051.039545:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782217051.039550:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782217051.039913:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5fa1d7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736a6 expref: 42 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.039935:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa1ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736a6 expref: 41 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.039943:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff952e46d74f00) 00010000:00010000:3.0:1782217051.039945:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782217051.039949:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b362e00, rc 0) 00000100:00100000:3.0:1782217051.040023:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+42:12426:x1868789693118080:12345-192.168.203.30@tcp:101:bash.0 Request processed in 4733us (10689us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1782217051.040033:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 215 00000100:00100000:0.0:1782217051.050736:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217051.050829:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693118208 00000100:00100000:2.0:1782217051.050838:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693118208 00000100:00100000:2.0:1782217051.050920:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 67 00000100:00100000:2.0:1782217051.050930:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:24a87249-c61f-41a1-85ec-9a313129e739+7:2405:x1868789693118208:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:2.0:1782217051.050949:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217051.050970:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052671b85/0x92b8e04cbf5fa1fa lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9736ad expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782217051.050996:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782217051.051015:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1782217051.051019:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782217051.051028:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052671b85/0x92b8e04cbf5fa1fa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736ad expref: 8 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.051048:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000052671b85/0x92b8e04cbf5fa1fa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736ad expref: 8 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.051081:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2c200, rc 0) 00000100:00100000:2.0:1782217051.051144:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:24a87249-c61f-41a1-85ec-9a313129e739+8:2405:x1868789693118208:12345-192.168.203.30@tcp:101:bash.0 Request processed in 214us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217051.051151:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 67 00000100:00080000:1.0:1782217051.051471:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782217051.054752:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217051.054896:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693118336 00000100:00100000:1.0:1782217051.054906:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693118336 00000100:00100000:1.0:1782217051.054972:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 68 00000100:00100000:1.0:1782217051.054982:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:24a87249-c61f-41a1-85ec-9a313129e739+8:12426:x1868789693118336:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:1.0:1782217051.055002:0:14273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217051.055019:0:14273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091802ae6/0x92b8e04cbf5fa201 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9736b4 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217051.055049:0:14273:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000052671b85/0x92b8e04cbf5fa1fa lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736ad expref: 9 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217051.055058:0:14273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217051.055061:0:14273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217051.055066:0:14273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091802ae6/0x92b8e04cbf5fa201 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736b4 expref: 9 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217051.055095:0:14273:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000052671b85/0x92b8e04cbf5fa1fa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736ad expref: 9 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217051.055125:0:14273:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000052671b85/0x92b8e04cbf5fa1fa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736ad expref: 9 pid: 8435 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217051.055137:0:14273:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43799880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14273:1868789713093248:192.168.203.30@tcp:104: 00000100:00100000:1.0:1782217051.055249:0:14273:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e64ef2240 going to sleep for 11 seconds 00000100:00100000:1.0:1782217051.059497:0:14273:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43799880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14273:1868789713093248:192.168.203.30@tcp:104: 00010000:00010000:1.0:1782217051.059548:0:14273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000091802ae6/0x92b8e04cbf5fa201 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736b4 expref: 9 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217051.059570:0:14273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43072200, rc 0) 00000100:00100000:1.0:1782217051.059713:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:24a87249-c61f-41a1-85ec-9a313129e739+9:12426:x1868789693118336:12345-192.168.203.30@tcp:101:bash.0 Request processed in 4731us (4978us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217051.059722:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 68 00000100:00100000:0.0:1782217051.062105:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217051.062325:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693118464 00000100:00100000:2.0:1782217051.062334:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693118464 00010000:00010000:2.0:1782217051.063189:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000052671b85/0x92b8e04cbf5fa1fa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736ad expref: 9 pid: 8435 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217051.063408:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 95 00000100:00100000:2.0:1782217051.063420:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e6f92d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24a87249-c61f-41a1-85ec-9a313129e739+9:2403:x1868789693118464:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782217051.063436:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217051.063455:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000052671b85/0x92b8e04cbf5fa1fa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736ad expref: 9 pid: 8435 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.063468:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000052671b85/0x92b8e04cbf5fa1fa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736ad expref: 9 pid: 8435 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.063490:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052671b85/0x92b8e04cbf5fa1fa lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736ad expref: 9 pid: 8435 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.063507:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782217051.063511:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782217051.063518:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000091802ae6/0x92b8e04cbf5fa201 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736b4 expref: 8 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.063541:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091802ae6/0x92b8e04cbf5fa201 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736b4 expref: 8 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.063629:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000091802ae6/0x92b8e04cbf5fa201 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736b4 expref: 8 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217051.063645:0:6506:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6506:1868789713093376:192.168.203.30@tcp:105: 00000100:00100000:2.0:1782217051.063738:0:6506:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e52b6eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1782217051.066745:0:6506:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6506:1868789713093376:192.168.203.30@tcp:105: 00010000:00010000:2.0:1782217051.066771:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217051.066815:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e6f92d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24a87249-c61f-41a1-85ec-9a313129e739+8:2403:x1868789693118464:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 3397us (4717us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217051.066825:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 95 00000100:00100000:1.0:1782217051.070250:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217051.070400:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693118720 00000100:00100000:2.0:1782217051.070410:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693118720 00000100:00100000:2.0:1782217051.070469:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 55 00000100:00100000:2.0:1782217051.070478:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+42:12426:x1868789693118720:12345-192.168.203.30@tcp:35:bash.0 00000001:00080000:2.0:1782217051.070747:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000100:00100000:2.0:1782217051.070961:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+44:12426:x1868789693118720:12345-192.168.203.30@tcp:35:bash.0 Request processed in 482us (719us total) trans 4294967487 rc 0/0 00000100:00100000:2.0:1782217051.070970:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 55 00000020:00080000:2.0:1782217051.070979:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1782217051.192911:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782217051.192936:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43314a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713093504:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782217051.193033:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217051.193102:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713093504 00000100:00100000:0.0:1782217051.193111:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713093504 00000100:00100000:0.0:1782217051.193166:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1782217051.193175:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713093504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782217051.193209:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1782217051.193392:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713093504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 216us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217051.193401:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1782217051.193498:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43314a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713093504:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782217051.213222:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217051.213408:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693118848 00000100:00100000:3.0:1782217051.213418:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693118848 00000100:00100000:3.0:1782217051.213483:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 216 00000100:00100000:3.0:1782217051.213493:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43feea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+44:12442:x1868789693118848:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1782217051.213517:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217051.213536:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5fa208 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9736bb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.213643:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa20f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.213676:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa20f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.213688:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa20f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217051.213742:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1782217051.213746:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782217051.213764:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa20f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.213786:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5fa208 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736bb expref: 46 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.213803:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa20f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736bb expref: 45 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.213811:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff952e6105c600) 00010000:00010000:3.0:1782217051.213813:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782217051.213816:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b362400, rc 0) 00000100:00100000:3.0:1782217051.213874:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43feea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+45:12442:x1868789693118848:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 382us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217051.213881:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 216 00000100:00100000:0.0:1782217051.217356:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217051.217497:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693119104 00000100:00100000:2.0:1782217051.217507:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693119104 00000100:00100000:2.0:1782217051.217566:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 217 00000100:00100000:2.0:1782217051.217576:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+45:12442:x1868789693119104:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1782217051.217627:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217051.217648:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5fa216 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9736c2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.217762:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5fa21d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.217776:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5fa21d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.217788:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5fa21d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217051.217799:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1782217051.217900:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5fa216 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736c2 expref: 48 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.217918:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5fa21d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736c2 expref: 47 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.217927:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff952e46d74f00) 00010000:00010000:2.0:1782217051.217930:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782217051.217934:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2c800, rc 0) 00000100:00100000:2.0:1782217051.218001:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+47:12442:x1868789693119104:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 426us (653us total) trans 4294967488 rc 0/0 00000100:00100000:2.0:1782217051.218025:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 217 00000100:00100000:1.0:1782217051.222163:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217051.222437:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693119360 00000100:00100000:3.0:1782217051.222447:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693119360 00000100:00100000:3.0:1782217051.222509:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 218 00000100:00100000:3.0:1782217051.222518:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4368c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+47:12442:x1868789693119360:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1782217051.222540:0:6548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217051.222565:0:6548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5fa22b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9736c9 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.222798:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5fa232 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.222813:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5fa232 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.222825:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5fa232 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217051.222837:0:6548:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1782217051.222934:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5fa22b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736c9 expref: 50 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.224477:0:6548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5fa232 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736c9 expref: 49 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.224492:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff952e46d74f00) 00010000:00010000:3.0:1782217051.224495:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1782217051.224498:0:6548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b362000, rc 0) 00000100:00100000:3.0:1782217051.228515:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4368c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+49:12442:x1868789693119360:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 5986us (6360us total) trans 4294967489 rc 0/0 00000100:00100000:3.0:1782217051.228530:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 218 00000100:00100000:0.0:1782217051.230052:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217051.230293:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693119488 00000100:00100000:3.0:1782217051.230361:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693119488 00000100:00100000:3.0:1782217051.230455:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:3.0:1782217051.230466:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24a87249-c61f-41a1-85ec-9a313129e739+49:2405:x1868789693119488:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782217051.230494:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217051.230516:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5fa21d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736c2 expref: 49 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.230542:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff952e46d74f00) 00010000:00010000:3.0:1782217051.230546:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217051.230727:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24a87249-c61f-41a1-85ec-9a313129e739+48:2405:x1868789693119488:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 262us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217051.230736:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:1.0:1782217051.236234:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217051.236513:0:10025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693119616 00000100:00100000:2.0:1782217051.236523:0:10025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693119616 00000100:00100000:2.0:1782217051.236620:0:10025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 69 00000100:00100000:2.0:1782217051.236631:0:10025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42610a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:24a87249-c61f-41a1-85ec-9a313129e739+8:2404:x1868789693119616:12345-192.168.203.30@tcp:1:lfs.0 00010000:00010000:2.0:1782217051.236684:0:10025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfa93e61/0x92b8e04cbf5fa240 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.236705:0:10025:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000091802ae6/0x92b8e04cbf5fa201 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736b4 expref: 8 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.236714:0:10025:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782217051.236719:0:10025:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782217051.236723:0:10025:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cfa93e61/0x92b8e04cbf5fa240 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.236916:0:10025:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000091802ae6/0x92b8e04cbf5fa201 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736b4 expref: 8 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.236931:0:10025:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000091802ae6/0x92b8e04cbf5fa201 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736b4 expref: 8 pid: 14273 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217051.236954:0:10025:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10025:1868789713093632:192.168.203.30@tcp:104: 00000100:00100000:2.0:1782217051.237083:0:10025:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e52b6ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782217051.249044:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217051.249172:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693119744 00000100:00100000:3.0:1782217051.249182:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693119744 00002000:00100000:3.0:1782217051.249230:0:8438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff952d43e92a00 x1868789693119744/t0(0) o4->24a87249-c61f-41a1-85ec-9a313129e739@192.168.203.30@tcp:302/0 lens 504/0 e 0 to 0 dl 1782217062 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782217051.249242:0:8438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff952d43e92a00 with x1868789693119744 ext(0->8) 00010000:00010000:3.0:1782217051.249253:0:8438:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000091802ae6/0x92b8e04cbf5fa201 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736b4 expref: 9 pid: 14273 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.249269:0:8438:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000091802ae6/0x92b8e04cbf5fa201 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736b4 expref: 9 pid: 14273 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782217051.249277:0:8438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff952d43e92a00 00000100:00100000:3.0:1782217051.249312:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3 00000100:00100000:3.0:1782217051.249323:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:24a87249-c61f-41a1-85ec-9a313129e739+9:2402:x1868789693119744:12345-192.168.203.30@tcp:4:lfs.0 00000100:00100000:0.0:1782217051.249833:0:10025:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10025:1868789713093632:192.168.203.30@tcp:104: 00010000:00010000:0.0:1782217051.249857:0:10025:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cfa93e61/0x92b8e04cbf5fa240 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217051.251951:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:24a87249-c61f-41a1-85ec-9a313129e739+11:2402:x1868789693119744:12345-192.168.203.30@tcp:4:lfs.0 Request processed in 2618us (2905us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1782217051.251965:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3 00002000:00100000:2.0:1782217051.251976:0:8438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff952d43e92a00 x1868789693119744/t4294967309(0) o4->24a87249-c61f-41a1-85ec-9a313129e739@192.168.203.30@tcp:302/0 lens 504/448 e 0 to 0 dl 1782217062 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782217051.251986:0:8438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff952d43e92a00 with x1868789693119744 ext(0->8) 00010000:00010000:2.0:1782217051.251996:0:8438:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000091802ae6/0x92b8e04cbf5fa201 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736b4 expref: 11 pid: 14273 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.252014:0:8438:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000091802ae6/0x92b8e04cbf5fa201 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736b4 expref: 11 pid: 14273 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782217051.252022:0:8438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff952d43e92a00 00000100:00100000:0.0:1782217051.258694:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217051.258883:0:13731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693119872 00000100:00100000:3.0:1782217051.258893:0:13731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693119872 00010000:00010000:3.0:1782217051.258933:0:13731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000091802ae6/0x92b8e04cbf5fa201 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736b4 expref: 11 pid: 14273 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217051.258986:0:13731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 96 00000100:00100000:3.0:1782217051.258996:0:13731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:24a87249-c61f-41a1-85ec-9a313129e739+11:2405:x1868789693119872:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782217051.259012:0:13731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1782217051.259030:0:13731:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1782217051.259033:0:13731:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1782217051 00002000:00010000:3.0:1782217051.259036:0:13731:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1782217051 00002000:00010000:3.0:1782217051.259038:0:13731:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1782217051 00002000:00010000:3.0:1782217051.259040:0:13731:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1782217051.259046:0:13731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000091802ae6/0x92b8e04cbf5fa201 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736b4 expref: 11 pid: 14273 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.259062:0:13731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000091802ae6/0x92b8e04cbf5fa201 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736b4 expref: 11 pid: 14273 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.259086:0:13731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091802ae6/0x92b8e04cbf5fa201 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736b4 expref: 11 pid: 14273 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.259104:0:13731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782217051.259108:0:13731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782217051.259113:0:13731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cfa93e61/0x92b8e04cbf5fa240 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.259123:0:13731:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cfa93e61/0x92b8e04cbf5fa240 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.259298:0:13731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217051.259359:0:13731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:24a87249-c61f-41a1-85ec-9a313129e739+10:2405:x1868789693119872:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 363us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217051.259367:0:13731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 96 00010000:00010000:2.0:1782217051.264084:0:10025:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cfa93e61/0x92b8e04cbf5fa240 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.264103:0:10025:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cfa93e61/0x92b8e04cbf5fa240 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.264317:0:10025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfa93e61/0x92b8e04cbf5fa240 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.264326:0:10025:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cfa93e61/0x92b8e04cbf5fa240 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.264335:0:10025:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cfa93e61/0x92b8e04cbf5fa240 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.264358:0:10025:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2ca00 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:2.0:1782217051.264363:0:10025:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfa93e61/0x92b8e04cbf5fa240 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.264371:0:10025:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfa93e61/0x92b8e04cbf5fa240 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.264388:0:10025:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cfa93e61/0x92b8e04cbf5fa240 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.264394:0:10025:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cfa93e61/0x92b8e04cbf5fa240 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217051.264553:0:10025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42610a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:24a87249-c61f-41a1-85ec-9a313129e739+9:2404:x1868789693119616:12345-192.168.203.30@tcp:1:lfs.0 Request processed in 27920us (28325us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217051.264562:0:10025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 69 00000100:00100000:0.0:1782217051.268337:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217051.268445:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693120128 00000100:00100000:2.0:1782217051.268454:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693120128 00000100:00100000:2.0:1782217051.269163:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 56 00000100:00100000:2.0:1782217051.269175:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e50124850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+48:12442:x1868789693120128:12345-192.168.203.30@tcp:35:lfs.0 00000004:00010000:2.0:1782217051.269237:0:6521:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5fa232 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736c9 expref: 48 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782217051.269404:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:2.0:1782217051.269433:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:2.0:1782217051.270198:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:2.0:1782217051.270241:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5fa247 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.270257:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa1ec lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736a6 expref: 52 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.270267:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5fa247 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.270303:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa1ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736a6 expref: 52 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.270317:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa1ec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736a6 expref: 52 pid: 6519 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217051.270331:0:6521:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43e90380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1868789713093760:192.168.203.30@tcp:104: 00000100:00100000:2.0:1782217051.270542:0:6521:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e52b6e900 going to sleep for 11 seconds 00000100:00100000:2.0:1782217051.274101:0:6521:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43e90380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1868789713093760:192.168.203.30@tcp:104: 00010000:00010000:2.0:1782217051.274130:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5fa247 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217051.274911:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217051.276431:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693120256 00000100:00100000:2.0:1782217051.276444:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693120256 00010000:00010000:2.0:1782217051.276553:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa1ec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736a6 expref: 53 pid: 6519 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217051.276678:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 97 00000100:00100000:2.0:1782217051.276689:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43feb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24a87249-c61f-41a1-85ec-9a313129e739+53:2403:x1868789693120256:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782217051.276717:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217051.276725:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa1ec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736a6 expref: 53 pid: 6519 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.276749:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa1ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736a6 expref: 53 pid: 6519 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.276770:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa1ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736a6 expref: 53 pid: 6519 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.276788:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff952e46d74f00) 00010000:00010000:2.0:1782217051.276793:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5fa247 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.276803:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5fa247 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.276811:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5fa247 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.276848:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217051.276905:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43feb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24a87249-c61f-41a1-85ec-9a313129e739+52:2403:x1868789693120256:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 218us (1997us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217051.276913:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 97 00010000:00010000:1.0:1782217051.277008:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5fa247 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217051.277016:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5fa247 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782217051.277123:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000001:00080000:1.0:1782217051.277249:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00000100:00100000:1.0:1782217051.277339:0:6521:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c673100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1868789713093888:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1782217051.277385:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217051.277418:0:6521:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e42c59300 going to sleep for 11 seconds 00000100:00100000:0.0:1782217051.277481:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713093888 00000100:00100000:0.0:1782217051.277486:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713093888 00000100:00100000:0.0:1782217051.277539:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1782217051.277547:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c673b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6521:x1868789713093888:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1782217051.277640:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c673b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6521:x1868789713093888:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 94us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217051.277656:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1782217051.277694:0:6521:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c673100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1868789713093888:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1782217051.277799:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00000100:00100000:0.0:1782217051.277836:0:6521:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43febb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1868789713094016:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1782217051.277862:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217051.277875:0:6521:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d426cc240 going to sleep for 11 seconds 00000100:00080000:1.0:1782217051.278059:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782217051.278169:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713094016 00000100:00100000:2.0:1782217051.278175:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713094016 00000100:00100000:2.0:1782217051.278245:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1782217051.278254:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fe8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6521:x1868789713094016:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1782217051.278358:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fe8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6521:x1868789713094016:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 105us (494us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1782217051.278374:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1782217051.278429:0:6521:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43febb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1868789713094016:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1782217051.278468:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967496 00010000:00010000:1.0:1782217051.278498:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5fa247 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217051.278507:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5fa247 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217051.278514:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5fa247 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217051.278520:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2c200 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217051.278524:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5fa247 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217051.278532:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5fa247 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217051.278546:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff952e46d74f00) 00010000:00010000:1.0:1782217051.278549:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1782217051.278552:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5fa247 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217051.278558:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5fa247 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782217051.278672:0:6521:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1782217051.278740:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1782217051.278751:0:6521:0:(osp_sync.c:1862:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 414262167329ns, next at 415262165657ns, rc = 0 00000001:00080000:1.0:1782217051.278757:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967497 00010000:00010000:1.0:1782217051.278778:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff952e46d74f00) 00010000:00010000:1.0:1782217051.278781:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1782217051.278787:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5fa232 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736c9 expref: 56 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217051.278878:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e50124850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+55:12442:x1868789693120128:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 9706us (10550us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1782217051.278887:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 56 00000020:00080000:1.0:1782217051.278891:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1782217051.282309:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217051.282394:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693120384 00000100:00100000:3.0:1782217051.282404:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693120384 00000100:00100000:3.0:1782217051.282456:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 219 00000100:00100000:3.0:1782217051.282467:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43feb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+55:12442:x1868789693120384:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1782217051.282493:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217051.282515:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5fa24e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9736d0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.282565:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5fa24e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736d0 expref: 56 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.282716:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5fa24e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736d0 expref: 56 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217051.289211:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:0.0:1782217051.289220:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782217051.289225:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b363e00, rc 0) 00000100:00100000:0.0:1782217051.289355:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43feb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+56:12442:x1868789693120384:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 6886us (7049us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217051.289365:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 219 00000100:00100000:0.0:1782217051.292965:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217051.293211:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693120640 00000100:00100000:1.0:1782217051.293221:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693120640 00000100:00100000:1.0:1782217051.293283:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 57 00000100:00100000:1.0:1782217051.293293:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43feb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24a87249-c61f-41a1-85ec-9a313129e739+56:12442:x1868789693120640:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:1.0:1782217051.294938:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43feb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24a87249-c61f-41a1-85ec-9a313129e739+57:12442:x1868789693120640:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 1639us (1974us total) trans 4294967499 rc 0/0 00000100:00100000:1.0:1782217051.294951:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 57 00000100:00100000:1.0:1782217051.363487:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217051.363576:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693120768 00000100:00100000:2.0:1782217051.363692:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693120768 00000100:00100000:2.0:1782217051.363806:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 220 00000100:00100000:2.0:1782217051.363817:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c671180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+57:12453:x1868789693120768:12345-192.168.203.30@tcp:34:lfs.0 00010000:00010000:2.0:1782217051.363892:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5fa255 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.363911:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5fa255 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.363939:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5fa255 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.363955:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5fa25c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.363963:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5fa25c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.363971:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5fa25c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.364045:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5fa263 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.364053:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5fa263 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.364061:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5fa263 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782217051.364125:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5fa263 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.364139:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5fa255 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.364146:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5fa255 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.364154:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5fa255 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.364160:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2ca00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782217051.364164:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5fa255 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.364172:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5fa255 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.364194:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff952e6105c600) 00010000:00010000:2.0:1782217051.364197:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217051.364202:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5fa255 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.364209:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5fa255 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.364223:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5fa25c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.364229:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5fa25c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.364245:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5fa25c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.364250:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2cc00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782217051.364253:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5fa25c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.364259:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5fa25c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.364266:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff952e6105c200) 00010000:00010000:2.0:1782217051.364269:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217051.364271:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5fa25c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.364276:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5fa25c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.364285:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5fa263 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.364290:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5fa263 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.364296:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5fa263 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.364301:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2d000 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782217051.364303:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5fa263 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.364318:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5fa263 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.364325:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:2.0:1782217051.364448:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217051.364452:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5fa263 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.364459:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5fa263 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217051.364577:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c671180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+57:12453:x1868789693120768:12345-192.168.203.30@tcp:34:lfs.0 Request processed in 760us (1098us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217051.364629:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 220 00000100:00100000:0.0:1782217051.403064:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217051.403185:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693121024 00000100:00100000:2.0:1782217051.403200:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693121024 00000100:00100000:2.0:1782217051.403260:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 221 00000100:00100000:2.0:1782217051.403269:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fe8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+57:12456:x1868789693121024:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1782217051.403289:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217051.403307:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5fa26a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9736d7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.403377:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5fa271 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.403391:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5fa271 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.403403:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5fa271 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.403429:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5fa278 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.403436:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5fa278 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.403442:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5fa278 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.403544:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5fa27f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.403551:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5fa27f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.403558:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5fa27f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217051.403567:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1782217051.403673:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5fa271 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.403681:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5fa271 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.403688:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5fa271 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.403694:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2cc00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782217051.403698:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5fa271 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.403717:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5fa271 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.403740:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff952e6105c600) 00010000:00010000:2.0:1782217051.403744:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217051.403748:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5fa271 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.403755:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5fa271 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.403769:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5fa278 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.403775:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5fa278 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.403781:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5fa278 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.403786:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2ca00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782217051.403789:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5fa278 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.403795:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5fa278 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.403802:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff952e6105c200) 00010000:00010000:2.0:1782217051.403804:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217051.403807:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5fa278 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.403823:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5fa278 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.403855:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5fa26a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736d7 expref: 60 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.404935:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5fa27f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736d7 expref: 59 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.404944:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:2.0:1782217051.404948:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782217051.404951:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2c200, rc 0) 00000100:00100000:2.0:1782217051.405021:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fe8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+59:12456:x1868789693121024:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 1752us (1965us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1782217051.405030:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 221 00000100:00100000:0.0:1782217051.409576:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217051.409703:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693121152 00000100:00100000:3.0:1782217051.409712:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693121152 00000100:00100000:3.0:1782217051.409770:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 222 00000100:00100000:3.0:1782217051.409780:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fe9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+59:12456:x1868789693121152:12345-192.168.203.30@tcp:54:lfs.0 00010000:00010000:3.0:1782217051.409839:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5fa28d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.409863:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5fa28d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.409886:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5fa28d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.409921:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5fa28d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.409928:0:6548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5fa28d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.409935:0:6548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5fa28d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.409940:0:6548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b363c00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217051.409944:0:6548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5fa28d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.409951:0:6548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5fa28d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.409962:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:3.0:1782217051.409964:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782217051.409968:0:6548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5fa28d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.409975:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5fa28d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217051.410040:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fe9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+59:12456:x1868789693121152:12345-192.168.203.30@tcp:54:lfs.0 Request processed in 261us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217051.410047:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 222 00000100:00100000:3.0:1782217051.413680:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217051.413748:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693121408 00000100:00100000:0.0:1782217051.413756:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693121408 00000100:00100000:0.0:1782217051.413801:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 58 00000100:00100000:0.0:1782217051.413814:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43315180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+59:12456:x1868789693121408:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:0.0:1782217051.414017:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43315180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+60:12456:x1868789693121408:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 201us (344us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1782217051.414029:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 58 00000100:00100000:0.0:1782217051.489341:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217051.493071:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693121664 00000100:00100000:2.0:1782217051.493086:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693121664 00000100:00100000:2.0:1782217051.493166:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 223 00000100:00100000:2.0:1782217051.493176:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4441ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+60:12466:x1868789693121664:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:2.0:1782217051.493214:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217051.493218:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1782217051.493244:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa20f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736bb expref: 60 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.493266:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff952e6105c600) 00010000:00010000:2.0:1782217051.493271:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782217051.493299:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5fa294 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9736de expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.493412:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5fa29b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.493426:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5fa27f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736d7 expref: 60 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.493435:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5fa29b lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.493466:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5fa27f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736d7 expref: 60 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.496898:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5fa27f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736d7 expref: 60 pid: 6518 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217051.496928:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43e90380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1868789713094144:192.168.203.30@tcp:104: 00000100:00100000:2.0:1782217051.497043:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e52b6e900 going to sleep for 11 seconds 00000100:00100000:2.0:1782217051.509999:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217051.513826:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693121792 00000100:00100000:1.0:1782217051.513839:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693121792 00010000:00010000:1.0:1782217051.513893:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5fa27f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736d7 expref: 61 pid: 6518 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217051.513944:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 98 00000100:00100000:1.0:1782217051.513954:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24a87249-c61f-41a1-85ec-9a313129e739+61:2403:x1868789693121792:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782217051.513986:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782217051.513994:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5fa27f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736d7 expref: 61 pid: 6518 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217051.514009:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5fa27f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736d7 expref: 61 pid: 6518 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217051.514029:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:1.0:1782217051.514034:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5fa29b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217051.514043:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5fa29b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217051.514050:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5fa29b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217051.514069:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782217051.514125:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24a87249-c61f-41a1-85ec-9a313129e739+61:2403:x1868789693121792:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 172us (4136us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217051.514132:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 98 00010000:00010000:0.0:1782217051.514525:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5fa27f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736d7 expref: 60 pid: 6518 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217051.514543:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43e90380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1868789713094144:192.168.203.30@tcp:104: 00010000:00010000:0.0:1782217051.514561:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5fa29b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217051.514570:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5fa29b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217051.514576:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5fa29b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782217051.514633:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1782217051.514782:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5fa294 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736de expref: 61 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217051.514796:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5fa29b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736de expref: 60 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217051.514804:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:0.0:1782217051.514807:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1782217051.514817:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2cc00, rc 0) 00000100:00100000:0.0:1782217051.514857:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4441ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+60:12466:x1868789693121664:12345-192.168.203.30@tcp:101:bash.0 Request processed in 21682us (25526us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1782217051.514866:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 223 00000100:00100000:2.0:1782217051.520503:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217051.520704:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693121920 00000100:00100000:3.0:1782217051.520715:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693121920 00000100:00100000:3.0:1782217051.520783:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 224 00000100:00100000:3.0:1782217051.520794:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+60:12466:x1868789693121920:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:3.0:1782217051.520818:0:6548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217051.520838:0:6548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5fa2a9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9736e5 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.520873:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa2b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.520887:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa2b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.520897:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa2b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.521027:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5fa2a9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736e5 expref: 62 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.521049:0:6548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa2b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736e5 expref: 61 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.521058:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:3.0:1782217051.521063:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1782217051.521066:0:6548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b362400, rc 0) 00000100:00100000:3.0:1782217051.521227:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+61:12466:x1868789693121920:12345-192.168.203.30@tcp:101:bash.0 Request processed in 434us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217051.521234:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 224 00000100:00100000:2.0:1782217051.525415:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217051.525796:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693122176 00000100:00100000:3.0:1782217051.525805:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693122176 00000100:00100000:3.0:1782217051.525855:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 225 00000100:00100000:3.0:1782217051.525864:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e525f7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+61:12466:x1868789693122176:12345-192.168.203.30@tcp:36:bash.0 00010000:00010000:3.0:1782217051.526093:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa2b7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.526110:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa2b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.526120:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa2b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782217051.526164:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967503 00000004:00010000:3.0:1782217051.526187:0:6518:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000724e1ac reply state 00000000a952b60f transno 4294967504 ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa2b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.526200:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa2b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.526207:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:3.0:1782217051.526210:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782217051.526213:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782217051.526300:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e525f7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+64:12466:x1868789693122176:12345-192.168.203.30@tcp:36:bash.0 Request processed in 435us (893us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1782217051.526308:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 225 00000020:00080000:3.0:1782217051.526313:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1782217051.531149:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217051.531250:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693122304 00000100:00100000:2.0:1782217051.531260:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693122304 00000100:00100000:2.0:1782217051.531318:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 226 00000100:00100000:2.0:1782217051.531328:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c672300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+64:12466:x1868789693122304:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:2.0:1782217051.531351:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217051.531372:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5fa2be lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9736ec expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.531475:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5fa2c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.531489:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5fa29b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736de expref: 65 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.531499:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5fa2c5 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.531532:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5fa29b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736de expref: 65 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.531545:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5fa29b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736de expref: 65 pid: 6519 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217051.531559:0:6520:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43e91f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1868789713094272:192.168.203.30@tcp:104: 00000100:00100000:2.0:1782217051.531699:0:6520:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e52b6e900 going to sleep for 11 seconds 00000100:00100000:3.0:1782217051.542464:0:6520:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43e91f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1868789713094272:192.168.203.30@tcp:104: 00010000:00010000:3.0:1782217051.542493:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5fa2c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217051.543960:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217051.544564:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693122432 00000100:00100000:0.0:1782217051.544573:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693122432 00010000:00010000:0.0:1782217051.544655:0:8449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5fa29b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736de expref: 66 pid: 6519 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217051.544689:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 99 00000100:00100000:0.0:1782217051.544698:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c671880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:24a87249-c61f-41a1-85ec-9a313129e739+66:2402:x1868789693122432:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782217051.544711:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217051.544718:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5fa29b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736de expref: 66 pid: 6519 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217051.544741:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5fa29b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736de expref: 66 pid: 6519 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217051.544762:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5fa29b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736de expref: 66 pid: 6519 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217051.544778:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:0.0:1782217051.544784:0:8449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5fa2c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217051.544793:0:8449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5fa2c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217051.544802:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5fa2c5 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217051.545010:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217051.545071:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c671880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:24a87249-c61f-41a1-85ec-9a313129e739+65:2402:x1868789693122432:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 373us (1117us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217051.545080:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 99 00010000:00010000:3.0:1782217051.545300:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5fa2c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.545310:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5fa2c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217051.545915:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1782217051.545921:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782217051.545943:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5fa2c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.545976:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5fa2be lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736ec expref: 65 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.545993:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5fa2c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736ec expref: 64 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.546010:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:3.0:1782217051.546013:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782217051.546015:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2d400, rc 0) 00000100:00100000:3.0:1782217051.546058:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c672300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+64:12466:x1868789693122304:12345-192.168.203.30@tcp:101:bash.0 Request processed in 14731us (14918us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217051.546066:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 226 00000100:00100000:0.0:1782217051.549678:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217051.549910:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693122688 00000100:00100000:2.0:1782217051.549919:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693122688 00000100:00100000:2.0:1782217051.549978:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 59 00000100:00100000:2.0:1782217051.549988:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4441dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+64:12466:x1868789693122688:12345-192.168.203.30@tcp:35:bash.0 00000100:00100000:2.0:1782217051.550197:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4441dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+65:12466:x1868789693122688:12345-192.168.203.30@tcp:35:bash.0 Request processed in 209us (527us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1782217051.550204:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 59 00000100:00100000:2.0:1782217051.617538:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217051.617639:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693122816 00000100:00100000:0.0:1782217051.617659:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693122816 00000100:00100000:0.0:1782217051.617719:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 227 00000100:00100000:0.0:1782217051.617738:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+65:12472:x1868789693122816:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1782217051.617765:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217051.617785:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5fa2cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9736f3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217051.617849:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5fa2d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217051.617863:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5fa2d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217051.617874:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5fa2d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782217051.617915:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1782217051.617919:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782217051.617936:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5fa2d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217051.617959:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121da00/0x92b8e04cbf5fa2cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736f3 expref: 67 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217051.618005:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5fa2d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736f3 expref: 66 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217051.618013:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff952e6105c600) 00010000:00010000:0.0:1782217051.618016:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782217051.618020:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e4121ca00, rc 0) 00000100:00100000:0.0:1782217051.618084:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+66:12472:x1868789693122816:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 357us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217051.618092:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 227 00000100:00100000:0.0:1782217051.621378:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217051.621491:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693122944 00000100:00100000:3.0:1782217051.621499:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693122944 00000100:00100000:3.0:1782217051.621553:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 228 00000100:00100000:3.0:1782217051.621562:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4441c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+66:12472:x1868789693122944:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1782217051.621611:0:6548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217051.621640:0:6548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5fa2da lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9736fa expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.621708:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5fa2e1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.621721:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5fa2e1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.621732:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5fa2e1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.621752:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e41681e00/0x92b8e04cbf5fa2e8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.621760:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e41681e00/0x92b8e04cbf5fa2e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.621767:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e41681e00/0x92b8e04cbf5fa2e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.621827:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e41681000/0x92b8e04cbf5fa2ef lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.621836:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e41681000/0x92b8e04cbf5fa2ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.621843:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e41681000/0x92b8e04cbf5fa2ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217051.621880:0:6548:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1782217051.621884:0:6548:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782217051.621901:0:6548:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e41681000/0x92b8e04cbf5fa2ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.621919:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e41681000/0x92b8e04cbf5fa2ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.621928:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5fa2e1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.621934:0:6548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5fa2e1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.621939:0:6548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5fa2e1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.621944:0:6548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362000 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217051.621948:0:6548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5fa2e1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.621955:0:6548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5fa2e1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.621966:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff952e6105c600) 00010000:00010000:3.0:1782217051.621969:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217051.621973:0:6548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5fa2e1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.621979:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362000/0x92b8e04cbf5fa2e1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.622095:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e41681e00/0x92b8e04cbf5fa2e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.622101:0:6548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e41681e00/0x92b8e04cbf5fa2e8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.622112:0:6548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e41681e00/0x92b8e04cbf5fa2e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.622117:0:6548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e41681e00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217051.622119:0:6548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e41681e00/0x92b8e04cbf5fa2e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.622125:0:6548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e41681e00/0x92b8e04cbf5fa2e8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.622133:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff952e6105c200) 00010000:00010000:3.0:1782217051.622136:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217051.622139:0:6548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e41681e00/0x92b8e04cbf5fa2e8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.622145:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e41681e00/0x92b8e04cbf5fa2e8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.622173:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363c00/0x92b8e04cbf5fa2da lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736fa expref: 68 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.622185:0:6548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e41681000/0x92b8e04cbf5fa2ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736fa expref: 67 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.622191:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:3.0:1782217051.622193:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782217051.622195:0:6548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e41681000, rc 0) 00000100:00100000:3.0:1782217051.622402:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4441c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+67:12472:x1868789693122944:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 839us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217051.622420:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 228 00000100:00100000:1.0:1782217051.627352:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217051.627489:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693123072 00000100:00100000:2.0:1782217051.627513:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693123072 00000100:00100000:2.0:1782217051.627575:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:2.0:1782217051.627621:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c670380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24a87249-c61f-41a1-85ec-9a313129e739+67:2402:x1868789693123072:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782217051.627636:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217051.627668:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e41681000/0x92b8e04cbf5fa2ef lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736fa expref: 67 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.627687:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:2.0:1782217051.627691:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217051.627745:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c670380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24a87249-c61f-41a1-85ec-9a313129e739+66:2402:x1868789693123072:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 160us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217051.627752:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:0.0:1782217051.629314:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217051.629814:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693123328 00000100:00100000:2.0:1782217051.629823:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693123328 00000100:00100000:2.0:1782217051.629873:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 229 00000100:00100000:2.0:1782217051.629882:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4441d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+66:12472:x1868789693123328:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1782217051.629901:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217051.629918:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5fa2f6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973701 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.630032:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5fa2fd lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.630044:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5fa2c5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736ec expref: 67 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.630052:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5fa2fd lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.630100:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5fa2c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736ec expref: 67 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.630112:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5fa2c5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736ec expref: 67 pid: 6520 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217051.630125:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43e92300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1868789713094400:192.168.203.30@tcp:104: 00000100:00100000:2.0:1782217051.630226:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e52b6e900 going to sleep for 11 seconds 00000100:00100000:2.0:1782217051.632579:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43e92300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1868789713094400:192.168.203.30@tcp:104: 00010000:00010000:2.0:1782217051.632625:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5fa2fd lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217051.635553:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217051.635802:0:13731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693123456 00000100:00100000:2.0:1782217051.635811:0:13731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693123456 00010000:00010000:2.0:1782217051.635848:0:13731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5fa2c5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736ec expref: 68 pid: 6520 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217051.635920:0:13731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 100 00000100:00100000:2.0:1782217051.635931:0:13731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e6f928850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:24a87249-c61f-41a1-85ec-9a313129e739+68:2403:x1868789693123456:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782217051.635946:0:13731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217051.635954:0:13731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5fa2c5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736ec expref: 68 pid: 6520 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.635966:0:13731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5fa2c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736ec expref: 68 pid: 6520 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.636019:0:13731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5fa2c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736ec expref: 68 pid: 6520 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.636035:0:13731:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:2.0:1782217051.636040:0:13731:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5fa2fd lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.636050:0:13731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5fa2fd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.636058:0:13731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5fa2fd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.636089:0:13731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217051.636176:0:13731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e6f928850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:24a87249-c61f-41a1-85ec-9a313129e739+67:2403:x1868789693123456:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 247us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217051.636183:0:13731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 100 00010000:00010000:3.0:1782217051.636270:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5fa2fd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.636278:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5fa2fd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217051.636295:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1782217051.636404:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5fa2f6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973701 expref: 68 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.636419:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5fa2fd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973701 expref: 67 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.636426:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:3.0:1782217051.636429:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1782217051.636431:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2c200, rc 0) 00000100:00100000:3.0:1782217051.636456:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4441d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+67:12472:x1868789693123328:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 6575us (7149us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1782217051.636463:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 229 00000100:00100000:0.0:1782217051.639766:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217051.639873:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693123712 00000100:00100000:1.0:1782217051.639882:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693123712 00000100:00100000:1.0:1782217051.639947:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 18 00000100:00100000:1.0:1782217051.639957:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4441d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24a87249-c61f-41a1-85ec-9a313129e739+67:12472:x1868789693123712:12345-192.168.203.30@tcp:103:lfs.0 00010000:00010000:1.0:1782217051.640016:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782217051.640041:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363e00/0x92b8e04cbf5fa24e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736d0 expref: 67 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217051.640060:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:1.0:1782217051.640065:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782217051.640118:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4441d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24a87249-c61f-41a1-85ec-9a313129e739+66:12472:x1868789693123712:12345-192.168.203.30@tcp:103:lfs.0 Request processed in 161us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217051.640125:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 18 00010000:00010000:0.0:1782217051.641005:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782217051.641936:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217051.642009:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693123840 00000100:00100000:2.0:1782217051.642017:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693123840 00000100:00100000:2.0:1782217051.642069:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 230 00000100:00100000:2.0:1782217051.642078:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c671c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+66:12472:x1868789693123840:12345-192.168.203.30@tcp:58:lfs.0 00010000:00010000:2.0:1782217051.642192:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5fa30b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.642208:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5fa30b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217051.642220:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5fa30b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782217051.642329:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1782217051.642405:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c671c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+66:12472:x1868789693123840:12345-192.168.203.30@tcp:58:lfs.0 Request processed in 328us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217051.642413:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 230 00000100:00100000:0.0:1782217051.644291:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217051.644364:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693123968 00000100:00100000:3.0:1782217051.644373:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693123968 00000100:00100000:3.0:1782217051.644426:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 231 00000100:00100000:3.0:1782217051.644435:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4441fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+66:12472:x1868789693123968:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1782217051.644452:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217051.644475:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e41681e00/0x92b8e04cbf5fa312 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973708 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.644537:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5fa30b lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.644547:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e41681e00/0x92b8e04cbf5fa312 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973708 expref: 67 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.644563:0:6518:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5fa30b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.644572:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e41681e00/0x92b8e04cbf5fa312 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973708 expref: 67 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.644666:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:3.0:1782217051.644671:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782217051.644675:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff952e41681e00/0x92b8e04cbf5fa312 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973708 expref: 67 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217051.644683:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e41681e00, rc 0) 00000100:00100000:3.0:1782217051.644737:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4441fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+67:12472:x1868789693123968:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 302us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217051.644744:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 231 00000040:00080000:3.0:1782217052.408797:0:13796:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782217052.408808:0:13796:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782217052.408836:0:13796:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1782217052.408847:0:13796:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782217052.408966:0:13796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43316680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13796:1868789713094528:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1782217052.409154:0:13796:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e44f51480 going to sleep for 11 seconds 00000100:00100000:0.0:1782217052.426417:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217052.426517:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693124096 00000100:00100000:1.0:1782217052.426526:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693124096 00000100:00100000:1.0:1782217052.426626:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 232 00000100:00100000:1.0:1782217052.426636:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4441f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+68:12473:x1868789693124096:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1782217052.426864:0:6548:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1782217052.426974:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4441f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+68:12473:x1868789693124096:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 339us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217052.426982:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 232 00000100:00100000:3.0:1782217052.427080:0:13796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43316680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13796:1868789713094528:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1782217052.433391:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217052.433493:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693124224 00000100:00100000:2.0:1782217052.433503:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693124224 00000100:00100000:2.0:1782217052.433563:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 233 00000100:00100000:2.0:1782217052.433573:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4441ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+67:12473:x1868789693124224:12345-192.168.203.30@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1782217052.433807:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5fa319 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.433823:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5fa319 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.433834:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5fa319 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.433847:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5fa320 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.433853:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5fa320 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.433860:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5fa320 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.433881:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5fa327 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.433890:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5fa327 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.433913:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5fa327 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217052.433963:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1782217052.433968:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782217052.433980:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5fa327 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.433991:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5fa319 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.433997:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5fa319 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.434004:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5fa319 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.434009:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2d400 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782217052.434013:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5fa319 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.434021:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5fa319 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.434032:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff952e7b201600) 00010000:00010000:2.0:1782217052.434035:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217052.434040:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5fa319 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.434045:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d400/0x92b8e04cbf5fa319 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.434067:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5fa320 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.434073:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5fa320 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.434078:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5fa320 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.434083:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2d000 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782217052.434085:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5fa320 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.434090:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5fa320 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.434099:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff952d410a7f00) 00010000:00010000:2.0:1782217052.434101:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217052.434103:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5fa320 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.434110:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5fa320 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.434236:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5fa327 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.434244:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5fa327 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.434250:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5fa327 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.434262:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2ca00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782217052.434265:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5fa327 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.434272:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5fa327 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.434281:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:2.0:1782217052.434284:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217052.434287:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5fa327 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.434292:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5fa327 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217052.434369:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4441ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+67:12473:x1868789693124224:12345-192.168.203.30@tcp:34:lhsmtool_posix.0 Request processed in 797us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217052.434378:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 233 00000100:00100000:0.0:1782217052.445333:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217052.446298:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693124480 00000100:00100000:2.0:1782217052.446310:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693124480 00000100:00100000:2.0:1782217052.446370:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 234 00000100:00100000:2.0:1782217052.446380:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4441df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+67:12473:x1868789693124480:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782217052.446399:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217052.446418:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5fa32e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be97370f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.446524:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5fa335 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.446918:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5fa335 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.446932:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5fa335 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217052.446946:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1782217052.447031:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5fa335 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.447039:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5fa335 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.447046:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5fa335 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.447052:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2d000 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782217052.447056:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5fa335 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.447064:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5fa335 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.447076:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:2.0:1782217052.447080:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782217052.447085:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5fa335 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.447091:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5fa335 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.447263:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5fa32e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97370f expref: 69 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.447283:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff952e7b201600) 00010000:00010000:2.0:1782217052.447285:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782217052.447289:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5fa32e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97370f expref: 69 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.447299:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2ca00, rc 0) 00000100:00100000:2.0:1782217052.447411:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4441df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+68:12473:x1868789693124480:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 1031us (2087us total) trans 4294967507 rc 301/301 00000100:00100000:2.0:1782217052.447420:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 234 00000100:00100000:0.0:1782217052.451006:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217052.451222:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693124608 00000100:00100000:2.0:1782217052.451232:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693124608 00000100:00100000:2.0:1782217052.451322:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 235 00000100:00100000:2.0:1782217052.451332:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4441ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+68:12473:x1868789693124608:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1782217052.451367:0:6519:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1782217052.451484:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4441ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+68:12473:x1868789693124608:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 153us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217052.451492:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 235 00000100:00100000:0.0:1782217052.455115:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217052.455525:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693124864 00000100:00100000:1.0:1782217052.455536:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693124864 00000100:00100000:1.0:1782217052.455696:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 236 00000100:00100000:1.0:1782217052.455726:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4441ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+68:12473:x1868789693124864:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782217052.455748:0:6548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217052.455752:0:6548:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1782217052.455778:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5fa2d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736f3 expref: 68 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.455815:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff952e6105c600) 00010000:00010000:1.0:1782217052.455820:0:6548:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782217052.455834:0:6548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5fa343 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973716 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782217052.457335:0:6548:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:1.0:1782217052.457476:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5fa34a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.457491:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5fa34a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.457500:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5fa34a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.457552:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5fa343 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973716 expref: 70 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.457568:0:6548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5fa34a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973716 expref: 69 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.457575:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff952e6105c300) 00010000:00010000:1.0:1782217052.457578:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782217052.458052:0:6548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43073e00, rc 0) 00000100:00100000:1.0:1782217052.458112:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4441ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+69:12473:x1868789693124864:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 2405us (3003us total) trans 4294967508 rc 0/0 00000100:00100000:1.0:1782217052.458121:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 236 00000100:00100000:2.0:1782217052.461696:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217052.461904:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693125120 00000100:00100000:3.0:1782217052.461914:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693125120 00000100:00100000:0.0:1782217052.462338:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 237 00000100:00100000:0.0:1782217052.462348:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+69:12473:x1868789693125120:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1782217052.462408:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217052.462435:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5fa34a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973716 expref: 69 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.462649:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff952e6105c300) 00010000:00010000:0.0:1782217052.462662:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782217052.462681:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121dc00/0x92b8e04cbf5fa358 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.462694:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121dc00/0x92b8e04cbf5fa358 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.462861:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121dc00/0x92b8e04cbf5fa358 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.462881:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d000/0x92b8e04cbf5fa35f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xebb30b69 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.462889:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d000/0x92b8e04cbf5fa35f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xebb30b69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.462896:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d000/0x92b8e04cbf5fa35f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xebb30b69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.462941:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121dc00/0x92b8e04cbf5fa358 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.463018:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121dc00/0x92b8e04cbf5fa358 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.463026:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121dc00/0x92b8e04cbf5fa358 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.463032:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121dc00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782217052.463036:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121dc00/0x92b8e04cbf5fa358 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.463052:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121dc00/0x92b8e04cbf5fa358 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.463062:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff952e6105c600) 00010000:00010000:0.0:1782217052.463065:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217052.463068:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121dc00/0x92b8e04cbf5fa358 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.463074:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121dc00/0x92b8e04cbf5fa358 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.463083:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d000/0x92b8e04cbf5fa35f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xebb30b69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.463089:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d000/0x92b8e04cbf5fa35f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xebb30b69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.463096:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d000/0x92b8e04cbf5fa35f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xebb30b69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.463101:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121d000 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782217052.463104:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d000/0x92b8e04cbf5fa35f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xebb30b69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.463109:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d000/0x92b8e04cbf5fa35f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xebb30b69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.463116:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xebb30b69 (ffff952d427f5700) 00010000:00010000:0.0:1782217052.463118:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217052.463120:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d000/0x92b8e04cbf5fa35f lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xebb30b69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.463135:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d000/0x92b8e04cbf5fa35f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xebb30b69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217052.463352:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+68:12473:x1868789693125120:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 1003us (1663us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782217052.463360:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 237 00000100:00100000:0.0:1782217052.466026:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217052.466113:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693125248 00000100:00100000:2.0:1782217052.466122:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693125248 00000100:00100000:2.0:1782217052.466349:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 238 00000100:00100000:2.0:1782217052.466359:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4441e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+68:12473:x1868789693125248:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782217052.466378:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217052.466400:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5fa366 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be97371d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.466447:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5fa36d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.466459:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5fa36d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.466470:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5fa36d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.466569:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2cc00/0x92b8e04cbf5fa366 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97371d expref: 70 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.466618:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5fa36d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97371d expref: 69 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.466626:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff952d410a7f00) 00010000:00010000:2.0:1782217052.466628:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782217052.466631:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2c600, rc 0) 00000100:00100000:2.0:1782217052.466691:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4441e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+69:12473:x1868789693125248:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 333us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217052.466698:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 238 00000100:00100000:2.0:1782217052.470032:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217052.470175:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693125504 00000100:00100000:3.0:1782217052.470185:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693125504 00000100:00100000:3.0:1782217052.470276:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 239 00000100:00100000:3.0:1782217052.470286:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+69:12473:x1868789693125504:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1782217052.470363:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e41680e00/0x92b8e04cbf5fa374 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217052.470378:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e41680e00/0x92b8e04cbf5fa374 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217052.470389:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e41680e00/0x92b8e04cbf5fa374 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782217052.470541:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:3.0:1782217052.470551:0:6519:0:(osp_sync.c:1862:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 415453967253ns, next at 416453964225ns, rc = 0 00000004:00010000:3.0:1782217052.470624:0:6519:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000859cd18 reply state 0000000045feb544 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff952e41680e00/0x92b8e04cbf5fa374 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217052.470637:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e41680e00/0x92b8e04cbf5fa374 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217052.470655:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff952d410a7f00) 00010000:00010000:3.0:1782217052.470657:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1782217052.470661:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782217052.470877:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+71:12473:x1868789693125504:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 590us (852us total) trans 4294967509 rc 0/0 00000100:00100000:3.0:1782217052.470885:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 239 00000100:00100000:3.0:1782217052.474494:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217052.474813:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693125632 00000100:00100000:1.0:1782217052.474823:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693125632 00000100:00100000:1.0:1782217052.474878:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 240 00000100:00100000:1.0:1782217052.474888:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43316680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+71:12473:x1868789693125632:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782217052.474911:0:6548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217052.474930:0:6548:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa37b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973724 expref: -99 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.474989:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa37b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973724 expref: 72 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.475004:0:6548:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa37b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973724 expref: 72 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.475716:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff952d410a7f00) 00010000:00010000:1.0:1782217052.475720:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782217052.475724:0:6548:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43072200, rc 0) 00000100:00100000:1.0:1782217052.475785:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43316680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+72:12473:x1868789693125632:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 897us (1296us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217052.475793:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 240 00000100:00100000:2.0:1782217052.479382:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217052.479463:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693125760 00000100:00100000:0.0:1782217052.479473:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693125760 00000100:00100000:0.0:1782217052.479546:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 70 00000100:00100000:0.0:1782217052.479556:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24a87249-c61f-41a1-85ec-9a313129e739+9:2403:x1868789693125760:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1782217052.479979:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24a87249-c61f-41a1-85ec-9a313129e739+10:2403:x1868789693125760:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 Request processed in 422us (606us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1782217052.479987:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 70 00000100:00080000:1.0:1782217052.480567:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782217052.483471:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217052.483695:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693126016 00000100:00100000:0.0:1782217052.483714:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693126016 00000100:00100000:0.0:1782217052.483913:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 60 00000100:00100000:0.0:1782217052.483924:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+72:12473:x1868789693126016:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1782217052.484249:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+73:12473:x1868789693126016:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 325us (784us total) trans 4294967510 rc 0/0 00000100:00100000:0.0:1782217052.484258:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 60 00000100:00100000:2.0:1782217052.486462:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217052.486527:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693126272 00000100:00100000:0.0:1782217052.486534:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693126272 00000100:00100000:0.0:1782217052.486579:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 241 00000100:00100000:0.0:1782217052.486624:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+73:12473:x1868789693126272:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1782217052.486762:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+73:12473:x1868789693126272:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 139us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217052.486771:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 241 00000100:00100000:2.0:1782217052.488845:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217052.489104:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693126400 00000100:00100000:3.0:1782217052.489113:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693126400 00000100:00100000:3.0:1782217052.489289:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 242 00000100:00100000:3.0:1782217052.489301:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+73:12473:x1868789693126400:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782217052.489321:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217052.489341:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e41681600/0x92b8e04cbf5fa382 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be97372b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217052.489411:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e41681400/0x92b8e04cbf5fa389 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217052.489425:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e41681400/0x92b8e04cbf5fa389 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217052.489436:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e41681400/0x92b8e04cbf5fa389 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217052.489480:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782217052.489498:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e41681400/0x92b8e04cbf5fa389 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217052.489525:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e41681600/0x92b8e04cbf5fa382 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97372b expref: 75 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217052.489545:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e41681400/0x92b8e04cbf5fa389 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97372b expref: 74 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217052.489552:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff952d410a7f00) 00010000:00010000:3.0:1782217052.489555:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1782217052.489570:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e41681400, rc 0) 00000100:00100000:3.0:1782217052.490324:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+74:12473:x1868789693126400:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 1021us (1490us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217052.490332:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 242 00000100:00100000:2.0:1782217052.495035:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217052.495215:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693126528 00000100:00100000:1.0:1782217052.495225:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693126528 00000100:00100000:1.0:1782217052.495281:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 71 00000100:00100000:1.0:1782217052.495290:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:24a87249-c61f-41a1-85ec-9a313129e739+10:2402:x1868789693126528:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782217052.495308:0:14273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217052.495328:0:14273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035ba4e27/0x92b8e04cbf5fa390 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973732 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782217052.495358:0:14273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a3a795c, blocks: 0x0 00010000:00010000:1.0:1782217052.495378:0:14273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=415s v=(0 0) 00010000:00010000:1.0:1782217052.495382:0:14273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217052.495391:0:14273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035ba4e27/0x92b8e04cbf5fa390 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973732 expref: 11 pid: 14273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.495410:0:14273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000035ba4e27/0x92b8e04cbf5fa390 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973732 expref: 11 pid: 14273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.495423:0:14273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43073800, rc 0) 00000100:00100000:1.0:1782217052.495478:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:24a87249-c61f-41a1-85ec-9a313129e739+11:2402:x1868789693126528:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 188us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217052.495485:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 71 00000100:00100000:1.0:1782217052.498026:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217052.498179:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693126784 00000100:00100000:0.0:1782217052.498243:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693126784 00000100:00100000:0.0:1782217052.498332:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 243 00000100:00100000:0.0:1782217052.498342:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c672680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+74:12473:x1868789693126784:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1782217052.498448:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c672680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+74:12473:x1868789693126784:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 107us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217052.498455:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 243 00000100:00100000:2.0:1782217052.500608:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217052.500664:0:10025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693126912 00000100:00100000:0.0:1782217052.500673:0:10025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693126912 00000100:00100000:0.0:1782217052.500779:0:10025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 72 00000100:00100000:0.0:1782217052.500789:0:10025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:24a87249-c61f-41a1-85ec-9a313129e739+11:12473:x1868789693126912:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782217052.501105:0:10025:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217052.501126:0:10025:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383b62e5/0x92b8e04cbf5fa397 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973739 expref: -99 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.501156:0:10025:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000035ba4e27/0x92b8e04cbf5fa390 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973732 expref: 12 pid: 14273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.501166:0:10025:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217052.501169:0:10025:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217052.501175:0:10025:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383b62e5/0x92b8e04cbf5fa397 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973739 expref: 12 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.501232:0:10025:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000035ba4e27/0x92b8e04cbf5fa390 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973732 expref: 12 pid: 14273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.501246:0:10025:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000035ba4e27/0x92b8e04cbf5fa390 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973732 expref: 12 pid: 14273 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217052.501260:0:10025:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c673480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10025:1868789713094656:192.168.203.30@tcp:104: 00000100:00100000:1.0:1782217052.501356:0:10025:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e42c59900 going to sleep for 11 seconds 00000100:00100000:2.0:1782217052.508502:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217052.509025:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693127040 00000100:00100000:3.0:1782217052.509034:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693127040 00010000:00010000:3.0:1782217052.509074:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000035ba4e27/0x92b8e04cbf5fa390 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973732 expref: 13 pid: 14273 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217052.509112:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 101 00000100:00100000:3.0:1782217052.509122:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24a87249-c61f-41a1-85ec-9a313129e739+13:2403:x1868789693127040:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782217052.509136:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217052.509211:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000035ba4e27/0x92b8e04cbf5fa390 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973732 expref: 13 pid: 14273 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217052.509228:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000035ba4e27/0x92b8e04cbf5fa390 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973732 expref: 13 pid: 14273 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217052.509254:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217052.509258:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217052.509268:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383b62e5/0x92b8e04cbf5fa397 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973739 expref: 13 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217052.509279:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383b62e5/0x92b8e04cbf5fa397 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973739 expref: 13 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217052.509317:0:6504:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000383b62e5/0x92b8e04cbf5fa397 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973739 expref: 13 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217052.509346:0:6504:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43314000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6504:1868789713094784:192.168.203.30@tcp:105: 00000100:00100000:3.0:1782217052.509418:0:6504:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e44f51a80 going to sleep for 11 seconds 00010000:00010000:1.0:1782217052.510080:0:10025:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035ba4e27/0x92b8e04cbf5fa390 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973732 expref: 13 pid: 14273 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217052.510097:0:10025:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c673480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10025:1868789713094656:192.168.203.30@tcp:104: 00010000:00010000:1.0:1782217052.510124:0:10025:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383b62e5/0x92b8e04cbf5fa397 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973739 expref: 12 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.510135:0:10025:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43073a00, rc 0) 00000100:00100000:1.0:1782217052.510235:0:10025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:24a87249-c61f-41a1-85ec-9a313129e739+12:12473:x1868789693126912:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 9446us (9632us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217052.510243:0:10025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 72 00000100:00100000:3.0:1782217052.513006:0:6504:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43314000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6504:1868789713094784:192.168.203.30@tcp:105: 00010000:00010000:3.0:1782217052.513030:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217052.513081:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24a87249-c61f-41a1-85ec-9a313129e739+11:2403:x1868789693127040:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 3959us (4587us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217052.513092:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 101 00000100:00100000:2.0:1782217052.516035:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217052.517884:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693127168 00000100:00100000:1.0:1782217052.517898:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693127168 00002000:00100000:1.0:1782217052.517952:0:8439:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff952d43e90380 x1868789693127168/t0(0) o4->24a87249-c61f-41a1-85ec-9a313129e739@192.168.203.30@tcp:303/0 lens 504/0 e 0 to 0 dl 1782217063 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782217052.517981:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff952d43e90380 with x1868789693127168 ext(0->12) 00002000:00010000:1.0:1782217052.517987:0:8439:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff952d43e90380 00000100:00100000:1.0:1782217052.518015:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6 00000100:00100000:1.0:1782217052.518025:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:24a87249-c61f-41a1-85ec-9a313129e739+11:2403:x1868789693127168:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1782217052.519562:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:24a87249-c61f-41a1-85ec-9a313129e739+13:2403:x1868789693127168:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 Request processed in 1531us (3527us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1782217052.519575:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6 00002000:00100000:1.0:1782217052.519622:0:8439:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff952d43e90380 x1868789693127168/t4294967321(0) o4->24a87249-c61f-41a1-85ec-9a313129e739@192.168.203.30@tcp:303/0 lens 504/448 e 0 to 0 dl 1782217063 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782217052.519632:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff952d43e90380 with x1868789693127168 ext(0->12) 00002000:00010000:1.0:1782217052.519637:0:8439:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff952d43e90380 00000100:00100000:2.0:1782217052.521990:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217052.522069:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693127296 00000100:00100000:3.0:1782217052.522078:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693127296 00000100:00100000:3.0:1782217052.522138:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 244 00000100:00100000:3.0:1782217052.522157:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+74:12473:x1868789693127296:12345-192.168.203.30@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1782217052.523908:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967510 is committed 00000004:00080000:3.0:1782217052.523924:0:6498:0:(osp_sync.c:1827:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000004:00080000:3.0:1782217052.523960:0:6498:0:(osp_sync.c:1827:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:3.0:1782217052.523984:0:6498:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff952d426cc6c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1782217052.523990:0:6498:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff952d43f2ad00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff952e583f16c0 00000020:00080000:3.0:1782217052.523993:0:6498:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff952d43f2ac00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff952d444b4800 00000020:00080000:3.0:1782217052.524033:0:6498:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff952d426cc600 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1782217052.524036:0:6498:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff952e6f882500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff952d43721d80 00000020:00080000:3.0:1782217052.524039:0:6498:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff952e6f882f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff952d43cc9800 00000020:00080000:3.0:1782217052.524048:0:6498:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:3.0:1782217052.524173:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+27:12473:x1868789693127296:12345-192.168.203.30@tcp:44:lhsmtool_posix.0 Request processed in 2022us (2187us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217052.524196:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 244 00000100:00100000:2.0:1782217052.524408:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782217052.524423:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43cb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713094912:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782217052.524471:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217052.524512:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713094912 00000100:00100000:2.0:1782217052.524518:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713094912 00000100:00100000:2.0:1782217052.524557:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1782217052.524565:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3648:x1868789713094912:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1782217052.524616:0:8434:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:2.0:1782217052.524657:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a3a795b, atime: 0x6a3a795b, ctime: 0x6a3a795b, blocks: 0x8 00010000:00010000:2.0:1782217052.524665:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebd05488/0x92b8e04cbf5fa39e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.524681:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=415s v=(0 0) 00010000:00010000:2.0:1782217052.524685:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782217052.524692:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebd05488/0x92b8e04cbf5fa39e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.524706:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ebd05488/0x92b8e04cbf5fa39e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.524785:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebd05488/0x92b8e04cbf5fa39e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.524810:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ebd05488/0x92b8e04cbf5fa39e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.524829:0:8434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782217052.524953:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3648:x1868789713094912:12345-0@lo:6:osp-syn-1-0.0 Request processed in 389us (481us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1782217052.524960:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00010000:2.0:1782217052.524978:0:10336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782217052.524984:0:10336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ebd05488/0x92b8e04cbf5fa39e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.524993:0:10336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2d800 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:2.0:1782217052.524996:0:10336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebd05488/0x92b8e04cbf5fa39e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.525005:0:10336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebd05488/0x92b8e04cbf5fa39e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.525021:0:10336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ebd05488/0x92b8e04cbf5fa39e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.525029:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ebd05488/0x92b8e04cbf5fa39e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.525048:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217052.525056:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217052.525057:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782217052.525085:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff952d43cb3b80/2, rc 0, transno 4294967311 00000100:00100000:2.0:1782217052.525091:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43cb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713094912:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782217052.525395:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c671500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713095168:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1782217052.525426:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217052.525462:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c673480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713095040:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782217052.525483:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217052.525510:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713095168 00000100:00100000:1.0:1782217052.525514:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713095168 00000100:00100000:1.0:1782217052.525544:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713095040 00000100:00100000:1.0:1782217052.525548:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713095040 00000100:00100000:1.0:1782217052.525568:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1782217052.525574:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c672a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3649:x1868789713095168:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1782217052.525684:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1782217052.525688:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1782217052 00002000:00010000:1.0:1782217052.525697:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1782217052.525699:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1782217052 -> 1782217052 00002000:00010000:1.0:1782217052.525701:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1782217052.525795:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c672a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3649:x1868789713095168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 220us (367us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1782217052.525802:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1782217052.525968:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1782217052.525974:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c670e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3648:x1868789713095040:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782217052.525987:0:8432:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:1.0:1782217052.525999:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035ba4e27/0x92b8e04cbf5fa3a5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.526014:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005da6ed1a/0x92b8e04cbf5fa152 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973691 expref: 12 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.526021:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1782217052.526024:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782217052.526029:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035ba4e27/0x92b8e04cbf5fa3a5 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.526053:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005da6ed1a/0x92b8e04cbf5fa152 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973691 expref: 12 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.526066:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005da6ed1a/0x92b8e04cbf5fa152 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973691 expref: 12 pid: 8434 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217052.526077:0:8432:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c672d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8432:1868789713095296:192.168.203.30@tcp:104: 00000100:00100000:1.0:1782217052.526130:0:8432:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e42c59900 going to sleep for 11 seconds 00000100:00080000:1.0:1782217052.526143:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1782217052.526164:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff952e7c671500/2, rc 0, transno 4294967322 00000100:00100000:1.0:1782217052.526169:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c671500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713095168:0@lo:2:osp-syn-0-0.0 00000020:00080000:1.0:1782217052.526204:0:6551:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1782217052.526240:0:6551:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1782217052.530542:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217052.530621:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217052.530657:0:13731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693127552 00000100:00100000:2.0:1782217052.530665:0:13731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693127552 00010000:00010000:2.0:1782217052.530705:0:13731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005da6ed1a/0x92b8e04cbf5fa152 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973691 expref: 13 pid: 8434 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217052.530754:0:13731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 102 00000100:00100000:2.0:1782217052.530764:0:13731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:24a87249-c61f-41a1-85ec-9a313129e739+13:2402:x1868789693127552:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782217052.530780:0:13731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217052.530786:0:13731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005da6ed1a/0x92b8e04cbf5fa152 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973691 expref: 13 pid: 8434 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.530800:0:13731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005da6ed1a/0x92b8e04cbf5fa152 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973691 expref: 13 pid: 8434 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.530824:0:13731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782217052.530828:0:13731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782217052.530834:0:13731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000035ba4e27/0x92b8e04cbf5fa3a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.530844:0:13731:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035ba4e27/0x92b8e04cbf5fa3a5 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.530883:0:13731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217052.530930:0:13731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:24a87249-c61f-41a1-85ec-9a313129e739+13:2402:x1868789693127552:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 167us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217052.530937:0:13731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 102 00000100:00100000:3.0:1782217052.531079:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693127424 00000100:00100000:3.0:1782217052.531085:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693127424 00000100:00100000:3.0:1782217052.531121:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 76 00000100:00100000:3.0:1782217052.531129:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:24a87249-c61f-41a1-85ec-9a313129e739+13:2402:x1868789693127424:12345-192.168.203.30@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1782217052.531930:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005da6ed1a/0x92b8e04cbf5fa152 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973691 expref: 13 pid: 8434 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217052.531948:0:8432:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c672d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8432:1868789713095296:192.168.203.30@tcp:104: 00010000:00010000:1.0:1782217052.531968:0:8432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000035ba4e27/0x92b8e04cbf5fa3a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.531977:0:8432:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000035ba4e27/0x92b8e04cbf5fa3a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.531983:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035ba4e27/0x92b8e04cbf5fa3a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.531992:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035ba4e27/0x92b8e04cbf5fa3a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.531998:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035ba4e27/0x92b8e04cbf5fa3a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.532013:0:8432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782217052.532948:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c400/0x92b8e04cbf5fa09c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.532961:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c400/0x92b8e04cbf5fa09c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.532966:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c400/0x92b8e04cbf5fa09c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.532971:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121c400 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782217052.532975:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c400/0x92b8e04cbf5fa09c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.532982:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c400/0x92b8e04cbf5fa09c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.533008:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff952d410a7b00) 00010000:00010000:0.0:1782217052.533011:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217052.533016:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c400/0x92b8e04cbf5fa09c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.533022:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c400/0x92b8e04cbf5fa09c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.533059:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5fa144 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.533065:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5fa144 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.533070:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5fa144 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.533074:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2c400 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782217052.533077:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5fa144 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.533083:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5fa144 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.533090:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff952e46d74200) 00010000:00010000:0.0:1782217052.533092:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217052.533095:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5fa144 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.533100:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5fa144 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.533126:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5fa1c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.533132:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5fa1c2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.533139:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5fa1c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.533152:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43073000 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782217052.533155:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5fa1c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.533160:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5fa1c2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.533168:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff952e6105c200) 00010000:00010000:0.0:1782217052.533170:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217052.533173:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5fa1c2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.533178:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5fa1c2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.533190:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5fa1e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.533196:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5fa1e5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.533202:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5fa1e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.533222:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362a00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782217052.533225:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5fa1e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.533231:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5fa1e5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.533239:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff952e6105c200) 00010000:00010000:0.0:1782217052.533241:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217052.533244:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5fa1e5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.533250:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362a00/0x92b8e04cbf5fa1e5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.533268:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa2b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.533275:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa2b7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.533281:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa2b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.533285:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362e00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782217052.533288:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa2b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.533293:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa2b7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.533312:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:0.0:1782217052.533314:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217052.533317:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa2b7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.533323:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fa2b7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.533337:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff952e41680e00/0x92b8e04cbf5fa374 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.533342:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e41680e00/0x92b8e04cbf5fa374 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.533348:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e41680e00/0x92b8e04cbf5fa374 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.533353:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e41680e00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782217052.533355:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e41680e00/0x92b8e04cbf5fa374 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.533361:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e41680e00/0x92b8e04cbf5fa374 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.533369:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff952d410a7f00) 00010000:00010000:0.0:1782217052.533371:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782217052.533374:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e41680e00/0x92b8e04cbf5fa374 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.533379:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e41680e00/0x92b8e04cbf5fa374 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.533781:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782217052.533789:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035ba4e27/0x92b8e04cbf5fa3a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.533798:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43073800 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:2.0:1782217052.533801:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035ba4e27/0x92b8e04cbf5fa3a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.533808:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035ba4e27/0x92b8e04cbf5fa3a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.533821:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035ba4e27/0x92b8e04cbf5fa3a5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.533828:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035ba4e27/0x92b8e04cbf5fa3a5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.533843:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217052.533845:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217052.533846:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782217052.534059:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c670e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3648:x1868789713095040:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8081us (8571us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1782217052.534069:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000004:00080000:2.0:1782217052.534390:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff952e7c673480/2, rc 0, transno 4294967323 00000100:00100000:2.0:1782217052.534397:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c673480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713095040:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1782217052.535364:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:3.0:1782217052.535374:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:2.0:1782217052.535848:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:24a87249-c61f-41a1-85ec-9a313129e739+7:2402:x1868789693127424:12345-192.168.203.30@tcp:16:lhsmtool_posix.0 Request processed in 4715us (5312us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217052.535858:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 76 00000100:00100000:2.0:1782217052.538769:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217052.538956:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693127808 00000100:00100000:1.0:1782217052.538966:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693127808 00000100:00100000:1.0:1782217052.539033:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 245 00000100:00100000:1.0:1782217052.539043:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+21:12473:x1868789693127808:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1782217052.539099:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782217052.539126:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e41681400/0x92b8e04cbf5fa389 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97372b expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.539153:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff952d410a7f00) 00010000:00010000:1.0:1782217052.539159:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782217052.539194:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5fa3ac lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.539208:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5fa3ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.539218:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5fa3ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782217052.539322:0:6519:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000172807f6 reply state 00000000aa9743ce transno 4294967511 ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5fa3ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.539334:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5fa3ac lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.539340:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff952d410a7f00) 00010000:00010000:1.0:1782217052.539342:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782217052.539358:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782217052.539451:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+22:12473:x1868789693127808:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 408us (689us total) trans 4294967511 rc 0/0 00000100:00100000:1.0:1782217052.539457:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 245 00000100:00100000:0.0:1782217052.542103:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217052.542327:0:10025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693127936 00000100:00100000:1.0:1782217052.542337:0:10025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693127936 00000100:00100000:1.0:1782217052.542384:0:10025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 77 00000100:00100000:1.0:1782217052.542393:0:10025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4441d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:24a87249-c61f-41a1-85ec-9a313129e739+7:2402:x1868789693127936:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1782217052.542531:0:10025:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1782217052.542535:0:10025:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1782217052 -> 1782217051 00002000:00010000:1.0:1782217052.542537:0:10025:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1782217051 00002000:00010000:1.0:1782217052.542540:0:10025:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1782217052 -> 1782217051 00002000:00010000:1.0:1782217052.542541:0:10025:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1782217052.542619:0:10025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4441d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:24a87249-c61f-41a1-85ec-9a313129e739+8:2402:x1868789693127936:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 Request processed in 226us (523us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1782217052.542626:0:10025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 77 00000100:00100000:2.0:1782217052.549819:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217052.549962:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693128192 00000100:00100000:1.0:1782217052.549972:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693128192 00000100:00100000:1.0:1782217052.550033:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 246 00000100:00100000:1.0:1782217052.550042:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+22:12473:x1868789693128192:12345-192.168.203.30@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1782217052.550109:0:6548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5fa3b3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.550124:0:6548:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5fa36d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97371d expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.550133:0:6548:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5fa3b3 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.550188:0:6548:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5fa36d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97371d expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.550201:0:6548:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5fa36d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97371d expref: 22 pid: 6520 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217052.550214:0:6548:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c672d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6548:1868789713095424:192.168.203.30@tcp:104: 00000100:00100000:1.0:1782217052.550295:0:6548:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e42c59540 going to sleep for 11 seconds 00000100:00100000:2.0:1782217052.553415:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217052.553506:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693128320 00000100:00100000:0.0:1782217052.553515:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693128320 00010000:00010000:0.0:1782217052.553553:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5fa36d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97371d expref: 23 pid: 6520 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217052.553629:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 103 00000100:00100000:0.0:1782217052.553649:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24a87249-c61f-41a1-85ec-9a313129e739+23:2402:x1868789693128320:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782217052.553665:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217052.553672:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5fa36d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97371d expref: 23 pid: 6520 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.553684:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5fa36d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97371d expref: 23 pid: 6520 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.553707:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff952d410a7f00) 00010000:00010000:0.0:1782217052.553713:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5fa3b3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.553735:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5fa3b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.553744:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5fa3b3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.553762:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217052.553810:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24a87249-c61f-41a1-85ec-9a313129e739+23:2402:x1868789693128320:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 171us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217052.553833:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 103 00010000:00010000:1.0:1782217052.553935:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c600/0x92b8e04cbf5fa36d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97371d expref: 22 pid: 6520 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217052.553953:0:6548:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c672d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6548:1868789713095424:192.168.203.30@tcp:104: 00010000:00010000:1.0:1782217052.553972:0:6548:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5fa3b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.553981:0:6548:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5fa3b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.553987:0:6548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5fa3b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.554025:0:6548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5fa3b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.554032:0:6548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5fa3b3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.554039:0:6548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5fa3b3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.554053:0:6548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43073800 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217052.554058:0:6548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5fa3b3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.554065:0:6548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5fa3b3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.554075:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff952d410a7f00) 00010000:00010000:1.0:1782217052.554078:0:6548:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1782217052.554082:0:6548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5fa3b3 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.554087:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5fa3b3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6548 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217052.554129:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+21:12473:x1868789693128192:12345-192.168.203.30@tcp:55:lhsmtool_posix.0 Request processed in 4088us (4319us total) trans 0 rc -22/-22 00000100:00100000:1.0:1782217052.554138:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 246 00000100:00100000:0.0:1782217052.558048:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217052.558164:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693128448 00000100:00100000:2.0:1782217052.558174:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693128448 00000100:00100000:2.0:1782217052.558231:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 78 00000100:00100000:2.0:1782217052.558241:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4441c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:24a87249-c61f-41a1-85ec-9a313129e739+8:2402:x1868789693128448:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1782217052.558284:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000078fbfed6/0x92b8e04cbf5fa3ba lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.558304:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383b62e5/0x92b8e04cbf5fa397 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973739 expref: 8 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.558313:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782217052.558317:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782217052.558321:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078fbfed6/0x92b8e04cbf5fa3ba lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.558354:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000383b62e5/0x92b8e04cbf5fa397 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973739 expref: 8 pid: 10025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.558367:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000383b62e5/0x92b8e04cbf5fa397 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973739 expref: 8 pid: 10025 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217052.558402:0:8434:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43cb3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8434:1868789713095552:192.168.203.30@tcp:104: 00000100:00100000:2.0:1782217052.558563:0:8434:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e52b6ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782217052.563146:0:8434:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43cb3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8434:1868789713095552:192.168.203.30@tcp:104: 00010000:00010000:1.0:1782217052.563176:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000078fbfed6/0x92b8e04cbf5fa3ba lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217052.565129:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217052.565682:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693128576 00000100:00100000:3.0:1782217052.565693:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693128576 00010000:00010000:3.0:1782217052.565801:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000383b62e5/0x92b8e04cbf5fa397 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973739 expref: 9 pid: 10025 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217052.565849:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 104 00000100:00100000:3.0:1782217052.565859:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4441f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24a87249-c61f-41a1-85ec-9a313129e739+9:2403:x1868789693128576:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782217052.565874:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217052.565895:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000383b62e5/0x92b8e04cbf5fa397 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973739 expref: 9 pid: 10025 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217052.565911:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000383b62e5/0x92b8e04cbf5fa397 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973739 expref: 9 pid: 10025 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217052.566046:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383b62e5/0x92b8e04cbf5fa397 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973739 expref: 9 pid: 10025 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217052.566063:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782217052.566079:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782217052.566086:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000078fbfed6/0x92b8e04cbf5fa3ba lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217052.566095:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078fbfed6/0x92b8e04cbf5fa3ba lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217052.566132:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782217052.566235:0:8434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000078fbfed6/0x92b8e04cbf5fa3ba lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.566247:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078fbfed6/0x92b8e04cbf5fa3ba lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.566279:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000078fbfed6/0x92b8e04cbf5fa3ba lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.566288:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078fbfed6/0x92b8e04cbf5fa3ba lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.566296:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078fbfed6/0x92b8e04cbf5fa3ba lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.566303:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2c000 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:1.0:1782217052.566307:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078fbfed6/0x92b8e04cbf5fa3ba lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.566317:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078fbfed6/0x92b8e04cbf5fa3ba lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.566331:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078fbfed6/0x92b8e04cbf5fa3ba lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.566339:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078fbfed6/0x92b8e04cbf5fa3ba lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217052.566395:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4441f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24a87249-c61f-41a1-85ec-9a313129e739+8:2403:x1868789693128576:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 536us (1273us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217052.566399:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4441c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:24a87249-c61f-41a1-85ec-9a313129e739+8:2402:x1868789693128448:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 Request processed in 8158us (8358us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217052.566408:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 104 00000100:00100000:1.0:1782217052.566413:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 78 00000100:00100000:2.0:1782217052.570073:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217052.570324:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693128832 00000100:00100000:1.0:1782217052.570335:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693128832 00000100:00100000:0.0:1782217052.570485:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 247 00000100:00100000:0.0:1782217052.570498:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+21:12473:x1868789693128832:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1782217052.572904:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5fa3c1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.572929:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa2b0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736e5 expref: 21 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.572940:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5fa3c1 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.572976:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa2b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736e5 expref: 21 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.572992:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa2b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736e5 expref: 21 pid: 6548 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217052.573007:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1868789713095680:192.168.203.30@tcp:104: 00000100:00100000:0.0:1782217052.573150:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d426cc180 going to sleep for 11 seconds 00000100:00100000:0.0:1782217052.578218:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217052.578534:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693128960 00000100:00100000:3.0:1782217052.578543:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693128960 00010000:00010000:3.0:1782217052.578598:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa2b0 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736e5 expref: 22 pid: 6548 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217052.578648:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 105 00000100:00100000:3.0:1782217052.578658:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4441e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24a87249-c61f-41a1-85ec-9a313129e739+22:2402:x1868789693128960:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782217052.578673:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217052.578679:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa2b0 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736e5 expref: 22 pid: 6548 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217052.578691:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa2b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736e5 expref: 22 pid: 6548 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217052.578713:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:3.0:1782217052.578726:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff952e41681e00/0x92b8e04cbf5fa312 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973708 expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217052.578748:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5fa3c1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217052.578756:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5fa3c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217052.578763:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5fa3c1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217052.578782:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217052.578828:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4441e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24a87249-c61f-41a1-85ec-9a313129e739+22:2402:x1868789693128960:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 171us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217052.578836:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 105 00010000:00010000:2.0:1782217052.579274:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362400/0x92b8e04cbf5fa2b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9736e5 expref: 21 pid: 6548 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217052.579291:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1868789713095680:192.168.203.30@tcp:104: 00010000:00010000:2.0:1782217052.579310:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5fa3c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.579319:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5fa3c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.579325:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5fa3c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.579487:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5fa3c8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.579499:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa37b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973724 expref: 21 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.579507:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5fa3c8 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.579637:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa37b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973724 expref: 21 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217052.579675:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa37b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973724 expref: 21 pid: 6548 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217052.579688:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43cb1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1868789713095808:192.168.203.30@tcp:104: 00000100:00100000:2.0:1782217052.579803:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d437876c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782217052.581987:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217052.582531:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693129088 00000100:00100000:3.0:1782217052.582541:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693129088 00010000:00010000:3.0:1782217052.582579:0:8449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa37b lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973724 expref: 22 pid: 6548 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217052.582661:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 106 00000100:00100000:3.0:1782217052.582672:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e6f92a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:24a87249-c61f-41a1-85ec-9a313129e739+22:2403:x1868789693129088:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782217052.582685:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217052.582692:0:8449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa37b lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973724 expref: 22 pid: 6548 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217052.582704:0:8449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa37b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973724 expref: 22 pid: 6548 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217052.582750:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff952d410a7f00) 00010000:00010000:3.0:1782217052.582755:0:8449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5fa3c8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217052.582763:0:8449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5fa3c8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217052.582770:0:8449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5fa3c8 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217052.582788:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217052.582838:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e6f92a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:24a87249-c61f-41a1-85ec-9a313129e739+22:2403:x1868789693129088:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 168us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217052.582846:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 106 00010000:00010000:0.0:1782217052.584062:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa37b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973724 expref: 21 pid: 6548 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217052.584085:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43cb1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1868789713095808:192.168.203.30@tcp:104: 00010000:00010000:0.0:1782217052.584118:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5fa3c8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.584128:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5fa3c8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217052.584134:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5fa3c8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782217052.584306:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000001:00080000:0.0:1782217052.584423:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000001:00080000:0.0:1782217052.584460:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00000100:00100000:0.0:1782217052.584681:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6518:1868789713095936:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1782217052.584813:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217052.584888:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e52b6ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782217052.584934:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713095936 00000100:00100000:2.0:1782217052.584940:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713095936 00000100:00100000:2.0:1782217052.585021:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1782217052.585030:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e50234850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6518:x1868789713095936:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1782217052.585117:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e50234850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6518:x1868789713095936:12345-0@lo:1000:mdt00_000.0 Request processed in 88us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217052.585125:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1782217052.585256:0:6518:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:1.0:1782217052.585262:0:6518:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:1.0:1782217052.585274:0:6518:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff952e7c671500, transno 4294967322 00000100:00100000:1.0:1782217052.585294:0:6518:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff952e7c673480 x1868789713095040/t4294967323(4294967323) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1782217068 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782217052.585304:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6518:1868789713095936:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1782217052.585400:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00000100:00100000:1.0:1782217052.585438:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c672d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6518:1868789713096064:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1782217052.585525:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217052.586342:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e42c590c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782217052.586471:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713096064 00000100:00100000:2.0:1782217052.586477:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713096064 00000100:00100000:0.0:1782217052.586534:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1782217052.586544:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c670000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6518:x1868789713096064:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1782217052.586710:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c670000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6518:x1868789713096064:12345-0@lo:1000:mdt00_000.0 Request processed in 167us (1184us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1782217052.586727:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1782217052.586928:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c672d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6518:1868789713096064:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1782217052.586970:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5fa3c8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.586980:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5fa3c8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.586987:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5fa3c8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.586993:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2c400 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217052.586997:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5fa3c8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.587003:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5fa3c8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.587018:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff952d410a7f00) 00010000:00010000:1.0:1782217052.587034:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782217052.587040:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5fa3c8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.587046:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c400/0x92b8e04cbf5fa3c8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.587071:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5fa30b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.587077:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5fa30b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.587083:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5fa30b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.587088:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2c800 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217052.587092:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5fa30b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.587097:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5fa30b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.587105:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:1.0:1782217052.587107:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782217052.587113:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff952e41681e00/0x92b8e04cbf5fa312 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973708 expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.587125:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e41681e00/0x92b8e04cbf5fa312 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973708 expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.587133:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e41681e00/0x92b8e04cbf5fa312 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973708 expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.587244:0:6518:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff952e41681e00/0x92b8e04cbf5fa312 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973708 expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217052.587257:0:6518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c670a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1868789713096192:192.168.203.30@tcp:105: 00000100:00100000:1.0:1782217052.587383:0:6518:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e42c590c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782217052.595445:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217052.595553:0:6518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c670a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1868789713096192:192.168.203.30@tcp:105: 00010000:00010000:1.0:1782217052.595607:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5fa30b lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.595618:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c800/0x92b8e04cbf5fa30b lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.595668:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5fa3cf lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.595682:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5fa3cf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.595694:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5fa3cf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.595704:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5fa3cf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.595711:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5fa3cf lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.595722:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5fa3cf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.595747:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43073000 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217052.595751:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5fa3cf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.595758:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5fa3cf lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.595771:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:1.0:1782217052.595774:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217052.595778:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5fa3cf lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.595783:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5fa3cf lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.595794:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5fa3c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.595799:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5fa3c1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.595805:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5fa3c1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.595810:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121d600 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217052.595812:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5fa3c1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.595817:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5fa3c1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.595835:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:1.0:1782217052.595837:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782217052.595840:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5fa3c1 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.595846:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5fa3c1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217052.595993:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+24:12473:x1868789693128832:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 25496us (25929us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1782217052.596004:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 247 00000020:00080000:1.0:1782217052.596009:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1782217052.596661:0:13796:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782217052.596666:0:13796:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782217052.597174:0:13796:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1782217052.597183:0:13796:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782217052.599374:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217052.599964:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693129216 00000100:00100000:0.0:1782217052.599975:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693129216 00000100:00100000:1.0:1782217052.600056:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693129472 00000100:00100000:1.0:1782217052.600060:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693129472 00000100:00100000:1.0:1782217052.600086:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 61 00000100:00100000:1.0:1782217052.600095:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+25:12472:x1868789693129216:12345-192.168.203.30@tcp:49:lfs.0 00000100:00100000:1.0:1782217052.600373:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+25:12472:x1868789693129216:12345-192.168.203.30@tcp:49:lfs.0 Request processed in 277us (4936us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217052.600381:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 61 00000100:00100000:1.0:1782217052.600399:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 62 00000100:00100000:1.0:1782217052.600405:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e50126450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+24:12473:x1868789693129472:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1782217052.600858:0:6521:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1782217052.600890:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967517 00010000:00010000:1.0:1782217052.600923:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fa3d6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.600938:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fa3d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.600963:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fa3d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.600972:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fa3d6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.600979:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fa3d6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.600984:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fa3d6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.600996:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782217052.601044:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e50126450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+26:12473:x1868789693129472:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 638us (1679us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1782217052.601051:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 62 00000020:00080000:1.0:1782217052.601055:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782217052.601129:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782217052.601135:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fa3d6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217052.601150:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43073400 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:3.0:1782217052.601154:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fa3d6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217052.601162:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fa3d6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217052.601184:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff952d410a7f00) 00010000:00010000:3.0:1782217052.601187:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782217052.601191:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fa3d6 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217052.601196:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fa3d6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217052.601217:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217052.601219:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217052.601221:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782217052.604066:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217052.604138:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693129728 00000100:00100000:0.0:1782217052.604348:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693129728 00000100:00100000:0.0:1782217052.604448:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 248 00000100:00100000:0.0:1782217052.604459:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+26:12472:x1868789693129728:12345-192.168.203.30@tcp:58:lfs.0 00000040:00080000:0.0:1782217052.604670:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1782217052.604754:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+26:12472:x1868789693129728:12345-192.168.203.30@tcp:58:lfs.0 Request processed in 297us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217052.604776:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 248 00000100:00100000:2.0:1782217052.641831:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217052.641946:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693129856 00000100:00100000:1.0:1782217052.641957:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693129856 00000100:00100000:1.0:1782217052.642017:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 249 00000100:00100000:1.0:1782217052.642027:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+26:12475:x1868789693129856:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1782217052.642046:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217052.642065:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5fa3dd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973740 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.642129:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5fa3e4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.642143:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5fa3e4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.642169:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5fa3e4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.642185:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fa3eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.642192:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fa3eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.642198:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fa3eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.642287:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa3f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.642298:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5fa2fd lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973701 expref: 27 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.642306:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa3f2 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.642339:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5fa2fd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973701 expref: 27 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.642351:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5fa2fd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973701 expref: 27 pid: 6519 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217052.642365:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c670a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1868789713096320:192.168.203.30@tcp:104: 00000100:00100000:1.0:1782217052.642462:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e42c59240 going to sleep for 11 seconds 00000100:00100000:1.0:1782217052.646773:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c670a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1868789713096320:192.168.203.30@tcp:104: 00010000:00010000:1.0:1782217052.646808:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa3f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217052.649571:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217052.649698:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693130112 00000100:00100000:0.0:1782217052.649708:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693130112 00000100:00100000:0.0:1782217052.649766:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 63 00000100:00100000:0.0:1782217052.649776:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24a87249-c61f-41a1-85ec-9a313129e739+28:6171:x1868789693130112:12345-192.168.203.30@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1782217052.649995:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24a87249-c61f-41a1-85ec-9a313129e739+29:6171:x1868789693130112:12345-192.168.203.30@tcp:35:ldlm_bl.0 Request processed in 220us (431us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1782217052.650004:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 63 00000100:00100000:2.0:1782217052.653905:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217052.654456:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693130240 00000100:00100000:3.0:1782217052.654467:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693130240 00010000:00010000:3.0:1782217052.654507:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5fa2fd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973701 expref: 29 pid: 6519 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217052.654552:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 107 00000100:00100000:3.0:1782217052.654561:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24a87249-c61f-41a1-85ec-9a313129e739+29:2402:x1868789693130240:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782217052.654574:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217052.654628:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5fa2fd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973701 expref: 29 pid: 6519 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217052.654652:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5fa2fd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973701 expref: 29 pid: 6519 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217052.654674:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c200/0x92b8e04cbf5fa2fd lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973701 expref: 29 pid: 6519 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217052.654709:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:3.0:1782217052.654724:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa3f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217052.654734:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa3f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217052.654741:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa3f2 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217052.654773:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217052.654825:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24a87249-c61f-41a1-85ec-9a313129e739+28:2402:x1868789693130240:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 265us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217052.654834:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 107 00010000:00010000:1.0:1782217052.655350:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa3f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.655360:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa3f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782217052.655426:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1782217052.655430:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782217052.655450:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa3f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.655463:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa3f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.655472:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5fa3e4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.655480:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5fa3e4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.655487:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5fa3e4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.655492:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43072e00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217052.655495:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5fa3e4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.655502:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5fa3e4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.655524:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff952e6105c600) 00010000:00010000:1.0:1782217052.655527:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217052.655531:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5fa3e4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.655537:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072e00/0x92b8e04cbf5fa3e4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.655549:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fa3eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.655555:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fa3eb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.655560:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fa3eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.655564:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43073400 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217052.655567:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fa3eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.655572:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fa3eb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.655578:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff952e6105c900) 00010000:00010000:1.0:1782217052.655580:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217052.655633:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fa3eb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.655649:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fa3eb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.655694:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073000/0x92b8e04cbf5fa3dd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973740 expref: 28 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.655709:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa3f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973740 expref: 27 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217052.655727:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:1.0:1782217052.655730:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782217052.655732:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43072200, rc 0) 00000100:00100000:1.0:1782217052.655766:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+27:12475:x1868789693129856:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 13740us (13944us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217052.655773:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 249 00010000:00010000:0.0:1782217052.667876:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782217053.117884:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217053.117930:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217053.117951:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217053.117969:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217053.117991:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217053.118015:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693130880 00000100:00100000:3.0:1782217053.118024:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693130880 00000100:00100000:3.0:1782217053.118082:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693130496 00000100:00100000:3.0:1782217053.118086:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693130496 00000100:00100000:3.0:1782217053.118099:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693130752 00000100:00100000:3.0:1782217053.118101:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693130752 00000100:00100000:3.0:1782217053.118132:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 337 00000100:00100000:3.0:1782217053.118141:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43317b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a927f5f6-9735-45e0-abce-963bd125e020+5:2403:x1868789693130880:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1782217053.118210:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43317b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a927f5f6-9735-45e0-abce-963bd125e020+5:2403:x1868789693130880:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 68us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217053.118228:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 337 00000100:00100000:3.0:1782217053.118247:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 338 00000100:00100000:3.0:1782217053.118253:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43315880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+5:2403:x1868789693130496:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1782217053.118279:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43315880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+5:2403:x1868789693130496:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 27us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217053.118284:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 338 00000100:00100000:3.0:1782217053.118294:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 339 00000100:00100000:3.0:1782217053.118300:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43314380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a927f5f6-9735-45e0-abce-963bd125e020+5:2403:x1868789693130752:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1782217053.118320:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43314380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a927f5f6-9735-45e0-abce-963bd125e020+5:2403:x1868789693130752:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 21us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217053.118326:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 339 00000100:00080000:3.0:1782217053.118343:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782217053.118346:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782217053.118403:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693130368 00000100:00100000:2.0:1782217053.118408:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693130368 00000100:00100000:2.0:1782217053.118447:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 392 00000100:00100000:2.0:1782217053.118454:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:2403:x1868789693130368:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1782217053.118482:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:2403:x1868789693130368:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 28us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217053.118494:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 392 00000100:00100000:2.0:1782217053.118524:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693130624 00000100:00100000:2.0:1782217053.118527:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693130624 00000100:00100000:2.0:1782217053.118558:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 106 00000100:00100000:2.0:1782217053.118565:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43315500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:24a87249-c61f-41a1-85ec-9a313129e739+9:2403:x1868789693130624:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1782217053.118618:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43315500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:24a87249-c61f-41a1-85ec-9a313129e739+9:2403:x1868789693130624:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 53us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217053.118625:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 106 00000100:00080000:3.0:1782217053.119141:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:3.0:1782217053.461361:0:14759:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782217053.461370:0:14759:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782217053.461402:0:14759:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1782217053.461408:0:14759:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1782217053.625299:0:13796:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782217053.625309:0:13796:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782217053.625340:0:13796:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1782217053.625348:0:13796:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782217053.625476:0:13796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43cb0e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13796:1868789713096448:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1782217053.625560:0:13796:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43721480 going to sleep for 11 seconds 00000100:00100000:2.0:1782217053.643147:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217053.644265:0:13796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43cb0e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13796:1868789713096448:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1782217053.649518:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693131008 00000100:00100000:3.0:1782217053.649533:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693131008 00000100:00100000:3.0:1782217053.649619:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 250 00000100:00100000:3.0:1782217053.649628:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+27:12487:x1868789693131008:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000100:00080000:1.0:1782217053.652200:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000080:3.0:1782217053.653447:0:6548:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1782217053.653620:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+27:12487:x1868789693131008:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 3987us (10530us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217053.653656:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 250 00000100:00100000:1.0:1782217053.659926:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217053.660791:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693131264 00000100:00100000:2.0:1782217053.660801:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693131264 00000100:00100000:2.0:1782217053.660857:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 251 00000100:00100000:2.0:1782217053.660866:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c670a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+27:12487:x1868789693131264:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782217053.660887:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217053.660907:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5fa3f9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973747 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217053.661008:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5fa400 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217053.661033:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5fa400 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217053.661047:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5fa400 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217053.661059:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1782217053.662268:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5fa3f9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973747 expref: 30 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217053.662290:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5fa400 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973747 expref: 29 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217053.662299:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:2.0:1782217053.662302:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782217053.662306:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2d000, rc 0) 00000100:00100000:2.0:1782217053.662414:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c670a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24a87249-c61f-41a1-85ec-9a313129e739+29:12487:x1868789693131264:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 1548us (2496us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1782217053.662423:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 251 00000100:00100000:1.0:1782217053.670011:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217053.670053:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217053.670176:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693131648 00000100:00100000:2.0:1782217053.670186:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693131648 00000100:00100000:2.0:1782217053.670246:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 252 00000100:00100000:2.0:1782217053.670257:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c671f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+29:12487:x1868789693131648:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1782217053.670331:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5fa40e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217053.670348:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5fa40e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217053.670372:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5fa40e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217053.670514:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5fa40e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217053.670522:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5fa40e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217053.670529:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5fa40e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217053.670535:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2d800 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782217053.670539:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5fa40e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217053.670547:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5fa40e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217053.670560:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:2.0:1782217053.670563:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782217053.670567:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5fa40e lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217053.670574:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d800/0x92b8e04cbf5fa40e lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217053.670854:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c671f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+30:12487:x1868789693131648:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 597us (850us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1782217053.670863:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 252 00000040:00080000:2.0:1782217053.671298:0:13796:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782217053.671303:0:13796:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1782217053.671900:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693131392 00000100:00100000:1.0:1782217053.671907:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693131392 00000100:00100000:1.0:1782217053.671969:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:1.0:1782217053.671977:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c671180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24a87249-c61f-41a1-85ec-9a313129e739+30:2404:x1868789693131392:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782217053.671989:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782217053.672007:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d000/0x92b8e04cbf5fa400 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973747 expref: 30 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217053.672035:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:1.0:1782217053.672039:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782217053.672077:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c671180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24a87249-c61f-41a1-85ec-9a313129e739+29:2404:x1868789693131392:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 101us (2023us total) trans 0 rc 0/0 00000040:00080000:2.0:1782217053.672390:0:13796:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1782217053.672400:0:13796:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1782217053.672466:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:1.0:1782217053.675853:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217053.676011:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693131904 00000100:00100000:3.0:1782217053.676020:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693131904 00000100:00100000:3.0:1782217053.676098:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 64 00000100:00100000:3.0:1782217053.676108:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c673100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24a87249-c61f-41a1-85ec-9a313129e739+29:12487:x1868789693131904:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1782217053.676403:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c673100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24a87249-c61f-41a1-85ec-9a313129e739+30:12487:x1868789693131904:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 295us (557us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1782217053.676410:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 64 00010000:00010000:1.0:1782217053.689982:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782217053.756344:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:3.0:1782217053.756359:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00010000:00010000:2.0:1782217054.714303:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782217054.776822:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782217054.776843:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c670700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713096576:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782217054.776907:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217054.776980:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713096576 00000100:00100000:1.0:1782217054.776987:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713096576 00000100:00100000:1.0:1782217054.777043:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1782217054.777052:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c673800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713096576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782217054.777081:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1782217054.777123:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c673800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713096576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217054.777410:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789713096704:0@lo:400:kworker.0 00000100:00100000:0.0:1782217054.777446:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217054.777471:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713097216:0@lo:400:kworker.0 00000100:00100000:0.0:1782217054.777495:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217054.777513:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43fee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1868789713097728:0@lo:400:kworker.0 00000100:00100000:0.0:1782217054.777536:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217054.777555:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1782217054.777561:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1868789713096832:0@lo:400:kworker.0 00000100:00100000:0.0:1782217054.777602:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217054.777618:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1868789713097344:0@lo:400:kworker.0 00000100:00100000:0.0:1782217054.777648:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217054.777663:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43fed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1868789713097856:0@lo:400:kworker.0 00000100:00100000:0.0:1782217054.777681:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217054.777772:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713097216 00000100:00100000:0.0:1782217054.777777:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713097216 00000100:00100000:0.0:1782217054.777819:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1782217054.777825:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43feca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713097216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217054.777864:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43feca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713097216:12345-0@lo:400:kworker.0 Request processed in 39us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217054.777871:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1782217054.777892:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713097728 00000100:00100000:0.0:1782217054.777895:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713097728 00000100:00100000:0.0:1782217054.777913:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713096832 00000100:00100000:0.0:1782217054.777915:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713096832 00000100:00100000:0.0:1782217054.777926:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713097344 00000100:00100000:0.0:1782217054.777928:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713097344 00000100:00100000:0.0:1782217054.777939:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713097856 00000100:00100000:0.0:1782217054.777941:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713097856 00000100:00100000:0.0:1782217054.777955:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1782217054.777960:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1868789713097728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217054.777988:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1868789713097728:12345-0@lo:400:kworker.0 Request processed in 28us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217054.777994:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1782217054.778004:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1782217054.778009:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1868789713096832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217054.778028:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1868789713096832:12345-0@lo:400:kworker.0 Request processed in 20us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217054.778033:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1782217054.778042:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1782217054.778047:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1868789713097344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217054.778066:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1868789713097344:12345-0@lo:400:kworker.0 Request processed in 19us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217054.778080:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1782217054.778091:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1782217054.778095:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43feed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1868789713097856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217054.778121:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43feed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1868789713097856:12345-0@lo:400:kworker.0 Request processed in 25us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217054.778306:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:1.0:1782217054.778327:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782217054.778330:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782217054.778332:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782217054.778344:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713096704 00000100:00100000:1.0:1782217054.778348:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713096704 00000100:00100000:1.0:1782217054.778373:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1782217054.778379:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3647:x1868789713096704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217054.778410:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3647:x1868789713096704:12345-0@lo:400:kworker.0 Request processed in 32us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217054.778427:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1782217054.778466:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713096960:0@lo:400:kworker.0 00000100:00100000:1.0:1782217054.778490:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217054.778510:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1868789713097472:0@lo:400:kworker.0 00000100:00100000:1.0:1782217054.778528:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217054.778541:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43fec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713097984:0@lo:400:kworker.0 00000100:00100000:1.0:1782217054.778559:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217054.778611:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c670700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713096576:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782217054.778638:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1782217054.778644:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1868789713097088:0@lo:400:kworker.0 00000100:00100000:1.0:1782217054.778663:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217054.778673:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43fed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713097600:0@lo:400:kworker.0 00000100:00100000:1.0:1782217054.778689:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217054.778881:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713097984 00000100:00100000:3.0:1782217054.778886:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713097984 00000100:00100000:3.0:1782217054.778917:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713097600 00000100:00100000:3.0:1782217054.778920:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713097600 00000100:00100000:3.0:1782217054.778940:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1782217054.778945:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c671880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713097984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217054.778975:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c671880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713097984:12345-0@lo:400:kworker.0 Request processed in 30us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217054.778980:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1782217054.778992:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1782217054.778996:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c670380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3649:x1868789713097600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217054.779017:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c670380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3649:x1868789713097600:12345-0@lo:400:kworker.0 Request processed in 21us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217054.779022:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1782217054.779036:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713096960 00000100:00100000:3.0:1782217054.779044:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713096960 00000100:00100000:3.0:1782217054.779064:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1782217054.779070:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c673b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713096960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217054.779096:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c673b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713096960:12345-0@lo:400:kworker.0 Request processed in 27us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217054.779102:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1782217054.779117:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713097472 00000100:00100000:3.0:1782217054.779120:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713097472 00000100:00100000:0.0:1782217054.779180:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1782217054.779196:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713097088 00000100:00100000:0.0:1782217054.779199:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713097088 00000100:00100000:1.0:1782217054.779239:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43fed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713097600:0@lo:400:kworker.0 00000100:00100000:1.0:1782217054.779246:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43fee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713098112:0@lo:400:kworker.0 00000100:00100000:1.0:1782217054.779266:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217054.779290:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713096960:0@lo:400:kworker.0 00000100:00100000:1.0:1782217054.779300:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43fec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713097984:0@lo:400:kworker.0 00000100:00100000:1.0:1782217054.779329:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713098112 00000100:00100000:1.0:1782217054.779333:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713098112 00000100:00100000:1.0:1782217054.779357:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1782217054.779363:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43695f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713098112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217054.779397:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43695f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713098112:12345-0@lo:400:kworker.0 Request processed in 34us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217054.779410:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:1.0:1782217054.779427:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782217054.779430:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782217054.779432:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782217054.779453:0:3649:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:1.0:1782217054.779459:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:1.0:1782217054.779487:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff952d4379b100, transno 4294967308 00000004:00080000:1.0:1782217054.779496:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:1.0:1782217054.779514:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff952d43cb3b80, transno 4294967311 00000100:00100000:1.0:1782217054.779520:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43fee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713098112:0@lo:400:kworker.0 00000100:00100000:1.0:1782217054.779733:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1868789713096832:0@lo:400:kworker.0 00000100:00100000:1.0:1782217054.779744:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1868789713097344:0@lo:400:kworker.0 00010000:00080000:1.0:1782217054.779757:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43fed880 x1868789713097856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782217054.779777:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43fed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1868789713097856:0@lo:400:kworker.0 00000100:00100000:1.0:1782217054.779787:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789713096704:0@lo:400:kworker.0 00000100:00100000:1.0:1782217054.779797:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713097216:0@lo:400:kworker.0 00000100:00100000:1.0:1782217054.779807:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43fee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1868789713097728:0@lo:400:kworker.0 00000100:00100000:1.0:1782217054.779981:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43696300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713098240:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782217054.780007:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217054.780037:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43cb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713098368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782217054.780049:0:10535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713098240 00000100:00100000:2.0:1782217054.780053:0:10535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713098240 00000100:00100000:1.0:1782217054.780056:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217054.780076:0:10535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713098368 00000100:00100000:2.0:1782217054.780079:0:10535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713098368 00000100:00100000:1.0:1782217054.780091:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1782217054.780217:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43697100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713098240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782217054.780239:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782217054.780273:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43697100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713098240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 174us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217054.782825:0:10535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1782217054.782845:0:10535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43694e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1868789713098368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782217054.782870:0:10535:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1782217054.782938:0:10535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43694e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1868789713098368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (2879us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217054.782946:0:10535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1782217054.783041:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43cb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713098496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782217054.783076:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217054.783116:0:10535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713098496 00000100:00100000:2.0:1782217054.783123:0:10535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713098496 00000100:00100000:2.0:1782217054.783148:0:10535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1782217054.783153:0:10535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713098496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782217054.783164:0:10535:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782217054.783199:0:10535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713098496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217054.784240:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1782217054.784305:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43696300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713098240:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782217054.784322:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43cb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713098368:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782217054.784383:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43cb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713098496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782217054.784997:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1782217054.785010:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c671500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1868789713097472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217054.785076:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c671500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1868789713097472:12345-0@lo:400:kworker.0 Request processed in 70us (6545us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217054.785083:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00010000:00080000:1.0:1782217054.785309:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4441ca80 x1868789713097472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782217054.785322:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1868789713097472:0@lo:400:kworker.0 00000100:00100000:2.0:1782217054.785455:0:10535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1782217054.788912:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1782217054.788928:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c670700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1868789713097088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217054.789018:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c670700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1868789713097088:12345-0@lo:400:kworker.0 Request processed in 96us (10353us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217054.789026:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1782217054.789075:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1868789713097088:0@lo:400:kworker.0 00000100:00100000:0.0:1782217055.291934:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43fef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713098624:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782217055.292005:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217055.292077:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713098624 00000100:00100000:0.0:1782217055.292084:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713098624 00000100:00100000:0.0:1782217055.292141:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1782217055.292149:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713098624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782217055.292180:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1782217055.292226:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713098624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217055.292232:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1782217055.292278:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43fef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713098624:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1782217055.366675:0:14810:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782217055.366684:0:14810:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782217055.366717:0:14810:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1782217055.366729:0:14810:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1782217055.493035:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217055.493130:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693132160 00000100:00100000:0.0:1782217055.493140:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693132160 00000100:00100000:0.0:1782217055.493199:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 253 00000100:00100000:0.0:1782217055.493207:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43696300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+30:12507:x1868789693132160:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1782217055.493230:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217055.493248:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121de00/0x92b8e04cbf5fa415 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be97374e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217055.493350:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c400/0x92b8e04cbf5fa41c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217055.493365:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c400/0x92b8e04cbf5fa41c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217055.493377:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c400/0x92b8e04cbf5fa41c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782217055.493389:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1782217055.493495:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121de00/0x92b8e04cbf5fa415 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97374e expref: 33 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217055.493511:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c400/0x92b8e04cbf5fa41c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97374e expref: 32 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217055.493520:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:0.0:1782217055.493524:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1782217055.493527:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e4121c400, rc 0) 00000100:00100000:0.0:1782217055.493573:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43696300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+32:12507:x1868789693132160:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 367us (546us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1782217055.493616:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 253 00000100:00080000:1.0:1782217055.493885:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782217055.507427:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217055.511882:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693132288 00000100:00100000:1.0:1782217055.511896:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693132288 00000100:00100000:1.0:1782217055.511948:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 254 00000100:00100000:1.0:1782217055.511958:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43317800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+32:12507:x1868789693132288:12345-192.168.203.30@tcp:54:lfs.0 00010000:00010000:1.0:1782217055.512019:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5fa42a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217055.516106:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5fa42a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217055.516120:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5fa42a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217055.516182:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5fa42a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217055.516190:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5fa42a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217055.516197:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5fa42a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217055.516203:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43073800 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217055.516207:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5fa42a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217055.516215:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5fa42a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217055.516228:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:1.0:1782217055.516232:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782217055.516236:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5fa42a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217055.516255:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5fa42a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217055.516500:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43317800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+32:12507:x1868789693132288:12345-192.168.203.30@tcp:54:lfs.0 Request processed in 4537us (9075us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217055.516510:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 254 00000100:00100000:1.0:1782217055.587019:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217055.587104:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693132416 00000100:00100000:2.0:1782217055.587114:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693132416 00000100:00100000:2.0:1782217055.587190:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 79 00000100:00100000:2.0:1782217055.587200:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43695880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24a87249-c61f-41a1-85ec-9a313129e739+7:2405:x1868789693132416:12345-192.168.203.30@tcp:101:cat.0 00010000:00010000:2.0:1782217055.587219:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217055.587239:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4ce389f/0x92b8e04cbf5fa431 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973755 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782217055.587263:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a3a795b, atime: 0x6a3a795b, ctime: 0x6a3a795b, blocks: 0x8 00010000:00010000:2.0:1782217055.587282:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=418s v=(0 0) 00010000:00010000:2.0:1782217055.587286:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782217055.587296:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4ce389f/0x92b8e04cbf5fa431 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973755 expref: 8 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217055.587314:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b4ce389f/0x92b8e04cbf5fa431 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973755 expref: 8 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217055.587326:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2c600, rc 0) 00000100:00100000:2.0:1782217055.587386:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43695880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24a87249-c61f-41a1-85ec-9a313129e739+8:2405:x1868789693132416:12345-192.168.203.30@tcp:101:cat.0 Request processed in 187us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217055.587393:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 79 00000100:00080000:1.0:1782217055.587452:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782217055.593920:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217055.594017:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693132544 00000100:00100000:2.0:1782217055.594026:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693132544 00002000:00100000:2.0:1782217055.594074:0:8438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff952d43317100 x1868789693132544/t0(0) o3->24a87249-c61f-41a1-85ec-9a313129e739@192.168.203.30@tcp:306/0 lens 488/0 e 0 to 0 dl 1782217066 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782217055.594085:0:8438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff952d43317100 with x1868789693132544 ext(0->4095) 00002000:00010000:2.0:1782217055.594104:0:8438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff952d43317100 00000100:00100000:2.0:1782217055.594139:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:2.0:1782217055.594150:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43317100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:24a87249-c61f-41a1-85ec-9a313129e739+8:2404:x1868789693132544:12345-192.168.203.30@tcp:3:cat.0 00000100:00100000:2.0:1782217055.594312:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43317100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:24a87249-c61f-41a1-85ec-9a313129e739+8:2404:x1868789693132544:12345-192.168.203.30@tcp:3:cat.0 Request processed in 162us (399us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1782217055.594320:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 7 00002000:00100000:2.0:1782217055.594327:0:8438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff952d43317100 x1868789693132544/t0(0) o3->24a87249-c61f-41a1-85ec-9a313129e739@192.168.203.30@tcp:306/0 lens 488/4536 e 0 to 0 dl 1782217066 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782217055.594336:0:8438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff952d43317100 with x1868789693132544 ext(0->4095) 00002000:00010000:2.0:1782217055.594340:0:8438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff952d43317100 00010000:00010000:3.0:1782217055.736756:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782217056.312996:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782217056.313018:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43315f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713098752:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782217056.313085:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217056.313167:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713098752 00000100:00100000:3.0:1782217056.313174:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713098752 00000100:00100000:3.0:1782217056.313220:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1782217056.313229:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43316d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713098752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782217056.313266:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1782217056.313377:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43316d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713098752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 147us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217056.313386:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1782217056.313446:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43315f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713098752:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1782217056.764031:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217057.785991:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1782217057.851465:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:1.0:1782217057.851494:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:0.0:1782217057.855505:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000020:00080000:0.0:1782217057.855538:0:6498:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff952e42c59f00 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1782217057.855543:0:6498:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff952e7c650f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff952e42c59540 00000020:00080000:0.0:1782217057.855546:0:6498:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff952e7c650400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff952d43cc8200 00000020:00080000:0.0:1782217057.855571:0:6498:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:0.0:1782217057.855614:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5fa3ac lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217057.855624:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5fa3ac lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217057.855631:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5fa3ac lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217057.855638:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43073600 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782217057.855643:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5fa3ac lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217057.855650:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5fa3ac lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217057.855667:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff952d410a7f00) 00010000:00010000:0.0:1782217057.855670:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217057.855674:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5fa3ac lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217057.855681:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073600/0x92b8e04cbf5fa3ac lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1782217057.855720:0:6551:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1782217057.855784:0:6551:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:0.0:1782217058.249723:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217058.249762:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217058.249827:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693132800 00000100:00100000:2.0:1782217058.249837:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693132800 00000100:00100000:2.0:1782217058.249919:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 346 00000100:00100000:2.0:1782217058.249929:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+18:2402:x1868789693132800:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1782217058.250001:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+18:2402:x1868789693132800:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 73us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217058.250008:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 346 00000100:00080000:0.0:1782217058.250203:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782217058.250303:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693132672 00000100:00100000:3.0:1782217058.250317:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693132672 00000100:00100000:3.0:1782217058.250394:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 394 00000100:00100000:3.0:1782217058.250403:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52589850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:2402:x1868789693132672:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1782217058.250445:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52589850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:2402:x1868789693132672:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 43us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217058.250452:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 394 00000100:00100000:0.0:1782217058.255759:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217058.255828:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217058.255857:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217058.255883:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217058.255921:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693133312 00000100:00100000:3.0:1782217058.255931:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693133312 00000100:00100000:3.0:1782217058.255982:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693132928 00000100:00100000:3.0:1782217058.255985:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693132928 00000100:00100000:3.0:1782217058.256007:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 347 00000100:00100000:3.0:1782217058.256016:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43feea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a927f5f6-9735-45e0-abce-963bd125e020+5:2403:x1868789693133312:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1782217058.256081:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43feea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a927f5f6-9735-45e0-abce-963bd125e020+5:2403:x1868789693133312:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 66us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217058.256088:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 347 00000100:00100000:3.0:1782217058.256102:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 348 00000100:00100000:3.0:1782217058.256109:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+5:2403:x1868789693132928:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1782217058.256132:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+5:2403:x1868789693132928:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 24us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217058.256138:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 348 00000100:00080000:1.0:1782217058.256775:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782217058.256781:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782217058.258775:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217058.258878:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693133440 00000100:00100000:0.0:1782217058.258888:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693133440 00000100:00100000:0.0:1782217058.258946:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 349 00000100:00100000:0.0:1782217058.258956:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a927f5f6-9735-45e0-abce-963bd125e020+5:2403:x1868789693133440:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782217058.259022:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a927f5f6-9735-45e0-abce-963bd125e020+5:2403:x1868789693133440:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 67us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217058.259029:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 349 00000100:00080000:0.0:1782217058.259758:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782217058.260242:0:10025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693133056 00000100:00100000:2.0:1782217058.260251:0:10025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693133056 00000100:00100000:2.0:1782217058.260313:0:10025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693133184 00000100:00100000:2.0:1782217058.260317:0:10025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693133184 00000100:00100000:2.0:1782217058.260344:0:10025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 110 00000100:00100000:2.0:1782217058.260366:0:10025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:24a87249-c61f-41a1-85ec-9a313129e739+7:2403:x1868789693133056:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1782217058.260418:0:10025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:24a87249-c61f-41a1-85ec-9a313129e739+7:2403:x1868789693133056:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 52us (4667us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217058.260468:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 111 00000100:00100000:1.0:1782217058.260482:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:24a87249-c61f-41a1-85ec-9a313129e739+5:2403:x1868789693133184:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1782217058.260802:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:24a87249-c61f-41a1-85ec-9a313129e739+5:2403:x1868789693133184:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 323us (4916us total) trans 0 rc 0/0 00000100:00080000:0.0:1782217058.263760:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782217058.263769:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782217058.263955:0:10025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 110 00000100:00100000:1.0:1782217058.263966:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 111 00000040:00080000:0.0:1782217058.621695:0:13800:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1782217058.808743:0:13796:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782217058.808753:0:13796:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782217058.808773:0:13796:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1782217058.808782:0:13796:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1782217058.820177:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217059.833645:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782217059.872491:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217059.872752:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693133568 00000100:00100000:3.0:1782217059.872776:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693133568 00000100:00100000:2.0:1782217059.872980:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 255 00000100:00100000:2.0:1782217059.872991:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+18:12160:x1868789693133568:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1782217059.873101:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24a87249-c61f-41a1-85ec-9a313129e739+18:12160:x1868789693133568:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 Request processed in 111us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217059.873109:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 255 00000100:00100000:2.0:1782217059.876842:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217059.877778:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693133696 00000100:00100000:0.0:1782217059.877789:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693133696 00000100:00100000:0.0:1782217059.877900:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 256 00000100:00100000:0.0:1782217059.877910:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+5:12160:x1868789693133696:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1782217059.878888:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+5:12160:x1868789693133696:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 Request processed in 977us (2053us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217059.878898:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 256 00000100:00100000:3.0:1782217059.882710:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217059.883252:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693133952 00000100:00100000:2.0:1782217059.883262:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693133952 00000100:00100000:2.0:1782217059.883321:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 65 00000100:00100000:2.0:1782217059.883331:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43315f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+18:12160:x1868789693133952:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1782217059.883571:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43315f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+19:12160:x1868789693133952:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 240us (868us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1782217059.883580:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 65 00000100:00100000:1.0:1782217059.896910:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713098880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782217059.896983:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217059.896992:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43316a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713099008:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782217059.897032:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217059.897389:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43cb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713099136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782217059.897422:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217059.897458:0:10535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713098880 00000100:00100000:2.0:1782217059.897465:0:10535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713098880 00000100:00100000:2.0:1782217059.897509:0:10535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713099008 00000100:00100000:2.0:1782217059.897513:0:10535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713099008 00000100:00100000:2.0:1782217059.897526:0:10535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713099136 00000100:00100000:2.0:1782217059.897541:0:10535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713099136 00000100:00100000:2.0:1782217059.897565:0:10535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1782217059.897573:0:10535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43696680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713098880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782217059.897644:0:10535:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00080000:0.0:1782217059.897803:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782217059.897808:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782217059.897817:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43fec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713099264:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782217059.897847:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217059.903857:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713099264 00000100:00100000:3.0:1782217059.903873:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713099264 00000100:00100000:3.0:1782217059.903952:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1782217059.903962:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43314a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713099008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782217059.903995:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782217059.904077:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43314a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713099008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 116us (7044us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217059.904084:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1782217059.904101:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1782217059.904107:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713099136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782217059.904119:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782217059.904146:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713099136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (6723us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217059.904152:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1782217059.904164:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1782217059.904171:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713099264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782217059.904181:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1782217059.904214:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713099264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (6366us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217059.904220:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1782217059.904270:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43fec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713099264:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782217059.904307:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43316a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713099008:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782217059.904341:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782217059.904351:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17bce19a-7a0f-4c9d-b31c-4e0155298487:3648:1868789713099392:0@lo:400:kworker.0 00000100:00100000:3.0:1782217059.904386:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217059.904781:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713099392 00000100:00100000:1.0:1782217059.904786:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713099392 00000100:00100000:1.0:1782217059.904820:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1782217059.904827:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52588c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3648:x1868789713099392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217059.904872:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52588c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3648:x1868789713099392:12345-0@lo:400:kworker.0 Request processed in 45us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217059.904878:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1782217059.904912:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17bce19a-7a0f-4c9d-b31c-4e0155298487:3648:1868789713099392:0@lo:400:kworker.0 00000100:00100000:1.0:1782217059.904960:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43cb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713099136:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1782217059.904981:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782217059.910066:0:10535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43696680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713098880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 12482us (13072us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217059.910082:0:10535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1782217059.913064:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782217059.913089:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713099648:0@lo:400:kworker.0 00000100:00100000:0.0:1782217059.913162:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217059.913216:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713099648 00000100:00100000:0.0:1782217059.913224:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713099648 00000100:00100000:0.0:1782217059.913268:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1782217059.913276:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713099648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217059.913329:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713099648:12345-0@lo:400:kworker.0 Request processed in 53us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217059.913336:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1782217059.913383:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713099648:0@lo:400:kworker.0 00000100:00100000:0.0:1782217059.913442:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1868789713099776:0@lo:400:kworker.0 00000100:00100000:0.0:1782217059.913469:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217059.913499:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713099776 00000100:00100000:0.0:1782217059.913503:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713099776 00000100:00100000:0.0:1782217059.913531:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1782217059.913538:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1868789713099776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217059.913575:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1868789713099776:12345-0@lo:400:kworker.0 Request processed in 37us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217059.913631:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1782217059.913816:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1868789713099520:0@lo:400:kworker.0 00000100:00100000:3.0:1782217059.913846:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217059.913915:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713099520 00000100:00100000:2.0:1782217059.913920:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713099520 00000100:00100000:2.0:1782217059.913955:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1782217059.913962:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43316a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1868789713099520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217059.913998:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43316a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1868789713099520:12345-0@lo:400:kworker.0 Request processed in 37us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217059.914004:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1782217059.914069:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1868789713099520:0@lo:400:kworker.0 00000100:00100000:0.0:1782217059.914129:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1868789713099776:0@lo:400:kworker.0 00000100:00100000:3.0:1782217059.914180:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782217059.915278:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:1.0:1782217059.915287:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff952e7c673480, transno 4294967323 00000004:00080000:1.0:1782217059.915306:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:1.0:1782217059.915336:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713098880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782217059.915351:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782217059.915373:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1868789713100032:0@lo:400:kworker.0 00000100:00100000:1.0:1782217059.915432:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217059.915474:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713100032 00000100:00100000:1.0:1782217059.915479:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713100032 00000100:00100000:1.0:1782217059.915519:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1782217059.915528:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1868789713100032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217059.915569:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1868789713100032:12345-0@lo:400:kworker.0 Request processed in 42us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217059.915577:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00080000:1.0:1782217059.915628:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782217059.915649:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1868789713100032:0@lo:400:kworker.0 00000100:00100000:3.0:1782217059.916136:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713099904:0@lo:400:kworker.0 00000100:00100000:3.0:1782217059.916170:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217059.916248:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713099904 00000100:00100000:1.0:1782217059.916254:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713099904 00000100:00100000:1.0:1782217059.916292:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1782217059.916299:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43315180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713099904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217059.916338:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43315180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713099904:12345-0@lo:400:kworker.0 Request processed in 39us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217059.916344:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1782217059.916429:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713099904:0@lo:400:kworker.0 00000100:00100000:0.0:1782217059.919865:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782217059.919887:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1868789713100160:0@lo:400:kworker.0 00000100:00100000:0.0:1782217059.919949:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217059.919995:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713100160 00000100:00100000:0.0:1782217059.920002:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713100160 00000100:00100000:0.0:1782217059.920056:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1782217059.920065:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1868789713100160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217059.920112:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1868789713100160:12345-0@lo:400:kworker.0 Request processed in 48us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217059.920119:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00080000:0.0:1782217059.920140:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1782217059.920168:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d41be5f80 x1868789713100160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782217059.920181:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1868789713100160:0@lo:400:kworker.0 00000100:00100000:0.0:1782217059.920215:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1868789713100288:0@lo:400:kworker.0 00000100:00100000:0.0:1782217059.920236:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217059.920261:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713100288 00000100:00100000:0.0:1782217059.920266:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713100288 00000100:00100000:0.0:1782217059.920296:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1782217059.920301:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1868789713100288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217059.920335:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1868789713100288:12345-0@lo:400:kworker.0 Request processed in 33us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217059.920341:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00080000:0.0:1782217059.920368:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782217059.920384:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1868789713100288:0@lo:400:kworker.0 00000100:00100000:3.0:1782217059.920534:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782217059.920544:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1868789713100416:0@lo:400:kworker.0 00000100:00100000:3.0:1782217059.920571:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217059.920824:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713100416 00000100:00100000:0.0:1782217059.920829:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713100416 00000100:00100000:0.0:1782217059.920910:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1782217059.920917:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43317480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1868789713100416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217059.920964:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43317480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1868789713100416:12345-0@lo:400:kworker.0 Request processed in 47us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217059.920970:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00010000:00080000:3.0:1782217059.921638:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d41be5f80 x1868789713100416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217059.921660:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1868789713100416:0@lo:400:kworker.0 00000100:00080000:2.0:1782217059.923335:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782217060.109858:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217060.109970:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693134080 00000100:00100000:0.0:1782217060.109979:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693134080 00000100:00100000:0.0:1782217060.110049:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 257 00000100:00100000:0.0:1782217060.110059:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43697800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a927f5f6-9735-45e0-abce-963bd125e020+5:12964:x1868789693134080:12345-192.168.203.30@tcp:101:lsof.0 00010000:00010000:0.0:1782217060.110077:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217060.110096:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5fa438 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be97375c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217060.110163:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5fa43f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217060.110176:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5fa43f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217060.110190:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5fa43f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782217060.110239:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1782217060.110243:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782217060.110266:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5fa43f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217060.110307:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d600/0x92b8e04cbf5fa438 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97375c expref: 7 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217060.110325:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5fa43f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97375c expref: 6 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217060.110334:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d410a7100) 00010000:00010000:0.0:1782217060.110336:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782217060.110340:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e4121c600, rc 0) 00000100:00100000:0.0:1782217060.110401:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43697800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a927f5f6-9735-45e0-abce-963bd125e020+6:12964:x1868789693134080:12345-192.168.203.30@tcp:101:lsof.0 Request processed in 343us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217060.110408:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 257 00000100:00080000:2.0:1782217060.110477:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782217060.408982:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782217060.409006:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713100544:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782217060.409071:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217060.409275:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713100544 00000100:00100000:2.0:1782217060.409283:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713100544 00000100:00100000:2.0:1782217060.409334:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1782217060.409343:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43694000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713100544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782217060.409377:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1782217060.409430:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43694000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713100544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217060.409436:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1782217060.409492:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713100544:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1782217060.856889:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782217061.432975:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782217061.432999:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43314700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713100672:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782217061.433068:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217061.435077:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713100672 00000100:00100000:3.0:1782217061.435090:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713100672 00000100:00100000:3.0:1782217061.435158:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1782217061.435168:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713100672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782217061.435205:0:7938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1782217061.435294:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713100672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 127us (2225us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217061.435318:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1782217061.437897:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43314700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713100672:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1782217061.881086:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217062.909295:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782217063.363788:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217063.363872:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217063.363909:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217063.363950:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217063.364010:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693134720 00000100:00100000:2.0:1782217063.364021:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693134720 00000100:00100000:2.0:1782217063.364095:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 112 00000100:00100000:2.0:1782217063.364117:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:24a87249-c61f-41a1-85ec-9a313129e739+5:2405:x1868789693134720:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1782217063.364183:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:24a87249-c61f-41a1-85ec-9a313129e739+5:2405:x1868789693134720:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 68us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217063.364191:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 112 00000100:00080000:2.0:1782217063.364211:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782217063.365668:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693134464 00000100:00100000:1.0:1782217063.365680:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693134464 00000100:00100000:1.0:1782217063.365743:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693134976 00000100:00100000:1.0:1782217063.365747:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693134976 00000100:00080000:2.0:1782217063.365879:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782217063.366006:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 356 00000100:00100000:1.0:1782217063.366041:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+5:2405:x1868789693134464:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1782217063.366235:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+5:2405:x1868789693134464:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 196us (2361us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217063.366244:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 356 00000100:00100000:1.0:1782217063.366262:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 357 00000100:00100000:1.0:1782217063.366268:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a927f5f6-9735-45e0-abce-963bd125e020+5:2405:x1868789693134976:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1782217063.366290:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a927f5f6-9735-45e0-abce-963bd125e020+5:2405:x1868789693134976:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 23us (2340us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217063.366296:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 357 00000100:00100000:3.0:1782217063.368780:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693134208 00000100:00100000:3.0:1782217063.368796:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693134208 00000100:00100000:1.0:1782217063.369313:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217063.369355:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217063.369381:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693134336 00000100:00100000:1.0:1782217063.369388:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217063.369390:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693134336 00000100:00100000:1.0:1782217063.369416:0:10025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693134592 00000100:00100000:1.0:1782217063.369421:0:10025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693134592 00000100:00100000:3.0:1782217063.369452:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693134848 00000100:00100000:3.0:1782217063.369457:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693134848 00000100:00100000:1.0:1782217063.369464:0:10025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 113 00000100:00100000:1.0:1782217063.369477:0:10025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43695500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:24a87249-c61f-41a1-85ec-9a313129e739+7:2404:x1868789693134592:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1782217063.369484:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 358 00000100:00100000:3.0:1782217063.369494:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+19:2404:x1868789693134336:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1782217063.369624:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 359 00000100:00100000:2.0:1782217063.369634:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a927f5f6-9735-45e0-abce-963bd125e020+6:2404:x1868789693134848:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1782217063.370096:0:10025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43695500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:24a87249-c61f-41a1-85ec-9a313129e739+7:2404:x1868789693134592:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 79us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217063.370106:0:10025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 113 00000100:00100000:3.0:1782217063.372175:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+19:2404:x1868789693134336:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 2672us (2855us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217063.372189:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 358 00000100:00100000:2.0:1782217063.372624:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a927f5f6-9735-45e0-abce-963bd125e020+6:2404:x1868789693134848:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 2988us (3233us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217063.372633:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 359 00000100:00080000:2.0:1782217063.372661:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782217063.372667:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782217063.372717:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 396 00000100:00100000:2.0:1782217063.372727:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52589450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:2405:x1868789693134208:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1782217063.372892:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52589450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:2405:x1868789693134208:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 166us (9113us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217063.372899:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 396 00000001:02000400:1.0:1782217063.532429:0:15009:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 08:17:42 (1782217062) 00010000:00010000:1.0:1782217063.929110:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782217064.005465:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000020:00080000:0.0:1782217064.005478:0:6498:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1782217064.005612:0:6551:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1782217064.005631:0:6551:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1782217064.953704:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782217065.016893:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43696d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713100800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782217065.016962:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217065.017119:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782217065.017129:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43cb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713100928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782217065.017158:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217065.017187:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713100800 00000100:00100000:2.0:1782217065.017194:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713100800 00000100:00100000:2.0:1782217065.017246:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713100928 00000100:00100000:2.0:1782217065.017249:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713100928 00000100:00100000:2.0:1782217065.017265:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1782217065.017273:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43696a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713100800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782217065.017302:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1782217065.017343:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43696a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713100800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217065.017350:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1782217065.017367:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1782217065.017373:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713100928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782217065.017388:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782217065.017416:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713100928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217065.017422:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:2.0:1782217065.017437:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782217065.017440:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782217065.017483:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43cb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713100928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782217065.017514:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43696d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713100800:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782217065.021739:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1868789713101440:0@lo:400:kworker.0 00000100:00100000:0.0:1782217065.021805:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217065.021850:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b300380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713101952:0@lo:400:kworker.0 00000100:00100000:0.0:1782217065.021874:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217065.021887:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b300a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713102464:0@lo:400:kworker.0 00000100:00100000:0.0:1782217065.021904:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217065.021922:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1782217065.021928:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789713101056:0@lo:400:kworker.0 00000100:00100000:0.0:1782217065.021951:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217065.021970:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713101568:0@lo:400:kworker.0 00000100:00100000:0.0:1782217065.021991:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217065.022006:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b303480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713102080:0@lo:400:kworker.0 00000100:00100000:0.0:1782217065.022023:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217065.022033:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b301f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713102592:0@lo:400:kworker.0 00000100:00100000:0.0:1782217065.022049:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217065.022074:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713101440 00000100:00100000:0.0:1782217065.022081:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713101440 00000100:00100000:0.0:1782217065.022123:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1782217065.022131:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b300700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1868789713101440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217065.022181:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b300700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1868789713101440:12345-0@lo:400:kworker.0 Request processed in 50us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217065.022189:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1782217065.022210:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713101056 00000100:00100000:0.0:1782217065.022214:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713101056 00000100:00100000:0.0:1782217065.022234:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:0.0:1782217065.022240:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e52589050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3647:x1868789713101056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217065.022269:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e52589050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3647:x1868789713101056:12345-0@lo:400:kworker.0 Request processed in 29us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217065.022285:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:0.0:1782217065.022313:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713101568 00000100:00100000:0.0:1782217065.022316:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713101568 00000100:00100000:0.0:1782217065.022340:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1782217065.022345:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b302d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713101568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217065.022377:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b302d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713101568:12345-0@lo:400:kworker.0 Request processed in 31us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217065.022383:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1782217065.022400:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713101952 00000100:00100000:0.0:1782217065.022404:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713101952 00000100:00100000:0.0:1782217065.022431:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713102464 00000100:00100000:0.0:1782217065.022433:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713102464 00000100:00100000:0.0:1782217065.022737:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713102080 00000100:00100000:0.0:1782217065.022742:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713102080 00000100:00100000:0.0:1782217065.022758:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713102592 00000100:00100000:0.0:1782217065.022761:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713102592 00000100:00100000:0.0:1782217065.022772:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1782217065.022778:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b300000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713101952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217065.022812:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b300000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713101952:12345-0@lo:400:kworker.0 Request processed in 34us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217065.022819:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1782217065.022831:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1782217065.022836:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b301500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713102464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217065.022863:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b301500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713102464:12345-0@lo:400:kworker.0 Request processed in 27us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217065.022869:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1782217065.022879:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1782217065.022892:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b303b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713102080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217065.022920:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b303b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713102080:12345-0@lo:400:kworker.0 Request processed in 29us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217065.022926:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1782217065.022935:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1782217065.022941:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b301180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713102592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217065.022963:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b301180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713102592:12345-0@lo:400:kworker.0 Request processed in 22us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217065.022968:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1782217065.023008:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789713101056:0@lo:400:kworker.0 00000100:00100000:0.0:1782217065.023019:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713101568:0@lo:400:kworker.0 00000100:00100000:0.0:1782217065.023029:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b303480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713102080:0@lo:400:kworker.0 00000100:00100000:0.0:1782217065.023038:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b301f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713102592:0@lo:400:kworker.0 00000100:00100000:0.0:1782217065.023047:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1868789713101440:0@lo:400:kworker.0 00000100:00100000:0.0:1782217065.023054:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b300380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713101952:0@lo:400:kworker.0 00000100:00100000:0.0:1782217065.023062:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b300a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713102464:0@lo:400:kworker.0 00000100:00100000:2.0:1782217065.023321:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1868789713101184:0@lo:400:kworker.0 00000100:00100000:2.0:1782217065.023354:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217065.023387:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1868789713101696:0@lo:400:kworker.0 00000100:00100000:2.0:1782217065.023407:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217065.023424:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1868789713102208:0@lo:400:kworker.0 00000100:00100000:2.0:1782217065.023454:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217065.023471:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43cb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713102720:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782217065.023503:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217065.023521:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1782217065.023527:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713101312:0@lo:400:kworker.0 00000100:00100000:2.0:1782217065.023547:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217065.023574:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1868789713101824:0@lo:400:kworker.0 00000100:00100000:2.0:1782217065.023616:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217065.023644:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b303100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1868789713102336:0@lo:400:kworker.0 00000100:00100000:2.0:1782217065.023666:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217065.023689:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713101184 00000100:00100000:2.0:1782217065.023693:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713101184 00000100:00100000:2.0:1782217065.023717:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713101696 00000100:00100000:2.0:1782217065.023719:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713101696 00000100:00100000:2.0:1782217065.023733:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713102208 00000100:00100000:2.0:1782217065.023735:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713102208 00000100:00100000:2.0:1782217065.023746:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713101824 00000100:00100000:2.0:1782217065.023749:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713101824 00000100:00100000:2.0:1782217065.023759:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713102336 00000100:00100000:2.0:1782217065.023761:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713102336 00000100:00100000:2.0:1782217065.023774:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1782217065.023780:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1868789713101184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217065.023818:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1868789713101184:12345-0@lo:400:kworker.0 Request processed in 37us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217065.023824:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1782217065.023838:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1782217065.023845:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1868789713101696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217065.023870:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1868789713101696:12345-0@lo:400:kworker.0 Request processed in 27us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217065.023876:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1782217065.023894:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1782217065.023900:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1868789713102208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217065.023931:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1868789713102208:12345-0@lo:400:kworker.0 Request processed in 32us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217065.023937:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1782217065.023949:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1782217065.023954:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1868789713101824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217065.023983:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1868789713101824:12345-0@lo:400:kworker.0 Request processed in 30us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217065.023989:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1782217065.024000:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1782217065.024005:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1868789713102336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217065.024028:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1868789713102336:12345-0@lo:400:kworker.0 Request processed in 23us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217065.024033:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1782217065.024054:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713101312 00000100:00100000:2.0:1782217065.024056:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713101312 00000100:00100000:2.0:1782217065.024080:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1782217065.024085:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713101312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217065.024114:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713101312:12345-0@lo:400:kworker.0 Request processed in 29us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217065.024120:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00080000:2.0:1782217065.024139:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782217065.024143:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782217065.024146:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782217065.024148:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782217065.024165:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713102720 00000100:00100000:2.0:1782217065.024174:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713102720 00000100:00100000:2.0:1782217065.024199:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1782217065.024205:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713102720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782217065.024220:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1782217065.024250:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713102720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217065.024256:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1782217065.024289:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713101312:0@lo:400:kworker.0 00010000:00080000:2.0:1782217065.024301:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d41be5500 x1868789713101824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782217065.024310:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1868789713101824:0@lo:400:kworker.0 00010000:00080000:2.0:1782217065.024320:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7b303100 x1868789713102336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782217065.024328:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b303100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1868789713102336:0@lo:400:kworker.0 00000100:00100000:2.0:1782217065.024337:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1868789713101184:0@lo:400:kworker.0 00000100:00100000:2.0:1782217065.024346:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1868789713101696:0@lo:400:kworker.0 00000100:00100000:2.0:1782217065.024355:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b302a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1868789713102208:0@lo:400:kworker.0 00000100:00100000:2.0:1782217065.024368:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43cb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713102720:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782217065.029284:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b300a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713102848:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782217065.029352:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217065.029421:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713102848 00000100:00100000:3.0:1782217065.029429:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713102848 00000100:00100000:3.0:1782217065.029487:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1782217065.029495:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713102848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782217065.029517:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782217065.029891:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713102848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 394us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217065.029899:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1782217065.029950:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b300a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713102848:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782217065.528851:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782217065.528892:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b300380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713102976:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782217065.528984:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217065.529182:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713102976 00000100:00100000:0.0:1782217065.529194:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713102976 00000100:00100000:0.0:1782217065.529265:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1782217065.529278:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713102976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782217065.529323:0:7938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1782217065.529388:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713102976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217065.529402:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1782217065.529618:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b300380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713102976:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1782217065.977788:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782217066.557777:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782217066.557832:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43316300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713103104:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782217066.557932:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217066.558212:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713103104 00000100:00100000:0.0:1782217066.558223:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713103104 00000100:00100000:0.0:1782217066.558333:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1782217066.558345:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43697480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713103104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782217066.558394:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1782217066.558462:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43697480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713103104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217066.558470:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1782217066.558578:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43316300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713103104:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1782217067.003455:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782217067.684833:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217067.684921:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693135232 00000100:00100000:2.0:1782217067.684936:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693135232 00000100:00100000:2.0:1782217067.685099:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 66 00000100:00100000:2.0:1782217067.685112:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43695c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+18:13187:x1868789693135232:12345-192.168.203.30@tcp:35:umount.0 00000100:00100000:2.0:1782217067.685557:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43695c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+19:13187:x1868789693135232:12345-192.168.203.30@tcp:35:umount.0 Request processed in 446us (736us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1782217067.685566:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 66 00000100:00080000:3.0:1782217067.685732:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782217067.694660:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217067.694845:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693135488 00000100:00100000:3.0:1782217067.694855:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693135488 00000100:00100000:3.0:1782217067.694908:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 67 00000100:00100000:3.0:1782217067.694919:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24a87249-c61f-41a1-85ec-9a313129e739+19:13187:x1868789693135488:12345-192.168.203.30@tcp:35:umount.0 00000100:00100000:3.0:1782217067.695213:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24a87249-c61f-41a1-85ec-9a313129e739+20:13187:x1868789693135488:12345-192.168.203.30@tcp:35:umount.0 Request processed in 294us (561us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1782217067.695234:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 67 00000100:00100000:1.0:1782217067.698451:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217067.698543:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693135744 00000100:00100000:3.0:1782217067.698553:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693135744 00000100:00100000:3.0:1782217067.698639:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 68 00000100:00100000:3.0:1782217067.698651:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e50126850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24a87249-c61f-41a1-85ec-9a313129e739+20:13187:x1868789693135744:12345-192.168.203.30@tcp:35:umount.0 00000100:00100000:3.0:1782217067.699128:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e50126850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24a87249-c61f-41a1-85ec-9a313129e739+21:13187:x1868789693135744:12345-192.168.203.30@tcp:35:umount.0 Request processed in 477us (684us total) trans 4294967527 rc 0/0 00000100:00100000:3.0:1782217067.699136:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 68 00000100:00100000:1.0:1782217067.704464:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217067.704573:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693136000 00000100:00100000:2.0:1782217067.704608:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693136000 00000100:00100000:2.0:1782217067.704669:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 69 00000100:00100000:2.0:1782217067.704679:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+21:13187:x1868789693136000:12345-192.168.203.30@tcp:35:umount.0 00000100:00100000:2.0:1782217067.704961:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24a87249-c61f-41a1-85ec-9a313129e739+22:13187:x1868789693136000:12345-192.168.203.30@tcp:35:umount.0 Request processed in 281us (504us total) trans 4294967528 rc 0/0 00000100:00100000:2.0:1782217067.704968:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 69 00000100:00100000:1.0:1782217067.711003:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217067.711055:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217067.711086:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217067.711117:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217067.711159:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693136128 00000100:00100000:1.0:1782217067.711164:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693136512 00000100:00100000:2.0:1782217067.711179:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693136128 00000100:00100000:1.0:1782217067.711179:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693136512 00000100:00100000:0.0:1782217067.711294:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693136384 00000100:00100000:0.0:1782217067.711301:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693136384 00000100:00100000:0.0:1782217067.711367:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 80 00000100:00100000:0.0:1782217067.711382:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43695c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:24a87249-c61f-41a1-85ec-9a313129e739+5:2401:x1868789693136384:12345-192.168.203.30@tcp:9:umount.0 00000100:00100000:2.0:1782217067.711398:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693136256 00000100:00100000:2.0:1782217067.711405:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693136256 00000020:00000080:0.0:1782217067.711422:0:8435:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f9734 00000100:00080000:0.0:1782217067.711437:0:8435:0:(import.c:65:import_set_state_nolock()) ffff952d4371e000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1782217067.711446:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00100000:2.0:1782217067.711459:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43694380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+15:2403:x1868789693136128:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782217067.711477:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217067.711496:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e7b362200/0x92b8e04cbf5f93a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9732af expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1782217067.711501:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00010000:00010000:2.0:1782217067.711549:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217067.711657:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43694380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+14:2403:x1868789693136128:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 198us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217067.711666:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00100000:2.0:1782217067.711694:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:2.0:1782217067.711704:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c673100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+13:2403:x1868789693136256:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782217067.711713:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1782217067.711775:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43695c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:24a87249-c61f-41a1-85ec-9a313129e739+2:2401:x1868789693136384:12345-192.168.203.30@tcp:9:umount.0 Request processed in 395us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217067.711784:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 80 00010000:00010000:2.0:1782217067.711808:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e4121c800/0x92b8e04cbf5f9631 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973388 expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217067.711816:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217067.711824:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:0.0:1782217067.711827:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782217067.711863:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c673100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+12:2403:x1868789693136256:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 159us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217067.711872:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:1.0:1782217067.712291:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 22 00000100:00100000:1.0:1782217067.712304:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43696d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+11:2403:x1868789693136512:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782217067.712320:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782217067.712339:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e413fc200/0x92b8e04cbf5f9359 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973270 expref: 11 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217067.712365:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782217067.712404:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43696d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7db73f00-8957-4054-9c9f-ae6b01c2a40a+10:2403:x1868789693136512:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 104us (1317us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217067.712412:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 22 00000100:00100000:1.0:1782217067.727546:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217067.727760:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693136896 00000100:00100000:2.0:1782217067.727777:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693136896 00000100:00100000:2.0:1782217067.727883:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 81 00000100:00100000:2.0:1782217067.727894:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c673480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24a87249-c61f-41a1-85ec-9a313129e739+7:2401:x1868789693136896:12345-192.168.203.30@tcp:9:umount.0 00000020:00000080:2.0:1782217067.727924:0:8432:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f99aa 00000020:00010000:2.0:1782217067.727931:0:8432:0:(genops.c:1942:obd_stale_export_put()) Put export ffff952e481cd000: total 0 00000100:00080000:2.0:1782217067.727936:0:8432:0:(import.c:65:import_set_state_nolock()) ffff952e481cc000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782217067.727985:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1782217067.728163:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c673480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24a87249-c61f-41a1-85ec-9a313129e739+5:2401:x1868789693136896:12345-192.168.203.30@tcp:9:umount.0 Request processed in 271us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217067.728172:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 81 00000020:00010000:1.0:1782217067.728350:0:10337:0:(genops.c:1928:obd_stale_export_get()) Get export ffff952e481cd000: total 0 00010000:00010000:1.0:1782217067.728429:0:10337:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff952e481cd000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1782217067.728519:0:10337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa3ca814/0x92b8e04cbf5f9d62 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973572 expref: 4 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217067.728576:0:10337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4ce389f/0x92b8e04cbf5fa431 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973755 expref: 3 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217067.728658:0:10337:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff952e481cd000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1782217067.728679:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217067.728681:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217067.728683:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782217067.728688:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782217067.742422:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217067.742513:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693137920 00000100:00100000:2.0:1782217067.742522:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693137920 00000100:00100000:2.0:1782217067.742615:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 258 00000100:00100000:2.0:1782217067.742626:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b301f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+22:2401:x1868789693137920:12345-192.168.203.30@tcp:39:umount.0 00000020:00000080:2.0:1782217067.742658:0:6548:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f9367 00000020:00010000:2.0:1782217067.742674:0:6548:0:(genops.c:1942:obd_stale_export_put()) Put export ffff952d435d5000: total 0 00000100:00080000:2.0:1782217067.742679:0:6548:0:(import.c:65:import_set_state_nolock()) ffff952d435d7800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782217067.742714:0:6548:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00100000:2.0:1782217067.742957:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b301f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24a87249-c61f-41a1-85ec-9a313129e739+21:2401:x1868789693137920:12345-192.168.203.30@tcp:39:umount.0 Request processed in 333us (544us total) trans 4294967529 rc 0/0 00000100:00100000:2.0:1782217067.742966:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 258 00000020:00010000:1.0:1782217067.743464:0:10336:0:(genops.c:1928:obd_stale_export_get()) Get export ffff952d435d5000: total 0 00010000:00010000:1.0:1782217067.743520:0:10336:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff952d435d5000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1782217067.743566:0:10336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff952d410ab800) 00010000:00010000:1.0:1782217067.743570:0:10336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782217067.743579:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2dc00/0x92b8e04cbf5f9693 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973396 expref: 20 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217067.743634:0:10336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff952e6105c600) 00010000:00010000:1.0:1782217067.743637:0:10336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1782217067.743640:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072400/0x92b8e04cbf5f9de7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973595 expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217067.743654:0:10336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:1.0:1782217067.743656:0:10336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782217067.743659:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072200/0x92b8e04cbf5fa3f2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973740 expref: 18 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217067.743671:0:10336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff952d426a0300) 00010000:00010000:1.0:1782217067.743686:0:10336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782217067.743693:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072000/0x92b8e04cbf5f9c43 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973525 expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217067.743709:0:10336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d410a7100) 00010000:00010000:1.0:1782217067.743712:0:10336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782217067.743800:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2d200/0x92b8e04cbf5f9dcb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97358e expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217067.743820:0:10336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:1.0:1782217067.743822:0:10336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1782217067.743826:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c400/0x92b8e04cbf5fa41c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97374e expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217067.743836:0:10336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff952e6105ce00) 00010000:00010000:1.0:1782217067.743838:0:10336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1782217067.743842:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ce00/0x92b8e04cbf5f970a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9733b2 expref: 14 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217067.743853:0:10336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff952e6105c600) 00010000:00010000:1.0:1782217067.743855:0:10336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782217067.743858:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5fa0d4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97366e expref: 13 pid: 6548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217067.743874:0:10336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff952e7b201600) 00010000:00010000:1.0:1782217067.743876:0:10336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217067.743880:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362800/0x92b8e04cbf5f96af lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97339d expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217067.743908:0:10336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff952d426a0300) 00010000:00010000:1.0:1782217067.743911:0:10336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782217067.743915:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c000/0x92b8e04cbf5f9d23 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97355d expref: 11 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217067.743927:0:10336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff952d426a0300) 00010000:00010000:1.0:1782217067.743930:0:10336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1782217067.743933:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5f9d4d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97356b expref: 10 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217067.743947:0:10336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff952e6105ce00) 00010000:00010000:1.0:1782217067.743949:0:10336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782217067.743953:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073c00/0x92b8e04cbf5f9a05 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97348b expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217067.743966:0:10336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:1.0:1782217067.743968:0:10336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782217067.743971:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e41681e00/0x92b8e04cbf5fa312 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973708 expref: 8 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217067.743984:0:10336:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff952d435d5000, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1782217067.743999:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217067.744002:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217067.744069:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782217067.763400:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217067.763624:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693138048 00000100:00100000:0.0:1782217067.763633:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693138048 00000100:00100000:0.0:1782217067.763724:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 259 00000100:00100000:0.0:1782217067.763736:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+5:2401:x1868789693138048:12345-192.168.203.30@tcp:39:umount.0 00000020:00000080:0.0:1782217067.763783:0:6519:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f936e 00000100:00080000:0.0:1782217067.763800:0:6519:0:(import.c:65:import_set_state_nolock()) ffff952d436dd800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782217067.763831:0:6519:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1782217067.763986:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24a87249-c61f-41a1-85ec-9a313129e739+3:2401:x1868789693138048:12345-192.168.203.30@tcp:39:umount.0 Request processed in 251us (595us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1782217067.763995:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 259 00010000:00010000:1.0:1782217067.764392:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1782217067.765943:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1782217068.024790:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1782217068.024969:0:13796:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782217068.024975:0:13796:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782217068.025226:0:13796:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1782217068.025234:0:13796:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782217068.479131:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217068.479194:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217068.479234:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217068.479435:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693138432 00000100:00100000:2.0:1782217068.479448:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693138432 00000100:00100000:2.0:1782217068.479542:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693138304 00000100:00100000:2.0:1782217068.479547:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693138304 00000100:00100000:2.0:1782217068.479575:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 366 00000100:00100000:2.0:1782217068.479643:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43315f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a927f5f6-9735-45e0-abce-963bd125e020+5:2404:x1868789693138432:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1782217068.479751:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43315f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a927f5f6-9735-45e0-abce-963bd125e020+5:2404:x1868789693138432:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 166us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217068.480004:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 366 00000100:00100000:2.0:1782217068.480040:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 367 00000100:00100000:2.0:1782217068.480048:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43314e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a927f5f6-9735-45e0-abce-963bd125e020+6:2404:x1868789693138304:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1782217068.480079:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43314e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a927f5f6-9735-45e0-abce-963bd125e020+6:2404:x1868789693138304:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 32us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217068.480086:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 367 00000100:00100000:1.0:1782217068.480689:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693138176 00000100:00100000:1.0:1782217068.480698:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693138176 00000100:00100000:1.0:1782217068.480768:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 398 00000100:00100000:1.0:1782217068.480777:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+10:2404:x1868789693138176:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1782217068.480831:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+10:2404:x1868789693138176:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 56us (1716us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217068.480838:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 398 00000100:00080000:3.0:1782217068.481929:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782217068.481940:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:3.0:1782217068.858958:0:13800:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1782217069.048953:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782217069.916888:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217069.916946:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217069.916993:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217069.917129:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693138560 00000100:00100000:1.0:1782217069.917130:0:13731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693138816 00000100:00100000:2.0:1782217069.917143:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693138560 00000100:00100000:1.0:1782217069.917143:0:13731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693138816 00000100:00100000:0.0:1782217069.917231:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693138688 00000100:00100000:0.0:1782217069.917236:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693138688 00000100:00100000:1.0:1782217069.917313:0:13731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 23 00000100:00100000:1.0:1782217069.917326:0:13731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e6f92a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7db73f00-8957-4054-9c9f-ae6b01c2a40a+12:2404:x1868789693138816:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782217069.917346:0:13731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782217069.917372:0:13731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e4121c200/0x92b8e04cbf5f962a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973381 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217069.917394:0:13731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782217069.917465:0:13731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e6f92a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7db73f00-8957-4054-9c9f-ae6b01c2a40a+11:2404:x1868789693138816:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 140us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217069.917473:0:13731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 23 00000100:00100000:2.0:1782217069.919156:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 24 00000100:00100000:2.0:1782217069.919181:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43315c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7db73f00-8957-4054-9c9f-ae6b01c2a40a+11:2403:x1868789693138560:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782217069.919202:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217069.919224:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e413fc600/0x92b8e04cbf5f946a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9732c4 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217069.919508:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217069.919637:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43315c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7db73f00-8957-4054-9c9f-ae6b01c2a40a+10:2403:x1868789693138560:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 466us (2761us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217069.919763:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 24 00000100:00100000:0.0:1782217069.925609:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 25 00000100:00100000:0.0:1782217069.925636:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43316300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+9:2404:x1868789693138688:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782217069.925660:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217069.925685:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e413fde00/0x92b8e04cbf5f9471 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9732f5 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217069.925710:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217069.925800:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43316300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7db73f00-8957-4054-9c9f-ae6b01c2a40a+8:2404:x1868789693138688:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 175us (8804us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217069.925809:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 25 00000100:00100000:2.0:1782217069.933897:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217069.934008:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693139072 00000100:00100000:3.0:1782217069.934021:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693139072 00000100:00100000:3.0:1782217069.934189:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 260 00000100:00100000:3.0:1782217069.934203:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a927f5f6-9735-45e0-abce-963bd125e020+6:2401:x1868789693139072:12345-192.168.203.30@tcp:39:umount.0 00000020:00000080:3.0:1782217069.934287:0:6548:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f947f 00000020:00010000:3.0:1782217069.934306:0:6548:0:(genops.c:1942:obd_stale_export_put()) Put export ffff952d43667000: total 0 00000100:00080000:3.0:1782217069.934311:0:6548:0:(import.c:65:import_set_state_nolock()) ffff952d43665800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782217069.934351:0:6548:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000100:00100000:3.0:1782217069.934575:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a927f5f6-9735-45e0-abce-963bd125e020+5:2401:x1868789693139072:12345-192.168.203.30@tcp:39:umount.0 Request processed in 373us (690us total) trans 4294967530 rc 0/0 00000020:00010000:0.0:1782217069.934581:0:10336:0:(genops.c:1928:obd_stale_export_get()) Get export ffff952d43667000: total 0 00010000:00010000:0.0:1782217069.934673:0:10336:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff952d43667000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1782217069.934717:0:10336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d410a7100) 00010000:00010000:0.0:1782217069.934721:0:10336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782217069.934731:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c600/0x92b8e04cbf5fa43f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97375c expref: 5 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217069.934740:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 260 00010000:00010000:0.0:1782217069.934777:0:10336:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff952d43667000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1782217069.934801:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217069.934803:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217069.934805:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782217069.944477:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217069.944645:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693139200 00000100:00100000:2.0:1782217069.944659:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693139200 00000100:00100000:2.0:1782217069.944730:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 261 00000100:00100000:2.0:1782217069.944742:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43314700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a927f5f6-9735-45e0-abce-963bd125e020+5:2401:x1868789693139200:12345-192.168.203.30@tcp:39:umount.0 00000020:00000080:2.0:1782217069.944804:0:6519:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f9486 00000100:00080000:2.0:1782217069.945088:0:6519:0:(import.c:65:import_set_state_nolock()) ffff952d43666800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782217069.945131:0:6519:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:3.0:1782217069.945274:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782217069.945462:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43314700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a927f5f6-9735-45e0-abce-963bd125e020+3:2401:x1868789693139200:12345-192.168.203.30@tcp:39:umount.0 Request processed in 720us (999us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1782217069.945472:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 261 00000100:00100000:0.0:1782217069.983503:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217069.983744:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693139456 00000100:00100000:2.0:1782217069.983758:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693139456 00000100:00100000:2.0:1782217069.983832:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 399 00000100:00100000:2.0:1782217069.983844:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+7:2401:x1868789693139456:12345-192.168.203.30@tcp:251:umount.0 00000020:00000080:2.0:1782217069.983926:0:6514:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f9344 00000020:00010000:2.0:1782217069.983936:0:6514:0:(genops.c:1942:obd_stale_export_put()) Put export ffff952d435d6000: total 0 00000100:00080000:2.0:1782217069.983942:0:6514:0:(import.c:65:import_set_state_nolock()) ffff952d435d1800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1782217069.984046:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7db73f00-8957-4054-9c9f-ae6b01c2a40a+3:2401:x1868789693139456:12345-192.168.203.30@tcp:251:umount.0 Request processed in 203us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217069.984057:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 399 00000020:00010000:0.0:1782217069.984066:0:6507:0:(genops.c:1928:obd_stale_export_get()) Get export ffff952d435d6000: total 0 00010000:00010000:0.0:1782217069.984073:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217069.984159:0:6507:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff952d435d6000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1782217069.984395:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e7c449c00/0x92b8e04cbf5f9401 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9732b6 expref: 2 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217069.984414:0:6507:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff952d435d6000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1782217069.984434:0:6507:0:(genops.c:906:class_export_put()) final put ffff952d435d6000/7db73f00-8957-4054-9c9f-ae6b01c2a40a 00010000:00010000:2.0:1782217069.984453:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217069.984456:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217069.984458:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782217069.987159:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952d435d6000/7db73f00-8957-4054-9c9f-ae6b01c2a40a for MGS 00000020:00000080:1.0:1782217069.987241:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff952d435d1800 for MGS 00010000:00010000:1.0:1782217070.072973:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782217070.137157:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43315c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789713103232:0@lo:400:kworker.0 00000100:00100000:1.0:1782217070.137272:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217070.137341:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43e93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713103744:0@lo:400:kworker.0 00000100:00100000:1.0:1782217070.137373:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217070.137398:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713104256:0@lo:400:kworker.0 00000100:00100000:1.0:1782217070.137445:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217070.137465:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713104768:0@lo:400:kworker.0 00000100:00100000:1.0:1782217070.137486:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217070.137528:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1782217070.137535:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43fec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1868789713103360:0@lo:400:kworker.0 00000100:00100000:1.0:1782217070.137562:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217070.137620:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43e93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1868789713103872:0@lo:400:kworker.0 00000100:00100000:1.0:1782217070.137643:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217070.137660:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1868789713104384:0@lo:400:kworker.0 00000100:00100000:1.0:1782217070.137682:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217070.137720:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713103744 00000100:00100000:1.0:1782217070.137729:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713103744 00000100:00100000:1.0:1782217070.137793:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1782217070.137804:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c671180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713103744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217070.137811:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713103488:0@lo:400:kworker.0 00000100:00100000:0.0:1782217070.137843:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217070.137863:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1868789713104000:0@lo:400:kworker.0 00000100:00100000:1.0:1782217070.137864:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c671180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713103744:12345-0@lo:400:kworker.0 Request processed in 61us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217070.137871:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1782217070.137881:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217070.137888:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713103488 00000100:00100000:1.0:1782217070.137891:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713103488 00000100:00100000:0.0:1782217070.137895:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1868789713104512:0@lo:400:kworker.0 00000100:00100000:1.0:1782217070.137905:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1782217070.137910:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b303480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713103488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217070.137915:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217070.137927:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1782217070.137933:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43e90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1868789713103616:0@lo:400:kworker.0 00000100:00100000:1.0:1782217070.137937:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b303480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713103488:12345-0@lo:400:kworker.0 Request processed in 26us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217070.137943:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1782217070.137951:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217070.137961:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713104256 00000100:00100000:0.0:1782217070.137962:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713104128:0@lo:400:kworker.0 00000100:00100000:1.0:1782217070.137964:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713104256 00000100:00100000:0.0:1782217070.137995:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217070.138012:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713104768 00000100:00100000:0.0:1782217070.138012:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713104640:0@lo:400:kworker.0 00000100:00100000:1.0:1782217070.138015:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713104768 00000100:00100000:0.0:1782217070.138032:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217070.138035:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713104128 00000100:00100000:1.0:1782217070.138037:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713104128 00000100:00100000:1.0:1782217070.138050:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713104640 00000100:00100000:1.0:1782217070.138051:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713104640 00000100:00100000:1.0:1782217070.138063:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1782217070.138063:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713103488:0@lo:400:kworker.0 00000100:00100000:1.0:1782217070.138068:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c673100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713104256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217070.138099:0:10025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1782217070.138100:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c673100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713104256:12345-0@lo:400:kworker.0 Request processed in 31us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217070.138106:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1782217070.138107:0:10025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c672d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713104768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217070.138116:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1782217070.138121:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b301c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713104128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217070.138136:0:10025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c672d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713104768:12345-0@lo:400:kworker.0 Request processed in 31us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217070.138148:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b301c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713104128:12345-0@lo:400:kworker.0 Request processed in 27us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217070.138152:0:10025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1782217070.138154:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1782217070.138163:0:10025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1782217070.138168:0:10025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b303800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713104640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217070.138208:0:10025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b303800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713104640:12345-0@lo:400:kworker.0 Request processed in 39us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217070.138217:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713103232 00000100:00100000:2.0:1782217070.138431:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43d93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713104896:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782217070.138465:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217070.138497:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43d93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713105152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782217070.138532:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217070.138551:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782217070.138556:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43d92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713105024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782217070.138577:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217070.138718:0:10535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713104896 00000100:00100000:2.0:1782217070.138722:0:10535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713104896 00000100:00100000:2.0:1782217070.138747:0:10535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713105152 00000100:00100000:2.0:1782217070.138750:0:10535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713105152 00000100:00100000:2.0:1782217070.138760:0:10535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713105024 00000100:00100000:2.0:1782217070.138763:0:10535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713105024 00000100:00100000:2.0:1782217070.138776:0:10535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1782217070.138795:0:10535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713104896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782217070.138822:0:10535:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1782217070.138863:0:10535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713104896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217070.138870:0:10535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1782217070.138887:0:10535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1782217070.138893:0:10535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713105152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782217070.138909:0:10535:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782217070.138938:0:10535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713105152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217070.138943:0:10535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1782217070.138956:0:10535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1782217070.138963:0:10535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713105024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782217070.138973:0:10535:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1782217070.138995:0:10535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713105024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 33us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217070.139001:0:10535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1782217070.139036:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43d93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713104896:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782217070.139060:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43d92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713105024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782217070.139071:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43d93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713105152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782217070.139365:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713103360 00000100:00100000:2.0:1782217070.139370:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713103360 00000100:00100000:2.0:1782217070.139393:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713103872 00000100:00100000:2.0:1782217070.139397:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713103872 00000100:00100000:2.0:1782217070.139412:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713104384 00000100:00100000:2.0:1782217070.139421:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713104384 00000100:00100000:2.0:1782217070.139437:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713104000 00000100:00100000:2.0:1782217070.139439:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713104000 00000100:00100000:2.0:1782217070.139455:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713104512 00000100:00100000:2.0:1782217070.139457:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713104512 00000100:00100000:2.0:1782217070.139468:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713103616 00000100:00100000:2.0:1782217070.139471:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713103616 00000100:00100000:2.0:1782217070.139485:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1782217070.139491:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1868789713103360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217070.139540:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1868789713103360:12345-0@lo:400:kworker.0 Request processed in 49us (1977us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217070.139546:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1782217070.139558:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1782217070.139563:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43696d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1868789713103872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217070.139637:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43696d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1868789713103872:12345-0@lo:400:kworker.0 Request processed in 73us (1992us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217070.139643:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1782217070.139670:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1782217070.139677:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4441f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1868789713104384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217070.139714:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4441f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1868789713104384:12345-0@lo:400:kworker.0 Request processed in 37us (2030us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217070.139721:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1782217070.139738:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1782217070.139744:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b302300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1868789713104000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217070.139770:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b302300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1868789713104000:12345-0@lo:400:kworker.0 Request processed in 26us (1888us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217070.139776:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1782217070.139793:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1782217070.139799:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b301880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1868789713104512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217070.139829:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b301880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1868789713104512:12345-0@lo:400:kworker.0 Request processed in 30us (1913us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217070.139835:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1782217070.139847:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1782217070.139852:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b302680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1868789713103616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217070.139879:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b302680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1868789713103616:12345-0@lo:400:kworker.0 Request processed in 27us (1926us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217070.139884:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00080000:2.0:1782217070.139936:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782217070.139940:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782217070.139943:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782217070.139946:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782217070.139993:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43fec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1868789713103360:0@lo:400:kworker.0 00000100:00100000:2.0:1782217070.140006:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43e93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1868789713103872:0@lo:400:kworker.0 00000100:00100000:2.0:1782217070.140017:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1868789713104384:0@lo:400:kworker.0 00000100:00100000:2.0:1782217070.140031:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43e93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713103744:0@lo:400:kworker.0 00000100:00100000:2.0:1782217070.140042:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713104256:0@lo:400:kworker.0 00000100:00100000:2.0:1782217070.140052:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713104768:0@lo:400:kworker.0 00000100:00100000:2.0:1782217070.140122:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43e90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1868789713103616:0@lo:400:kworker.0 00000100:00100000:2.0:1782217070.140133:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713104128:0@lo:400:kworker.0 00000100:00100000:2.0:1782217070.140146:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713104640:0@lo:400:kworker.0 00010000:00080000:2.0:1782217070.140175:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43e90a80 x1868789713104000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782217070.140187:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1868789713104000:0@lo:400:kworker.0 00010000:00080000:2.0:1782217070.140197:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7c6f3100 x1868789713104512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782217070.140206:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1868789713104512:0@lo:400:kworker.0 00000100:00100000:2.0:1782217070.140282:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782217070.140290:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43d93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713105280:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782217070.140326:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217070.140356:0:10535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713105280 00000100:00100000:2.0:1782217070.140361:0:10535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713105280 00000100:00100000:2.0:1782217070.140391:0:10535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1782217070.140397:0:10535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3650:x1868789713105280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782217070.140412:0:10535:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782217070.140444:0:10535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3650:x1868789713105280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217070.140450:0:10535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1782217070.140485:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43d93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713105280:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782217070.141247:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713103232 00000100:00100000:3.0:1782217070.141299:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:3.0:1782217070.141309:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e5258b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3649:x1868789713103232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217070.141575:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e5258b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3649:x1868789713103232:12345-0@lo:400:kworker.0 Request processed in 267us (4302us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217070.141611:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:3.0:1782217070.141674:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43315c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789713103232:0@lo:400:kworker.0 00000100:00100000:0.0:1782217070.142839:0:10025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1782217070.648953:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782217070.658050:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b300380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713105408:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782217070.658168:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217070.658676:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713105408 00000100:00100000:0.0:1782217070.658687:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713105408 00000100:00100000:0.0:1782217070.658747:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1782217070.658758:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4441ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713105408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782217070.658807:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1782217070.658881:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4441ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713105408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 124us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217070.658888:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1782217070.659178:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b300380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713105408:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1782217071.101577:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782217071.679218:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713105536:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782217071.679293:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217071.679399:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713105536 00000100:00100000:0.0:1782217071.679408:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713105536 00000100:00100000:0.0:1782217071.679460:0:7938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1782217071.679469:0:7938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713105536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782217071.679512:0:7938:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1782217071.686866:0:7938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713105536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 7388us (7563us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217071.686882:0:7938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1782217071.687789:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713105536:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1782217072.120989:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1782217072.166070:0:15205:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1782217072.203079:0:15205:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1782217072.203138:0:15205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e413fd200/0x92b8e04cbf5f93f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f93fa expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217072.203154:0:15205:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e413fd200/0x92b8e04cbf5f93f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f93fa expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217072.203163:0:15205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e413fd200/0x92b8e04cbf5f93f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x92b8e04cbf5f93fa expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217072.203182:0:15205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff952e413fd200/0x92b8e04cbf5f93f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x92b8e04cbf5f93fa expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217072.203204:0:15205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1782217072.203210:0:15205:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1782217072.203235:0:15205:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1782217072.203239:0:15205:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1782217072.203244:0:15205:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1782217072.203268:0:15205:0:(import.c:65:import_set_state_nolock()) ffff952e7b0cb000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1782217072.203373:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1868789713105664:0@lo:39:umount.0 00000100:00100000:0.0:1782217072.203441:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782217072.206936:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782217072.206950:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e413fd200/0x92b8e04cbf5f93f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x92b8e04cbf5f93fa expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217072.206980:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e413fd200 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:2.0:1782217072.206984:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e413fd200/0x92b8e04cbf5f93f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x92b8e04cbf5f93fa expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217072.207001:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e413fd200/0x92b8e04cbf5f93f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x92b8e04cbf5f93fa expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782217072.207008:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e413fd200/0x92b8e04cbf5f93f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x92b8e04cbf5f93fa expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782217072.207014:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1782217072.207017:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1782217072.207020:0:6507:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1782217072.207065:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e413fd200/0x92b8e04cbf5f93f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x92b8e04cbf5f93fa expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217072.207072:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782217072.207106:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e413fd200/0x92b8e04cbf5f93f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x92b8e04cbf5f93fa expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217072.207113:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e413fd200/0x92b8e04cbf5f93f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x92b8e04cbf5f93fa expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217072.207123:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1782217072.207130:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217072.207132:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217072.207134:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782217072.207143:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43d93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789713105792:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782217072.207228:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217072.207251:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713105664 00000100:00100000:1.0:1782217072.207259:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713105664 00000100:00100000:1.0:1782217072.207371:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1782217072.207382:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b300a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1868789713105664:12345-0@lo:39:umount.0 00000020:00000080:1.0:1782217072.207407:0:6548:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f8f5b 00000100:00080000:1.0:1782217072.207417:0:6548:0:(import.c:65:import_set_state_nolock()) ffff952e7b2b8800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1782217072.207482:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782217072.207495:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b300a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3646:x1868789713105664:12345-0@lo:39:umount.0 Request processed in 115us (4053us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217072.207512:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:1.0:1782217072.207523:0:6548:0:(genops.c:906:class_export_put()) final put ffff952e7b2bf000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:1.0:1782217072.207577:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952e7b0cb000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1782217072.207606:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1868789713105664:0@lo:39:umount.0 00000020:00000080:0.0:1782217072.207606:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff952e7b2bf000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00080000:1.0:1782217072.207629:0:15205:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1782217072.207632:0:15205:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1782217072.207637:0:15205:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1782217072.207644:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff952e7b2b8800 for lustre-MDT0000 00010000:00010000:1.0:1782217072.208535:0:15205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e413fc000/0x92b8e04cbf5f9408 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f940f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217072.208561:0:15205:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e413fc000/0x92b8e04cbf5f9408 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f940f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217072.208567:0:15205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e413fc000/0x92b8e04cbf5f9408 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x92b8e04cbf5f940f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217072.208573:0:15205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff952e413fc000/0x92b8e04cbf5f9408 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x92b8e04cbf5f940f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217072.208609:0:15205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782217072.208615:0:15205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7c449800/0x92b8e04cbf5f92fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f9305 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217072.208622:0:15205:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7c449800/0x92b8e04cbf5f92fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f9305 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217072.208628:0:15205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7c449800/0x92b8e04cbf5f92fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x92b8e04cbf5f9305 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217072.208635:0:15205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff952e7c449800/0x92b8e04cbf5f92fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x92b8e04cbf5f9305 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217072.208648:0:15205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1782217072.208654:0:15205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e72e2de00/0x92b8e04cbf5f9662 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f9669 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217072.208661:0:15205:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e72e2de00/0x92b8e04cbf5f9662 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f9669 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217072.208677:0:15205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e72e2de00/0x92b8e04cbf5f9662 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x92b8e04cbf5f9669 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217072.208683:0:10336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782217072.208685:0:15205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff952e72e2de00/0x92b8e04cbf5f9662 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x92b8e04cbf5f9669 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217072.208688:0:10336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e413fc000/0x92b8e04cbf5f9408 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x92b8e04cbf5f940f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217072.208695:0:10336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e413fc000 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:0.0:1782217072.208699:0:10336:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e413fc000/0x92b8e04cbf5f9408 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x92b8e04cbf5f940f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217072.208708:0:10336:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e413fc000/0x92b8e04cbf5f9408 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x92b8e04cbf5f940f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782217072.208715:0:10336:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e413fc000/0x92b8e04cbf5f9408 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x92b8e04cbf5f940f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782217072.208719:0:10336:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1782217072.208722:0:10336:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1782217072.208746:0:10336:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e413fc000/0x92b8e04cbf5f9408 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x92b8e04cbf5f940f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217072.208753:0:10336:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782217072.208768:0:10336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e413fc000/0x92b8e04cbf5f9408 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x92b8e04cbf5f940f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217072.208776:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e413fc000/0x92b8e04cbf5f9408 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x92b8e04cbf5f940f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217072.208787:0:10336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782217072.208796:0:10336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e7c449800/0x92b8e04cbf5f92fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x92b8e04cbf5f9305 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217072.208801:0:10336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7c449800 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:0.0:1782217072.208804:0:10336:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e7c449800/0x92b8e04cbf5f92fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x92b8e04cbf5f9305 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217072.208810:0:10336:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e7c449800/0x92b8e04cbf5f92fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x92b8e04cbf5f9305 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782217072.208816:0:10336:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e7c449800/0x92b8e04cbf5f92fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x92b8e04cbf5f9305 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782217072.208821:0:10336:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1782217072.208823:0:10336:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1782217072.208826:0:10336:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1782217072.208840:0:10336:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e7c449800/0x92b8e04cbf5f92fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x92b8e04cbf5f9305 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217072.208846:0:10336:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782217072.208852:0:10336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e7c449800/0x92b8e04cbf5f92fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x92b8e04cbf5f9305 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217072.208858:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e7c449800/0x92b8e04cbf5f92fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x92b8e04cbf5f9305 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217072.208866:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217072.208867:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217072.208869:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782217072.209049:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713105792 00000100:00100000:2.0:1782217072.209056:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713105792 00000100:00100000:2.0:1782217072.209111:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782217072.209121:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b302a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3647:x1868789713105792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782217072.209140:0:8449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217072.209153:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952d43073200/0x92b8e04cbf5f93fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x92b8e04cbf5f93f3 expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217072.209170:0:8449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217072.209225:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b302a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:3647:x1868789713105792:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (1998us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217072.209232:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782217072.209262:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b300380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17bce19a-7a0f-4c9d-b31c-4e0155298487:3650:1868789713106048:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782217072.209296:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217072.209327:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782217072.209333:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b303100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17bce19a-7a0f-4c9d-b31c-4e0155298487:3650:1868789713105920:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782217072.209353:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217072.209378:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713106048 00000100:00100000:2.0:1782217072.209381:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713106048 00000100:00100000:2.0:1782217072.209404:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713105920 00000100:00100000:2.0:1782217072.209407:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713105920 00000100:00100000:2.0:1782217072.209427:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1782217072.209433:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3650:x1868789713106048:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782217072.209646:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782217072.209654:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+24:3650:x1868789713105920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782217072.209669:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217072.209677:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e7c449600/0x92b8e04cbf5f940f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x92b8e04cbf5f9408 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217072.209687:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217072.209728:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17bce19a-7a0f-4c9d-b31c-4e0155298487+23:3650:x1868789713105920:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217072.209735:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:2.0:1782217072.209846:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217072.209856:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e7c448600/0x92b8e04cbf5f9305 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x92b8e04cbf5f92fe expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217072.209865:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217072.209885:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:3650:x1868789713106048:12345-0@lo:103:ldlm_bl.0 Request processed in 453us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217072.209891:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1782217072.209926:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b303100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17bce19a-7a0f-4c9d-b31c-4e0155298487:3650:1868789713105920:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782217072.209941:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b300380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17bce19a-7a0f-4c9d-b31c-4e0155298487:3650:1868789713106048:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782217072.209964:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43d93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789713105792:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782217072.210053:0:15205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782217072.210063:0:15205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e821cfe00/0x92b8e04cbf5f8eba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f8ec1 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217072.210070:0:15205:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e821cfe00/0x92b8e04cbf5f8eba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f8ec1 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217072.210077:0:15205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e821cfe00/0x92b8e04cbf5f8eba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x92b8e04cbf5f8ec1 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217072.210083:0:15205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff952e821cfe00/0x92b8e04cbf5f8eba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x92b8e04cbf5f8ec1 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217072.210109:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782217072.210114:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e72e2de00/0x92b8e04cbf5f9662 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x92b8e04cbf5f9669 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217072.210121:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2de00 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:2.0:1782217072.210124:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e72e2de00/0x92b8e04cbf5f9662 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x92b8e04cbf5f9669 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217072.210132:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e72e2de00/0x92b8e04cbf5f9662 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x92b8e04cbf5f9669 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782217072.210138:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e72e2de00/0x92b8e04cbf5f9662 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x92b8e04cbf5f9669 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782217072.210143:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1782217072.210146:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1782217072.210148:0:6507:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1782217072.210165:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e72e2de00/0x92b8e04cbf5f9662 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x92b8e04cbf5f9669 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217072.210171:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782217072.210195:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e72e2de00/0x92b8e04cbf5f9662 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x92b8e04cbf5f9669 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217072.210202:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e72e2de00/0x92b8e04cbf5f9662 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x92b8e04cbf5f9669 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217072.210222:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782217072.210225:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e821cfe00/0x92b8e04cbf5f8eba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x92b8e04cbf5f8ec1 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217072.210231:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e821cfe00 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:2.0:1782217072.210234:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e821cfe00/0x92b8e04cbf5f8eba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x92b8e04cbf5f8ec1 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217072.210241:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e821cfe00/0x92b8e04cbf5f8eba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x92b8e04cbf5f8ec1 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782217072.210247:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e821cfe00/0x92b8e04cbf5f8eba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x92b8e04cbf5f8ec1 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782217072.210252:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1782217072.210254:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:2.0:1782217072.210277:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e821cfe00/0x92b8e04cbf5f8eba lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x92b8e04cbf5f8ec1 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217072.210283:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782217072.210289:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e821cfe00/0x92b8e04cbf5f8eba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x92b8e04cbf5f8ec1 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217072.210296:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217072.210298:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217072.210300:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782217072.210310:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17bce19a-7a0f-4c9d-b31c-4e0155298487:3648:1868789713106304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782217072.210338:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217072.210366:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782217072.210380:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43d93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17bce19a-7a0f-4c9d-b31c-4e0155298487:3648:1868789713106176:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782217072.210403:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217072.210424:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713106304 00000100:00100000:2.0:1782217072.210428:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713106304 00000100:00100000:2.0:1782217072.210462:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713106176 00000100:00100000:2.0:1782217072.210465:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713106176 00000100:00100000:2.0:1782217072.210480:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1782217072.210485:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17bce19a-7a0f-4c9d-b31c-4e0155298487+22:3648:x1868789713106304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782217072.210493:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217072.210511:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e821cf600/0x92b8e04cbf5f8ec1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x92b8e04cbf5f8eba expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217072.210520:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217072.210543:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17bce19a-7a0f-4c9d-b31c-4e0155298487+21:3648:x1868789713106304:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217072.210548:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1782217072.210559:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782217072.210564:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17bce19a-7a0f-4c9d-b31c-4e0155298487+20:3648:x1868789713106176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782217072.210571:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217072.210579:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952d43072a00/0x92b8e04cbf5f9669 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x92b8e04cbf5f9662 expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217072.210608:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217072.210629:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17bce19a-7a0f-4c9d-b31c-4e0155298487+19:3648:x1868789713106176:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217072.210635:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782217072.210661:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43d93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17bce19a-7a0f-4c9d-b31c-4e0155298487:3648:1868789713106176:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782217072.210668:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:17bce19a-7a0f-4c9d-b31c-4e0155298487:3648:1868789713106304:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782217072.210948:0:15205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1782217072.210954:0:15205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e821cfe00/0x92b8e04cbf5f8eba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x92b8e04cbf5f8ec1 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782217072.210964:0:15205:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:1.0:1782217072.210967:0:15205:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1782217072.210970:0:15205:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1782217072.211000:0:15205:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1782217072.211004:0:15205:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1782217072.211008:0:15205:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782217072.211018:0:15205:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:1.0:1782217072.211022:0:15205:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff952e7b2be800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1782217072.211027:0:15205:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff952e7c510000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1782217072.211031:0:15205:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff952e7396f800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1782217072.211035:0:15205:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff952e7396a800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:1.0:1782217072.211041:0:15205:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff952d43667000 a927f5f6-9735-45e0-abce-963bd125e020 192.168.203.30@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1782217072.211046:0:15205:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff952d435d5000 24a87249-c61f-41a1-85ec-9a313129e739 192.168.203.30@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967524 stale:0 00000020:00080000:1.0:1782217072.211050:0:15205:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff952e46db8000) has exports, disconnecting them 00000020:00080000:1.0:1782217072.211054:0:15205:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff952e7b2be800), last request at 1782217070 00000020:00000080:1.0:1782217072.211060:0:15205:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f9279 00000100:00080000:1.0:1782217072.211074:0:15205:0:(import.c:65:import_set_state_nolock()) ffff952e7b2bb000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1782217072.211094:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1782217072.211185:0:15205:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff952e7b2be800): rc 0 00000020:00000080:1.0:1782217072.211188:0:15205:0:(genops.c:906:class_export_put()) final put ffff952e7b2be800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1782217072.211206:0:15205:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff952e7c510000), last request at 1782217070 00000020:00000080:1.0:1782217072.211210:0:15205:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f9145 00000100:00080000:1.0:1782217072.211216:0:15205:0:(import.c:65:import_set_state_nolock()) ffff952e7c517000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1782217072.211245:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952e7b2be800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1782217072.211290:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff952e7b2bb000 for lustre-MDT0000 00010000:00010000:0.0:1782217072.211345:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217072.215080:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217072.215426:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1782217072.215473:0:15205:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff952e7c510000): rc 0 00000020:00000080:1.0:1782217072.215477:0:15205:0:(genops.c:906:class_export_put()) final put ffff952e7c510000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1782217072.215494:0:15205:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff952e7396f800), last request at 1782216841 00000020:00000080:1.0:1782217072.215512:0:15205:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f9042 00000100:00080000:1.0:1782217072.215521:0:15205:0:(import.c:65:import_set_state_nolock()) ffff952e73969000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1782217072.215544:0:15205:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff952e7396f800): rc 0 00000020:00000080:1.0:1782217072.215546:0:15205:0:(genops.c:906:class_export_put()) final put ffff952e7396f800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1782217072.215551:0:15205:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff952e7396a800), last request at 1782216841 00000020:00000080:1.0:1782217072.215554:0:15205:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f9003 00000100:00080000:1.0:1782217072.215557:0:15205:0:(import.c:65:import_set_state_nolock()) ffff952e73968800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1782217072.215604:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff952e7c510000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1782217072.215646:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff952e7396f800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1782217072.215671:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff952e7c517000 for lustre-MDT0000 00000020:00000080:2.0:1782217072.215675:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff952e73969000 for lustre-MDT0000 00010000:00010000:3.0:1782217072.215885:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1782217072.216138:0:15205:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967530 00000020:00080000:1.0:1782217072.216524:0:15205:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff952e7396a800): rc 0 00000004:00000080:1.0:1782217072.216532:0:15205:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa4bf885c3ae0 00010000:00010000:0.0:1782217072.216534:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1782217072.216551:0:15205:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1782217072.216555:0:15205:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00080000:1.0:1782217072.219726:0:15205:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1782217072.219760:0:15205:0:(import.c:65:import_set_state_nolock()) ffff952e7b2cc800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1782217072.219858:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1868789713106432:0@lo:39:umount.0 00000100:00100000:0.0:1782217072.219929:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217072.220026:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713106432 00000100:00100000:1.0:1782217072.220035:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713106432 00000100:00100000:1.0:1782217072.220087:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1782217072.220096:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b300380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1868789713106432:12345-0@lo:39:umount.0 00000020:00000080:1.0:1782217072.220124:0:6523:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f90b2 00000100:00080000:1.0:1782217072.220132:0:6523:0:(import.c:65:import_set_state_nolock()) ffff952e7c5cc000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782217072.220163:0:6523:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1782217072.220302:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b300380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3646:x1868789713106432:12345-0@lo:39:umount.0 Request processed in 207us (373us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1782217072.220310:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00080000:0.0:1782217072.220381:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952e7b2cc800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1782217072.220389:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1868789713106432:0@lo:39:umount.0 00010000:00010000:2.0:1782217072.220434:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1782217072.221787:0:15205:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1782217072.221793:0:15205:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:1.0:1782217072.221809:0:15205:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1782217072.221866:0:15205:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1782217072.221885:0:15205:0:(import.c:65:import_set_state_nolock()) ffff952e7c6c9800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1782217072.222033:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1868789713106560:0@lo:9:umount.0 00000100:00100000:0.0:1782217072.222082:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1782217072.222123:0:15205:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1782217072.222125:0:15205:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:1.0:1782217072.222139:0:15205:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1782217072.222196:0:15205:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1782217072.222212:0:15205:0:(import.c:65:import_set_state_nolock()) ffff952d430f9800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1782217072.222249:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713106560 00000100:00100000:2.0:1782217072.222255:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713106560 00000100:00100000:2.0:1782217072.222314:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1782217072.222324:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b303100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1868789713106560:12345-0@lo:9:umount.0 00000020:00000080:2.0:1782217072.222346:0:8435:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f91fb 00000100:00080000:2.0:1782217072.222353:0:8435:0:(import.c:65:import_set_state_nolock()) ffff952d42003800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782217072.222393:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00080000:3.0:1782217072.222542:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782217072.222711:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1868789713106688:0@lo:9:umount.0 00000100:00100000:0.0:1782217072.222740:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217072.222808:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713106688 00000100:00100000:3.0:1782217072.222813:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713106688 00000100:00100000:3.0:1782217072.222849:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1782217072.222856:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1868789713106688:12345-0@lo:9:umount.0 00000020:00000080:3.0:1782217072.222870:0:8432:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f932f 00000100:00080000:3.0:1782217072.222889:0:8432:0:(import.c:65:import_set_state_nolock()) ffff952d435d4000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782217072.222921:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1782217072.223011:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3646:x1868789713106688:12345-0@lo:9:umount.0 Request processed in 155us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217072.223018:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1782217072.223037:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1782217072.223044:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1782217072.223269:0:15205:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff952e46db8000) has no exports 00000100:00100000:2.0:1782217072.223436:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b303100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3646:x1868789713106560:12345-0@lo:9:umount.0 Request processed in 1113us (1352us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217072.223452:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00010000:2.0:1782217072.223472:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782217072.223978:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952e7c6c9800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1782217072.224026:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1782217072.224468:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1782217072.224474:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1868789713106560:0@lo:9:umount.0 00000100:00080000:0.0:1782217072.224516:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952d430f9800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1782217072.224532:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1782217072.224535:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1782217072.224538:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1868789713106688:0@lo:9:umount.0 00000020:00080000:1.0:1782217072.237220:0:15205:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff952e46db8000) has no exports 00000020:00000080:1.0:1782217072.278578:0:15205:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f8f15 00000020:00000080:1.0:1782217072.278765:0:15205:0:(genops.c:906:class_export_put()) final put ffff952e7b0c8800/lustre-QMT0000_UUID 00000020:01000000:1.0:1782217072.278818:0:15205:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1782217072.278893:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952e7b0c8800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1782217072.278917:0:15205:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782217072.278926:0:15205:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1782217072.278930:0:15205:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff952e64e1b380) has no exports 00000020:00000080:0.0:1782217072.279219:0:15205:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f8f0e 00000020:00000080:0.0:1782217072.279224:0:15205:0:(genops.c:906:class_export_put()) final put ffff952e7b07b000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1782217072.279328:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952e7b07b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1782217072.279388:0:15205:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782217072.279396:0:15205:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1782217072.279399:0:15205:0:(genops.c:906:class_export_put()) final put ffff952e46d58000/lustre-QMT0000_UUID 00000020:00000080:0.0:1782217072.279401:0:15205:0:(genops.c:865:class_export_destroy()) destroying export ffff952e46d58000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1782217072.279405:0:15205:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:0.0:1782217073.144740:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1782217073.213338:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1782217073.213348:0:9512:0:(genops.c:906:class_export_put()) final put ffff952d435d3000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1782217073.213368:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 24a87249-c61f-41a1-85ec-9a313129e739 00000020:00000080:3.0:1782217073.213371:0:9512:0:(genops.c:906:class_export_put()) final put ffff952d43719800/24a87249-c61f-41a1-85ec-9a313129e739 00000020:00000080:0.0:1782217073.213758:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952d435d3000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1782217073.213818:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952d43719800/24a87249-c61f-41a1-85ec-9a313129e739 for lustre-OST0001 00000020:00000080:0.0:1782217073.213833:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff952d435d4000 for lustre-OST0001 00000020:00000080:0.0:1782217073.213838:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff952d4371e000 for lustre-OST0001 00000001:00100000:0.0:1782217073.216039:0:6498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1782217073.216049:0:6498:0:(genops.c:906:class_export_put()) final put ffff952e7396a800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1782217073.216073:0:6498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a927f5f6-9735-45e0-abce-963bd125e020 00000001:00080000:0.0:1782217073.216082:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967530 is committed 00000020:00000080:0.0:1782217073.216085:0:6498:0:(genops.c:906:class_export_put()) final put ffff952d43667000/a927f5f6-9735-45e0-abce-963bd125e020 00000001:00100000:0.0:1782217073.216095:0:6498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 24a87249-c61f-41a1-85ec-9a313129e739 00000001:00080000:0.0:1782217073.216100:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967529 is committed 00000020:00000080:0.0:1782217073.216109:0:6498:0:(genops.c:906:class_export_put()) final put ffff952d435d5000/24a87249-c61f-41a1-85ec-9a313129e739 00000020:00000080:2.0:1782217073.216170:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff952e7396a800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1782217073.216229:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff952d43667000/a927f5f6-9735-45e0-abce-963bd125e020 for lustre-MDT0000 00000020:00000080:2.0:1782217073.216249:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff952d435d5000/24a87249-c61f-41a1-85ec-9a313129e739 for lustre-MDT0000 00000020:00000080:2.0:1782217073.216278:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff952e73968800 for lustre-MDT0000 00000020:00000080:2.0:1782217073.216283:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff952d43665800 for lustre-MDT0000 00000020:00000080:2.0:1782217073.216286:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff952d435d7800 for lustre-MDT0000 00000001:00100000:3.0:1782217073.731095:0:8428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1782217073.731105:0:8428:0:(genops.c:906:class_export_put()) final put ffff952d42004000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1782217073.731131:0:8428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 24a87249-c61f-41a1-85ec-9a313129e739 00000020:00000080:3.0:1782217073.731134:0:8428:0:(genops.c:906:class_export_put()) final put ffff952e481cd000/24a87249-c61f-41a1-85ec-9a313129e739 00000020:00000080:0.0:1782217073.731191:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952d42004000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1782217073.731246:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952e481cd000/24a87249-c61f-41a1-85ec-9a313129e739 for lustre-OST0000 00000020:00000080:0.0:1782217073.731265:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff952d42003800 for lustre-OST0000 00000020:00000080:0.0:1782217073.731270:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff952e481cc000 for lustre-OST0000 00010000:00010000:2.0:1782217074.168835:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1782217074.235518:0:7451:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1782217074.235536:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:1.0:1782217074.235543:0:7451:0:(genops.c:906:class_export_put()) final put ffff952e7c5c9000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1782217074.235565:0:7451:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a927f5f6-9735-45e0-abce-963bd125e020 00000001:00080000:1.0:1782217074.235571:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:1.0:1782217074.235574:0:7451:0:(genops.c:906:class_export_put()) final put ffff952d43663000/a927f5f6-9735-45e0-abce-963bd125e020 00000001:00100000:1.0:1782217074.235597:0:7451:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 24a87249-c61f-41a1-85ec-9a313129e739 00000020:00000080:3.0:1782217074.235606:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff952e7c5c9000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000001:00080000:1.0:1782217074.235607:0:7451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:1.0:1782217074.235609:0:7451:0:(genops.c:906:class_export_put()) final put ffff952d436dc800/24a87249-c61f-41a1-85ec-9a313129e739 00000020:00000080:3.0:1782217074.236044:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff952d43663000/a927f5f6-9735-45e0-abce-963bd125e020 for lustre-MDT0001 00000020:00000080:3.0:1782217074.236069:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff952d436dc800/24a87249-c61f-41a1-85ec-9a313129e739 for lustre-MDT0001 00000020:00000080:3.0:1782217074.236092:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff952e7c5cc000 for lustre-MDT0001 00000020:00000080:3.0:1782217074.236097:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff952d43666800 for lustre-MDT0001 00000020:00000080:3.0:1782217074.236100:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff952d436dd800 for lustre-MDT0001 00000020:01000000:0.0:1782217074.296708:0:15205:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff952e7c4ac720 - data ffff952e65339a20/ffff952d435f4000 00000020:01000000:0.0:1782217074.296938:0:15205:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff952e460e6000 - data ffff952e6514b6c0/ffff952e7b077000 00000001:00000004:0.0:1782217074.304016:0:15205:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967530 00000100:00080000:1.0:1782217074.374729:0:15205:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1782217074.374738:0:15205:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:1.0:1782217074.374751:0:15205:0:(client.c:3149:ptlrpc_free_committed()) @@@ free request with old gen req@ffff952d4441e680 x1868789713106432/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1782217082 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782217074.374773:0:15205:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1782217074.377691:0:15205:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1782217074.377699:0:15205:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:1.0:1782217074.377757:0:15205:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1782217074.377767:0:15205:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1782217074.380500:0:8536:0:(osp_sync.c:1339:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1782217074.380509:0:8536:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:2.0:1782217074.380519:0:8536:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1782217074.381243:0:15205:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1782217074.381249:0:15205:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:1.0:1782217074.381271:0:15205:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1782217074.381273:0:15205:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1782217074.381446:0:10020:0:(osp_sync.c:1339:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1782217074.381449:0:10020:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1782217074.381458:0:10020:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1782217074.394693:0:15205:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f8edd 00000020:00000080:1.0:1782217074.394718:0:15205:0:(genops.c:906:class_export_put()) final put ffff952e64e4c800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1782217074.394862:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952e64e4c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1782217074.397635:0:15205:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f8ef2 00000020:00000080:1.0:1782217074.397650:0:15205:0:(genops.c:906:class_export_put()) final put ffff952e64e4a000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1782217074.397664:0:15205:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1782217074.397669:0:15205:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782217074.397678:0:15205:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1782217074.397681:0:15205:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff952e46dbb380) has no exports 00000004:01000000:1.0:1782217074.397856:0:15205:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1782217074.397865:0:15205:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f9328 00000020:00000080:1.0:1782217074.397869:0:15205:0:(genops.c:906:class_export_put()) final put ffff952d435d2000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1782217074.397873:0:15205:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1782217074.397876:0:15205:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782217074.397886:0:15205:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1782217074.397889:0:15205:0:(genops.c:1579:class_disconnect_exports()) OBD device 28 (ffff952d43344d40) has no exports 00000020:00000080:1.0:1782217074.397894:0:15205:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f9321 00000020:00000080:1.0:1782217074.397897:0:15205:0:(genops.c:906:class_export_put()) final put ffff952d435d7000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1782217074.398229:0:15205:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1782217074.398234:0:15205:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1782217074.398239:0:15205:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:1.0:1782217074.398244:0:15205:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1782217074.398246:0:15205:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1782217074.398280:0:15205:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782217074.398288:0:15205:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1782217074.398293:0:15205:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f91e6 00000020:00000080:1.0:1782217074.398297:0:15205:0:(genops.c:906:class_export_put()) final put ffff952d42002000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1782217074.398301:0:15205:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1782217074.398304:0:15205:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782217074.398308:0:15205:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1782217074.398310:0:15205:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff952e74c80000) has no exports 00000020:00000080:1.0:1782217074.398314:0:15205:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f91df 00000020:00000080:1.0:1782217074.398317:0:15205:0:(genops.c:906:class_export_put()) final put ffff952e7c6ce000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1782217074.398648:0:15205:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1782217074.398659:0:15205:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1782217074.398661:0:15205:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:1.0:1782217074.398665:0:15205:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1782217074.398666:0:15205:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1782217074.398688:0:15205:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782217074.398693:0:15205:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1782217074.398702:0:15205:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1782217074.398707:0:15205:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f90ab 00000020:00000080:1.0:1782217074.398711:0:15205:0:(genops.c:906:class_export_put()) final put ffff952e7c511000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1782217074.398714:0:15205:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1782217074.398717:0:15205:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782217074.398721:0:15205:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1782217074.398723:0:15205:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff952e7397b380) has no exports 00000020:00000080:1.0:1782217074.398727:0:15205:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f90a4 00000020:00000080:1.0:1782217074.398729:0:15205:0:(genops.c:906:class_export_put()) final put ffff952e7b2cd800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1782217074.399530:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952e64e4a000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1782217074.399541:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952d435d2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1782217074.399546:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952d435d7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1782217074.399551:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff952d430f9800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1782217074.399557:0:36:0:(genops.c:906:class_export_put()) final put ffff952d435d4800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1782217074.399559:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952d435d4800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1782217074.399563:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1782217074.399659:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952d42002000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1782217074.399665:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952e7c6ce000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1782217074.399669:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff952e7c6c9800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1782217074.399673:0:36:0:(genops.c:906:class_export_put()) final put ffff952e7c6cf800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1782217074.399675:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952e7c6cf800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1782217074.399678:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1782217074.399708:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952e7c511000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1782217074.399712:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952e7b2cd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1782217074.437329:0:15205:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1782217074.437338:0:15205:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1782217074.437343:0:15205:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:1.0:1782217074.437352:0:15205:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1782217074.437432:0:15205:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782217074.437446:0:15205:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1782217074.437471:0:15205:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782217074.437474:0:15205:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1782217074.437479:0:15205:0:(genops.c:906:class_export_put()) final put ffff952e64e4a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1782217074.437493:0:15205:0:(genops.c:865:class_export_destroy()) destroying export ffff952e64e4a800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1782217074.437503:0:15205:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1782217074.437635:0:15205:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f8ef9 00000020:00000080:1.0:1782217074.437642:0:15205:0:(genops.c:906:class_export_put()) final put ffff952e64e4c000/lustre-MDD0000_UUID 00000020:00000080:2.0:1782217074.437750:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff952e7b2cc800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1782217074.437757:0:36:0:(genops.c:906:class_export_put()) final put ffff952e7b2b9000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1782217074.437860:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952e7b2b9000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1782217074.437869:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1782217074.437984:0:15205:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1782217074.437989:0:15205:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782217074.437995:0:15205:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1782217074.437999:0:15205:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff952e46db99c0) has no exports 00000020:00000080:1.0:1782217074.438030:0:15205:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782217074.438034:0:15205:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1782217074.438039:0:15205:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f8f00 00000020:00000080:1.0:1782217074.438043:0:15205:0:(genops.c:906:class_export_put()) final put ffff952e64e4b800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1782217074.438066:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952e64e4c000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1782217074.438070:0:36:0:(genops.c:906:class_export_put()) final put ffff952e64e48000/lustre-MDD0000_UUID 00000020:00000080:2.0:1782217074.438072:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952e64e48000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1782217074.438076:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:1.0:1782217074.438167:0:15205:0:(tgt_mount.c:187:server_put_mount()) put mount ffff952e70905800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1782217074.438171:0:15205:0:(obd_mount.c:701:lustre_put_lsi()) put ffff952e70905800 3 00000020:01000004:1.0:1782217074.438175:0:15205:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff952e70905800 from lustre-MDT0000 00000020:00000080:1.0:1782217074.438193:0:15205:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782217074.438197:0:15205:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1782217074.438200:0:15205:0:(genops.c:906:class_export_put()) final put ffff952e64e48800/lustre-MDT0000_UUID 00000020:00000080:1.0:1782217074.438202:0:15205:0:(genops.c:865:class_export_destroy()) destroying export ffff952e64e48800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1782217074.438208:0:15205:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1782217074.438240:0:15205:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1782217074.438244:0:15205:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1782217074.438246:0:15205:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1782217074.438249:0:15205:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782217074.438251:0:15205:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1782217074.438257:0:15205:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff952e64e6a800 17bce19a-7a0f-4c9d-b31c-4e0155298487 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1782217074.438263:0:15205:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff952e5021cd40) has exports, disconnecting them 00000020:00080000:1.0:1782217074.438267:0:15205:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff952e64e6a800), last request at 1782216824 00000020:00000080:1.0:1782217074.438280:0:15205:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f8e9e 00000020:00010000:1.0:1782217074.438284:0:15205:0:(genops.c:1942:obd_stale_export_put()) Put export ffff952e64e6a800: total 1 00000100:00080000:1.0:1782217074.438288:0:15205:0:(import.c:65:import_set_state_nolock()) ffff952e64e68800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1782217074.438305:0:15205:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff952e64e6a800): rc 0 00000020:00080000:1.0:1782217074.438309:0:15205:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff952e5021cd40) has no exports 00000100:00100000:1.0:1782217074.438358:0:6511:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff952e501b6400:6511] 0 exiting: rc = 1 00000100:00100000:3.0:1782217074.438506:0:6513:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff952e501b6c00:6513] 1 exiting: rc = 0 00000100:00100000:3.0:1782217074.438578:0:6514:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff952e589df000:6514] 2 exiting: rc = 0 00000020:00010000:3.0:1782217074.438643:0:10337:0:(genops.c:1928:obd_stale_export_get()) Get export ffff952e64e6a800: total 1 00010000:00010000:3.0:1782217074.438678:0:10337:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff952e64e6a800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1782217074.438705:0:10337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e72e2ce00/0x92b8e04cbf5f963f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x92b8e04cbf5f9638 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217074.438721:0:10337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e7c448e00/0x92b8e04cbf5f93d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x92b8e04cbf5f93c9 expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217074.438740:0:10337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e4121d200/0x92b8e04cbf5f964d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x92b8e04cbf5f9646 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217074.438748:0:10337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e7c448400/0x92b8e04cbf5f93b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x92b8e04cbf5f93ad expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217074.438757:0:10337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e413fcc00/0x92b8e04cbf5f8fa8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x92b8e04cbf5f8fa1 expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217074.439066:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439075:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439083:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439089:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439094:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439100:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439114:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439120:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439125:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439131:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439135:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439140:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439146:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439151:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439155:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439160:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439165:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439171:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439176:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439182:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439187:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439192:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439197:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439202:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439208:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439213:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439219:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439227:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439233:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439239:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439245:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439250:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439255:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439260:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439266:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439272:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439279:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439285:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439290:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439296:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439301:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439314:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439319:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439325:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439331:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439336:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439340:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439345:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439349:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439355:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439359:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439366:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439372:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439376:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439380:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439387:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439391:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439396:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439400:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439406:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439411:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439416:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439421:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217074.439426:0:15205:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1782217074.440327:0:10337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e7c449000/0x92b8e04cbf5f93c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x92b8e04cbf5f93bb expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217074.440339:0:10337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e7c448200/0x92b8e04cbf5f939f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x92b8e04cbf5f9398 expref: 8 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217074.440350:0:10337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e7c449400/0x92b8e04cbf5f93de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x92b8e04cbf5f93d7 expref: 7 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217074.440360:0:10337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e7c449e00/0x92b8e04cbf5f941d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x92b8e04cbf5f9416 expref: 6 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217074.440371:0:10337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e72e2d600/0x92b8e04cbf5f965b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x92b8e04cbf5f9654 expref: 5 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217074.440382:0:10337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e413fc800/0x92b8e04cbf5f93ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x92b8e04cbf5f93e5 expref: 4 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217074.440393:0:10337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e41680c00/0x92b8e04cbf5f92bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x92b8e04cbf5f92b8 expref: 3 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217074.440419:0:10337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e41681c00/0x92b8e04cbf5f8f9a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x92b8e04cbf5f8f93 expref: 2 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217074.440430:0:10337:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff952e64e6a800, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1782217074.440454:0:10337:0:(genops.c:906:class_export_put()) final put ffff952e64e6a800/17bce19a-7a0f-4c9d-b31c-4e0155298487 00000020:00000080:2.0:1782217074.441047:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952e64e4b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1782217074.441151:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217074.441154:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217074.441156:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782217074.441263:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952e64e6a800/17bce19a-7a0f-4c9d-b31c-4e0155298487 for MGS 00000020:00000080:3.0:1782217074.441342:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff952e64e68800 for MGS 00000020:01000000:1.0:1782217074.441415:0:15205:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff952e7c4ac300 - data ffff952e65339af8/ffff952d435f5000 00000020:01000000:1.0:1782217074.441552:0:15205:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff952e460e6ba0 - data ffff952e65094870/ffff952e5258e000 00000020:00000080:1.0:1782217074.442353:0:15205:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f8e82 00000020:00000080:1.0:1782217074.442362:0:15205:0:(genops.c:906:class_export_put()) final put ffff952e6f927000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1782217074.442420:0:15205:0:(tgt_mount.c:187:server_put_mount()) put mount ffff952e70905800 from MGS, refs=2 00000020:01000004:1.0:1782217074.442424:0:15205:0:(obd_mount.c:701:lustre_put_lsi()) put ffff952e70905800 2 00000020:01000004:1.0:1782217074.442427:0:15205:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff952e70905800 from MGS 00000020:00000080:1.0:1782217074.442445:0:15205:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782217074.442452:0:15205:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1782217074.442455:0:15205:0:(genops.c:906:class_export_put()) final put ffff952e6f926800/MGS 00000020:00000080:1.0:1782217074.442457:0:15205:0:(genops.c:865:class_export_destroy()) destroying export ffff952e6f926800/MGS for MGS 00000020:01000000:1.0:1782217074.442463:0:15205:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1782217074.442545:0:15205:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1782217074.442550:0:15205:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782217074.442555:0:15205:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1782217074.442681:0:15205:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff952e7b0cd800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1782217074.442687:0:15205:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff952e46dbcd40) has exports, disconnecting them 00000020:00080000:1.0:1782217074.442691:0:15205:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff952e7b0cd800), last request at 1782216824 00000020:00000080:1.0:1782217074.442695:0:15205:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f8f4d 00000020:00080000:1.0:1782217074.442704:0:15205:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff952e7b0cd800): rc 0 00000020:00000080:1.0:1782217074.442708:0:15205:0:(genops.c:906:class_export_put()) final put ffff952e7b0cd800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1782217074.442738:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952e6f927000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1782217074.443701:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952e7b0cd800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1782217074.457497:0:15205:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1782217074.457506:0:15205:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1782217074.457511:0:15205:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1782217074.457518:0:15205:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1782217074.457920:0:15205:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782217074.457930:0:15205:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1782217074.457937:0:15205:0:(obd_mount.c:701:lustre_put_lsi()) put ffff952e70905800 1 00000020:00000080:1.0:1782217074.457944:0:15205:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f8e74 00000020:00000080:1.0:1782217074.457954:0:15205:0:(genops.c:906:class_export_put()) final put ffff952e6f922800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1782217074.458010:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff952e7b0cb000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1782217074.458017:0:36:0:(genops.c:906:class_export_put()) final put ffff952e7b0ce800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1782217074.458020:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952e7b0ce800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1782217074.458026:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:1.0:1782217074.458179:0:15205:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1782217074.458184:0:15205:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782217074.458189:0:15205:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1782217074.458193:0:15205:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff952e64e1cd40) has no exports 00000020:00000080:3.0:1782217074.460320:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952e6f922800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1782217074.534072:0:15205:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782217074.534086:0:15205:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1782217074.534092:0:15205:0:(genops.c:906:class_export_put()) final put ffff952e70905000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1782217074.534097:0:15205:0:(genops.c:865:class_export_destroy()) destroying export ffff952e70905000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1782217074.534103:0:15205:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1782217074.534218:0:15205:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff952e70903000 00000020:02000400:3.0:1782217074.534289:0:15205:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1782217075.192761:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782217075.260110:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43e90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713106816:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782217075.260183:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217075.260263:0:10535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713106816 00000100:00100000:0.0:1782217075.260270:0:10535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713106816 00000100:00100000:0.0:1782217075.260322:0:10535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1782217075.260331:0:10535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713106816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782217075.260360:0:10535:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782217075.260408:0:10535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713106816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217075.260416:0:10535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:0.0:1782217075.260439:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782217075.260493:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43e90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713106816:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782217075.262737:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43e93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713107200:0@lo:400:kworker.0 00000100:00100000:0.0:1782217075.262779:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713107072:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782217075.262806:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217075.262824:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217075.262859:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713107712:0@lo:400:kworker.0 00000100:00100000:0.0:1782217075.262864:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1868789713107584:0@lo:400:kworker.0 00000100:00100000:0.0:1782217075.262898:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217075.262912:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217075.262938:0:7938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713107200 00000100:00100000:0.0:1782217075.262945:0:7938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713107200 00000100:00100000:3.0:1782217075.262967:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713107072 00000100:00100000:3.0:1782217075.262973:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713107072 00000100:00100000:3.0:1782217075.263014:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1782217075.263022:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713107072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782217075.263048:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1782217075.263096:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713107072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217075.263103:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1782217075.263125:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1868789713107328:0@lo:400:kworker.0 00000100:00100000:3.0:1782217075.263156:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217075.263178:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1868789713107840:0@lo:400:kworker.0 00000100:00100000:1.0:1782217075.263188:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1782217075.263196:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1868789713107200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217075.263203:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1782217075.263207:0:6523:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1782217075.263224:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1782217075.263233:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43e90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789713106944:0@lo:400:kworker.0 00000100:00100000:1.0:1782217075.263253:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1868789713107200:12345-0@lo:400:kworker.0 Request processed in 56us (447us total) trans 0 rc -107/-107 00000400:00000100:3.0:1782217075.263258:0:3649:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1868789713106944 offset 0 length 224: 4 00000100:00100000:1.0:1782217075.263266:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1782217075.263284:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1868789713107456:0@lo:400:kworker.0 00000100:00100000:0.0:1782217075.263330:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713107584 00000100:00100000:0.0:1782217075.263335:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713107584 00000100:00100000:0.0:1782217075.263362:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713107328 00000100:00100000:0.0:1782217075.263364:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713107328 00000100:00100000:0.0:1782217075.263372:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713107840 00000100:00100000:0.0:1782217075.263374:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713107840 00000100:00100000:0.0:1782217075.263393:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1782217075.263399:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1868789713107584:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1782217075.263435:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1782217075.263446:0:3648:0:(import.c:65:import_set_state_nolock()) ffff952e749e9000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1782217075.263450:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1782217075.267971:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217075.268011:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1868789713107968:0@lo:400:kworker.0 00000100:00100000:3.0:1782217075.268286:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217075.268330:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713107456 00000100:00100000:3.0:1782217075.268338:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713107456 00000100:00100000:3.0:1782217075.268364:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713107968 00000100:00100000:3.0:1782217075.268367:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713107968 00000100:00100000:3.0:1782217075.268394:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1782217075.268402:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1868789713107968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217075.268488:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1868789713107968:12345-0@lo:400:kworker.0 Request processed in 75us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217075.268497:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1782217075.268516:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1782217075.268521:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1868789713107328:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1782217075.268528:0:6520:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1782217075.268769:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1868789713107584:12345-0@lo:400:kworker.0 Request processed in 5368us (5868us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217075.268778:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1782217075.268797:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1782217075.268802:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1868789713107840:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1782217075.268809:0:6519:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1782217075.268835:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1868789713107328:12345-0@lo:400:kworker.0 Request processed in 311us (5676us total) trans 0 rc -107/-107 00000100:00100000:0.0:1782217075.268844:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1868789713107840:12345-0@lo:400:kworker.0 Request processed in 39us (5641us total) trans 0 rc -107/-107 00000100:00100000:3.0:1782217075.268845:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1782217075.268856:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1782217075.268868:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1782217075.268875:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1868789713107456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217075.268886:0:10025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713107712 00000100:00100000:0.0:1782217075.268891:0:10025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713107712 00000100:00100000:0.0:1782217075.268920:0:10025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1782217075.268926:0:10025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713107712:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1782217075.268946:0:6520:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1782217075.268959:0:10025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713107712:12345-0@lo:400:kworker.0 Request processed in 32us (6049us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217075.268966:0:10025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1782217075.268983:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1868789713107456:12345-0@lo:400:kworker.0 Request processed in 107us (1432us total) trans 0 rc -107/-107 00000100:00100000:3.0:1782217075.268991:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:0.0:1782217075.269009:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782217075.269016:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782217075.269033:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1782217075.269039:0:3649:0:(import.c:65:import_set_state_nolock()) ffff952d42006800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00100000:0.0:1782217075.269057:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713107072:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1782217075.269072:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff952d41be4a80 x1868789713107584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782217075.269083:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1868789713107584:0@lo:400:kworker.0 00000100:02000400:3.0:1782217075.269201:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1782217075.269207:0:3649:0:(import.c:65:import_set_state_nolock()) ffff952d42006800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782217075.269211:0:3649:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 221 00000100:00080000:3.0:1782217075.269218:0:3649:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff952d42006800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1782217075.269243:0:3649:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff952e7c6f2300 x1868789713108096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782217075.269273:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1868789713107456:0@lo:400:kworker.0 00010000:00080000:3.0:1782217075.269288:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff952d41be6d80 x1868789713107968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217075.269304:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1868789713107968:0@lo:400:kworker.0 00000100:00080000:3.0:1782217075.269316:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1782217075.269320:0:3649:0:(import.c:65:import_set_state_nolock()) ffff952e74b7b800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1782217075.269323:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1782217075.269326:0:3649:0:(import.c:65:import_set_state_nolock()) ffff952e74b7b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782217075.269329:0:3649:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 204 00000100:00080000:3.0:1782217075.269332:0:3649:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff952e74b7b800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1782217075.269344:0:3649:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff952e7c6f3800 x1868789713108224/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782217075.269354:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1868789713107328:0@lo:400:kworker.0 00000100:00080000:3.0:1782217075.269365:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1782217075.269368:0:3649:0:(import.c:65:import_set_state_nolock()) ffff952d430ff800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1782217075.269371:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1782217075.269373:0:3649:0:(import.c:65:import_set_state_nolock()) ffff952d430ff800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782217075.269376:0:3649:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 244 00000100:00080000:3.0:1782217075.269380:0:3649:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff952d430ff800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1782217075.269391:0:3649:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff952e7c6f3b80 x1868789713108352/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782217075.269399:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1868789713107840:0@lo:400:kworker.0 00000100:00100000:0.0:1782217075.269434:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1868789713108096:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1782217075.269469:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217075.269528:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1868789713108224:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1782217075.269563:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217075.269578:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1868789713108352:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1782217075.269622:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217075.269654:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713108096 00000100:00100000:0.0:1782217075.269658:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713108096 00000100:00100000:0.0:1782217075.269675:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713108224 00000100:00100000:0.0:1782217075.269677:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713108224 00000100:00100000:0.0:1782217075.269685:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713108352 00000100:00100000:0.0:1782217075.269687:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713108352 00000100:00100000:0.0:1782217075.269698:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1782217075.269702:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1868789713108096:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:0.0:1782217075.269717:0:6518:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1782217075.269757:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1868789713108096:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 51us (286us total) trans 0 rc -19/-19 00000100:00100000:0.0:1782217075.269763:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1782217075.269777:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1782217075.269781:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1868789713108224:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:0.0:1782217075.269790:0:6518:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1782217075.269812:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1868789713108224:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 30us (250us total) trans 0 rc -19/-19 00000100:00100000:0.0:1782217075.269817:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1782217075.269829:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1782217075.269832:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1868789713108352:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:0.0:1782217075.269841:0:6518:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1782217075.269860:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1868789713108352:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 27us (238us total) trans 0 rc -19/-19 00000100:00100000:0.0:1782217075.269874:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:0.0:1782217075.269901:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952d42006800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782217075.269906:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1782217075.269910:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1868789713108096:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:0.0:1782217075.269918:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952e74b7b800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782217075.269922:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1782217075.269925:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1868789713108224:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:0.0:1782217075.269934:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952d430ff800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782217075.269937:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1782217075.269940:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1868789713108352:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1782217075.281104:0:3648:0:(import.c:65:import_set_state_nolock()) ffff952e749e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782217075.281118:0:3648:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 204 00000100:00080000:1.0:1782217075.281128:0:3648:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff952e749e9000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1782217075.281166:0:3648:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff952d4441e680 x1868789713108480/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782217075.281193:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43e93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713107200:0@lo:400:kworker.0 00000100:00100000:1.0:1782217075.281253:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713107712:0@lo:400:kworker.0 00000100:00100000:0.0:1782217075.282660:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1868789713108480:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1782217075.283446:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217075.284162:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713108480 00000100:00100000:0.0:1782217075.284171:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713108480 00000100:00100000:0.0:1782217075.284208:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1782217075.284217:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1868789713108480:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:0.0:1782217075.284296:0:6524:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1782217075.284357:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1868789713108480:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 140us (912us total) trans 0 rc -19/-19 00000100:00100000:0.0:1782217075.284365:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00080000:0.0:1782217075.284404:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952e749e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782217075.284409:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1782217075.284413:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1868789713108480:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:0.0:1782217076.218433:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217077.242646:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1782217077.899925:0:15406:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1782217077.928735:0:15406:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1782217077.928793:0:15406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7b363000/0x92b8e04cbf5f93d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f93de expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217077.928806:0:15406:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7b363000/0x92b8e04cbf5f93d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f93de expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217077.928814:0:15406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7b363000/0x92b8e04cbf5f93d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x92b8e04cbf5f93de expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217077.928821:0:15406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff952e7b363000/0x92b8e04cbf5f93d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x92b8e04cbf5f93de expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217077.928842:0:15406:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1782217077.928847:0:15406:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1782217077.928874:0:15406:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1782217077.928879:0:15406:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1782217077.928885:0:15406:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1782217077.928890:0:15406:0:(import.c:65:import_set_state_nolock()) ffff952e74b7b800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1782217077.928895:0:15406:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1782217077.928896:0:15406:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1782217077.928898:0:15406:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1782217077.929792:0:15406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952d43072c00/0x92b8e04cbf5f93e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f93ec expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217077.929804:0:15406:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952d43072c00/0x92b8e04cbf5f93e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f93ec expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217077.929827:0:15406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952d43072c00/0x92b8e04cbf5f93e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x92b8e04cbf5f93ec expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217077.929833:0:15406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff952d43072c00/0x92b8e04cbf5f93e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x92b8e04cbf5f93ec expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217077.930003:0:15406:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1782217077.931641:0:15406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7b363200/0x92b8e04cbf5f92b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f92bf expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217077.931657:0:15406:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7b363200/0x92b8e04cbf5f92b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f92bf expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217077.931664:0:15406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7b363200/0x92b8e04cbf5f92b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x92b8e04cbf5f92bf expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217077.931670:0:15406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff952e7b363200/0x92b8e04cbf5f92b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x92b8e04cbf5f92bf expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217077.932543:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1782217077.932650:0:10337:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782217077.932657:0:10337:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952d43072c00/0x92b8e04cbf5f93e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x92b8e04cbf5f93ec expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217077.932679:0:10337:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43072c00 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:3.0:1782217077.932683:0:10337:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952d43072c00/0x92b8e04cbf5f93e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x92b8e04cbf5f93ec expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217077.932693:0:10337:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952d43072c00/0x92b8e04cbf5f93e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x92b8e04cbf5f93ec expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782217077.932700:0:10337:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952d43072c00/0x92b8e04cbf5f93e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x92b8e04cbf5f93ec expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782217077.932705:0:10337:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1782217077.932708:0:10337:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:3.0:1782217077.932744:0:10337:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952d43072c00/0x92b8e04cbf5f93e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x92b8e04cbf5f93ec expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217077.932751:0:10337:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782217077.932775:0:10337:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952d43072c00/0x92b8e04cbf5f93e5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x92b8e04cbf5f93ec expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217077.932782:0:10337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952d43072c00/0x92b8e04cbf5f93e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x92b8e04cbf5f93ec expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217077.932805:0:10337:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782217077.932875:0:10337:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e7b363200/0x92b8e04cbf5f92b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x92b8e04cbf5f92bf expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217077.932883:0:10337:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b363200 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:3.0:1782217077.932886:0:10337:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e7b363200/0x92b8e04cbf5f92b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x92b8e04cbf5f92bf expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217077.932904:0:10337:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e7b363200/0x92b8e04cbf5f92b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x92b8e04cbf5f92bf expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782217077.932911:0:10337:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e7b363200/0x92b8e04cbf5f92b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x92b8e04cbf5f92bf expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782217077.932916:0:10337:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1782217077.932918:0:10337:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:3.0:1782217077.932933:0:10337:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e7b363200/0x92b8e04cbf5f92b8 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x92b8e04cbf5f92bf expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217077.932940:0:10337:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782217077.932947:0:10337:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e7b363200/0x92b8e04cbf5f92b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x92b8e04cbf5f92bf expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217077.932956:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217077.932958:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217077.932960:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782217077.932978:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789713108608:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782217077.933050:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217077.933106:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782217077.933112:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789713108736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782217077.933135:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217077.933182:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713108608 00000100:00100000:3.0:1782217077.933189:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713108608 00000100:00100000:3.0:1782217077.933226:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713108736 00000100:00100000:3.0:1782217077.933228:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713108736 00000100:00100000:3.0:1782217077.933245:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782217077.933251:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e6f929c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3647:x1868789713108608:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1782217077.933265:0:8449:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782217077 with bad export cookie 10572446745485086366 00010000:00010000:1.0:1782217077.934421:0:15406:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1782217077.934433:0:15406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e7b363200/0x92b8e04cbf5f92b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x92b8e04cbf5f92bf expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782217077.934467:0:15406:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1782217077.934619:0:15406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952d43072800/0x92b8e04cbf5f9654 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f965b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217077.934629:0:15406:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952d43072800/0x92b8e04cbf5f9654 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f965b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217077.934635:0:15406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952d43072800/0x92b8e04cbf5f9654 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x92b8e04cbf5f965b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217077.934642:0:15406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff952d43072800/0x92b8e04cbf5f9654 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x92b8e04cbf5f965b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217077.934660:0:15406:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782217077.934666:0:15406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e41680000/0x92b8e04cbf5f8fa1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f8fa8 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217077.934673:0:15406:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e41680000/0x92b8e04cbf5f8fa1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f8fa8 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217077.934678:0:15406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e41680000/0x92b8e04cbf5f8fa1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x92b8e04cbf5f8fa8 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217077.934683:0:15406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff952e41680000/0x92b8e04cbf5f8fa1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x92b8e04cbf5f8fa8 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217077.934696:0:15406:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1782217077.934699:0:15406:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:1.0:1782217077.934703:0:15406:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:1.0:1782217077.934757:0:15406:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00010000:00010000:0.0:1782217077.934760:0:10336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:01000000:1.0:1782217077.934761:0:15406:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:1.0:1782217077.934766:0:15406:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00010000:00010000:0.0:1782217077.934767:0:10336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952d43072800/0x92b8e04cbf5f9654 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x92b8e04cbf5f965b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217077.934775:0:10336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43072800 already unused, calling callback (ffffffffc1157c20) 00000020:00000080:1.0:1782217077.934776:0:15406:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 10000000:00010000:0.0:1782217077.934778:0:10336:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952d43072800/0x92b8e04cbf5f9654 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x92b8e04cbf5f965b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1782217077.934782:0:15406:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff952e7b2be000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:0.0:1782217077.934786:0:10336:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952d43072800/0x92b8e04cbf5f9654 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x92b8e04cbf5f965b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1782217077.934788:0:15406:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff952e74b7f800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1782217077.934794:0:15406:0:(genops.c:1574:class_disconnect_exports()) OBD device 11 (ffff952e64e199c0) has exports, disconnecting them 10000000:00010000:0.0:1782217077.934795:0:10336:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952d43072800/0x92b8e04cbf5f9654 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x92b8e04cbf5f965b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1782217077.934799:0:15406:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff952e7b2be000), last request at 1782217075 10000000:01000000:0.0:1782217077.934800:0:10336:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1782217077.934802:0:10336:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1782217077.934804:0:10336:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000020:00000080:1.0:1782217077.934807:0:15406:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f9280 00010000:00010000:0.0:1782217077.934841:0:10336:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952d43072800/0x92b8e04cbf5f9654 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x92b8e04cbf5f965b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217077.934848:0:10336:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782217077.934876:0:10336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952d43072800/0x92b8e04cbf5f9654 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x92b8e04cbf5f965b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217077.934889:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952d43072800/0x92b8e04cbf5f9654 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x92b8e04cbf5f965b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217077.934900:0:10336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782217077.934903:0:10336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e41680000/0x92b8e04cbf5f8fa1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x92b8e04cbf5f8fa8 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217077.934908:0:10336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e41680000 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:0.0:1782217077.934911:0:10336:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e41680000/0x92b8e04cbf5f8fa1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x92b8e04cbf5f8fa8 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217077.934917:0:10336:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e41680000/0x92b8e04cbf5f8fa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x92b8e04cbf5f8fa8 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782217077.934922:0:10336:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e41680000/0x92b8e04cbf5f8fa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x92b8e04cbf5f8fa8 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782217077.934927:0:10336:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1782217077.934928:0:10336:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1782217077.934930:0:10336:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1782217077.934946:0:10336:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e41680000/0x92b8e04cbf5f8fa1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x92b8e04cbf5f8fa8 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217077.934951:0:10336:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782217077.934957:0:10336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e41680000/0x92b8e04cbf5f8fa1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x92b8e04cbf5f8fa8 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217077.934964:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e41680000/0x92b8e04cbf5f8fa1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x92b8e04cbf5f8fa8 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217077.934987:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217077.934988:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217077.934990:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782217077.935005:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17bce19a-7a0f-4c9d-b31c-4e0155298487:3650:1868789713108992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782217077.935066:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217077.935114:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782217077.935121:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17bce19a-7a0f-4c9d-b31c-4e0155298487:3650:1868789713108864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782217077.935142:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217077.935165:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713108992 00000100:00100000:0.0:1782217077.935172:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713108992 00000100:00100000:0.0:1782217077.935200:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713108864 00000100:00100000:0.0:1782217077.935202:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713108864 00000100:00100000:0.0:1782217077.935215:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1782217077.935222:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3647:x1868789713108736:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1782217077.935229:0:6505:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782217077 with bad export cookie 10572446745485086366 00000100:00100000:0.0:1782217077.935275:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3647:x1868789713108736:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (2137us total) trans 0 rc -107/-107 00000100:00100000:0.0:1782217077.935282:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1782217077.935299:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1782217077.935303:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3650:x1868789713108992:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1782217077.935307:0:6505:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782217077 with bad export cookie 10572446745485086366 00000100:00100000:0.0:1782217077.935335:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3650:x1868789713108992:12345-0@lo:103:ldlm_bl.0 Request processed in 29us (269us total) trans 0 rc -107/-107 00000100:00100000:0.0:1782217077.935341:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1782217077.935354:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1782217077.935358:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3650:x1868789713108864:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1782217077.935369:0:6505:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782217077 with bad export cookie 10572446745485086366 00000100:00100000:0.0:1782217077.935394:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3650:x1868789713108864:12345-0@lo:103:ldlm_bl.0 Request processed in 34us (251us total) trans 0 rc -107/-107 00000100:00100000:0.0:1782217077.935399:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1782217077.935411:0:15406:0:(import.c:65:import_set_state_nolock()) ffff952e7b2bd000 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1782217077.935430:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.130@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1782217077.935434:0:3650:0:(import.c:65:import_set_state_nolock()) ffff952e64ec6800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1782217077.935437:0:3650:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000020:00080000:1.0:1782217077.935466:0:15406:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff952e7b2be000): rc 0 00000020:00000080:1.0:1782217077.935469:0:15406:0:(genops.c:906:class_export_put()) final put ffff952e7b2be000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:1.0:1782217077.935479:0:15406:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff952e74b7f800), last request at 1782217075 00000020:00000080:1.0:1782217077.935484:0:15406:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f915a 00000100:00080000:1.0:1782217077.935489:0:15406:0:(import.c:65:import_set_state_nolock()) ffff952e74b7c000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1782217077.935500:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e7b363000/0x92b8e04cbf5f93d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x92b8e04cbf5f93de expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217077.935516:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b363000 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:2.0:1782217077.935519:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e7b363000/0x92b8e04cbf5f93d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x92b8e04cbf5f93de expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217077.935526:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e7b363000/0x92b8e04cbf5f93d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x92b8e04cbf5f93de expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782217077.935532:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e7b363000/0x92b8e04cbf5f93d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x92b8e04cbf5f93de expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782217077.935538:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1782217077.935540:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1782217077.935542:0:6507:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1782217077.935573:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782217077.935736:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952e7b2be000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:1.0:1782217077.935771:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff952e7b2bd000 for lustre-MDT0001 00010000:00010000:2.0:1782217077.935823:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217077.940159:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1782217077.947729:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.130@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1782217077.957937:0:3650:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.130@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1782217077.957944:0:3650:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1782217077.957953:0:3650:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff952d43e90e00 x1868789713106944/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1782217091 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782217077.957982:0:3650:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff952e7c6f0380 x1868789713108608/t0(0) o103->MGC192.168.203.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1782217093 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782217077.957993:0:3650:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff952e7c6f3b80 x1868789713108736/t0(0) o103->MGC192.168.203.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1782217093 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782217077.958001:0:3650:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff952e46da7b80 x1868789713108992/t0(0) o103->MGC192.168.203.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1782217093 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782217077.958009:0:3650:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff952d41be5500 x1868789713108864/t0(0) o103->MGC192.168.203.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1782217093 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1782217077.958017:0:3650:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1782217077.958020:0:3650:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1782217077.958021:0:3650:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00010000:00010000:1.0:1782217077.968953:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e7b363000/0x92b8e04cbf5f93d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x92b8e04cbf5f93de expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217077.968969:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782217077.968993:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e7b363000/0x92b8e04cbf5f93d7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x92b8e04cbf5f93de expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217077.969001:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e7b363000/0x92b8e04cbf5f93d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x92b8e04cbf5f93de expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217077.969020:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217077.969022:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217077.969025:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1782217077.969130:0:15406:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff952e74b7f800): rc 0 00000020:00000080:1.0:1782217077.969133:0:15406:0:(genops.c:906:class_export_put()) final put ffff952e74b7f800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:1.0:1782217077.969163:0:15406:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa4bf817a7ae0 00000020:00000080:1.0:1782217077.969177:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff952e74b7f800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1782217077.969217:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff952e74b7c000 for lustre-MDT0001 00000100:00080000:1.0:1782217077.969243:0:15406:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1782217077.969247:0:15406:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:2.0:1782217077.969779:0:3647:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff952e64ec6800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:2.0:1782217077.969803:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789713108608:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782217077.969830:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:0:1868789713109120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782217077.969835:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:17bce19a-7a0f-4c9d-b31c-4e0155298487:3647:1868789713108736:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1782217077.970016:0:15406:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1782217077.970021:0:15406:0:(import.c:65:import_set_state_nolock()) ffff952e749e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1782217077.970033:0:3650:0:(import.c:65:import_set_state_nolock()) ffff952e64ec6800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782217077.970039:0:3650:0:(import.c:512:import_select_connection()) MGC192.168.203.130@tcp: connect to NID 0@lo last attempt 187 00000100:00080000:0.0:1782217077.970047:0:3650:0:(import.c:626:import_select_connection()) MGC192.168.203.130@tcp: import ffff952e64ec6800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1782217077.970064:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43e90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:17bce19a-7a0f-4c9d-b31c-4e0155298487:3649:1868789713106944:0@lo:400:kworker.0 00010000:00010000:0.0:1782217077.970319:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782217077.970358:0:3650:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff952e46da5500 x1868789713109248/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782217077.970393:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17bce19a-7a0f-4c9d-b31c-4e0155298487:3650:1868789713108992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782217077.970408:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:17bce19a-7a0f-4c9d-b31c-4e0155298487:3650:1868789713108864:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1782217077.970827:0:15406:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1782217077.970832:0:15406:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:0.0:1782217077.970851:0:15406:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1782217077.970911:0:15406:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1782217077.970924:0:15406:0:(import.c:65:import_set_state_nolock()) ffff952d4245f800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1782217077.970931:0:15406:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1782217077.970934:0:15406:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:0.0:1782217077.970943:0:15406:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1782217077.971013:0:15406:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1782217077.971022:0:15406:0:(import.c:65:import_set_state_nolock()) ffff952d435d5800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1782217077.971046:0:15406:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff952e64e199c0) has no exports 00000100:00100000:1.0:1782217077.976556:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:17bce19a-7a0f-4c9d-b31c-4e0155298487:3646:1868789713109248:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:1.0:1782217077.976633:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1868789713109248 offset 0 length 520: 4 00000100:00100000:1.0:1782217077.976680:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1868789713109376:0@lo:9:umount.0 00000100:00100000:1.0:1782217077.976715:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217077.976740:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1868789713109504:0@lo:9:umount.0 00000100:00100000:1.0:1782217077.976763:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217077.976894:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713109376 00000100:00100000:1.0:1782217077.976903:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713109376 00000100:00100000:1.0:1782217077.976959:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713109504 00000100:00100000:1.0:1782217077.976963:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713109504 00000100:00100000:1.0:1782217077.976988:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1782217077.976997:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4441d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1868789713109376:12345-0@lo:9:umount.0 00000020:00000080:1.0:1782217077.977023:0:14273:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f91b5 00000100:00080000:1.0:1782217077.977032:0:14273:0:(import.c:65:import_set_state_nolock()) ffff952d4229b000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782217077.977072:0:14273:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1782217077.977207:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4441d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+2:3646:x1868789713109376:12345-0@lo:9:umount.0 Request processed in 210us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217077.977214:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1782217077.977231:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1782217077.977237:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4441f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1868789713109504:12345-0@lo:9:umount.0 00000020:00000080:1.0:1782217077.977262:0:14273:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f92e9 00000100:00080000:1.0:1782217077.977267:0:14273:0:(import.c:65:import_set_state_nolock()) ffff952e7c6cd800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782217077.977290:0:14273:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1782217077.977366:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4441f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+2:3646:x1868789713109504:12345-0@lo:9:umount.0 Request processed in 128us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217077.977373:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1782217077.977391:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782217077.977394:0:6515:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782217077.977408:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1782217077.977435:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952d4245f800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1782217077.977449:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1782217077.977451:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1782217077.977467:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1868789713109376:0@lo:9:umount.0 00000100:00080000:1.0:1782217077.977481:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952d435d5800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1782217077.977490:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1782217077.977492:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1782217077.977494:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1868789713109504:0@lo:9:umount.0 00010000:00010000:1.0:1782217077.977523:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:3.0:1782217077.980121:0:8449:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1868789713108608 offset 224 length 224: 4 00000100:00100000:3.0:1782217077.980144:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e6f929c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3647:x1868789713108608:12345-0@lo:103:ldlm_bl.0 Request processed in 46891us (47093us total) trans 0 rc -107/-107 00000100:00100000:3.0:1782217077.980155:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000020:00080000:2.0:1782217077.992929:0:15406:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff952e64e199c0) has no exports 00000020:01000000:3.0:1782217078.043468:0:15406:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff952e7c4accc0 - data ffff952e6519f000/ffff952e7c799400 00000020:01000000:3.0:1782217078.043736:0:15406:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff952e4e1007e0 - data ffff952e65153ca8/ffff952e47c3d400 00000001:00000004:0.0:1782217078.055011:0:15406:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:2.0:1782217078.083766:0:15406:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1782217078.083774:0:15406:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1782217078.083782:0:15406:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1782217078.085505:0:15406:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1782217078.085514:0:15406:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1782217078.085650:0:15406:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1782217078.085653:0:15406:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1782217078.086006:0:8530:0:(osp_sync.c:1339:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1782217078.086012:0:8530:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:0.0:1782217078.086021:0:8530:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1782217078.086976:0:15406:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1782217078.086981:0:15406:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1782217078.086999:0:15406:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1782217078.087002:0:15406:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1782217078.087216:0:10013:0:(osp_sync.c:1339:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1782217078.087220:0:10013:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:1.0:1782217078.087228:0:10013:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1782217078.088064:0:15406:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f8fc4 00000020:00000080:2.0:1782217078.088074:0:15406:0:(genops.c:906:class_export_put()) final put ffff952e7b07c800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1782217078.089420:0:15406:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f8fd9 00000020:00000080:2.0:1782217078.089429:0:15406:0:(genops.c:906:class_export_put()) final put ffff952e46d59000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1782217078.089436:0:15406:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1782217078.089441:0:15406:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782217078.089448:0:15406:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1782217078.089463:0:15406:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff952e64e18000) has no exports 00000004:01000000:2.0:1782217078.089689:0:15406:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1782217078.089696:0:15406:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f92e2 00000020:00000080:2.0:1782217078.089700:0:15406:0:(genops.c:906:class_export_put()) final put ffff952d436df800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1782217078.089704:0:15406:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1782217078.089707:0:15406:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782217078.089713:0:15406:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1782217078.089715:0:15406:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff952e74c819c0) has no exports 00000020:00000080:2.0:1782217078.089720:0:15406:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f92db 00000020:00000080:2.0:1782217078.089723:0:15406:0:(genops.c:906:class_export_put()) final put ffff952d422ed800/lustre-MDT0001-osd_UUID 00010000:01000000:2.0:1782217078.090043:0:15406:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1782217078.090048:0:15406:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1782217078.090060:0:15406:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:2.0:1782217078.090066:0:15406:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1782217078.090068:0:15406:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1782217078.090093:0:15406:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782217078.090100:0:15406:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1782217078.090104:0:15406:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f91a0 00000020:00000080:2.0:1782217078.090108:0:15406:0:(genops.c:906:class_export_put()) final put ffff952e7c6c9000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1782217078.090112:0:15406:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1782217078.090115:0:15406:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782217078.090118:0:15406:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1782217078.090121:0:15406:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff952e7dbd99c0) has no exports 00000020:00000080:2.0:1782217078.090124:0:15406:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f9199 00000020:00000080:2.0:1782217078.090127:0:15406:0:(genops.c:906:class_export_put()) final put ffff952d42459000/lustre-MDT0001-osd_UUID 00010000:01000000:2.0:1782217078.090428:0:15406:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1782217078.090431:0:15406:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1782217078.090433:0:15406:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:2.0:1782217078.090437:0:15406:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1782217078.090439:0:15406:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1782217078.090472:0:15406:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782217078.090477:0:15406:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1782217078.090486:0:15406:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1782217078.090490:0:15406:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f8ffc 00000020:00000080:2.0:1782217078.090494:0:15406:0:(genops.c:906:class_export_put()) final put ffff952e7396f000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1782217078.090498:0:15406:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1782217078.090501:0:15406:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782217078.090504:0:15406:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1782217078.090506:0:15406:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff952e4e288000) has no exports 00000020:00000080:2.0:1782217078.090509:0:15406:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f8ff5 00000020:00000080:2.0:1782217078.090512:0:15406:0:(genops.c:906:class_export_put()) final put ffff952e749ef000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1782217078.090746:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952e7b07c800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1782217078.090754:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952e46d59000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:0.0:1782217078.090761:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952d436df800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1782217078.090766:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952d422ed800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1782217078.090770:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff952d435d5800 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1782217078.090777:0:36:0:(genops.c:906:class_export_put()) final put ffff952d422e8000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1782217078.090780:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952d422e8000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1782217078.090784:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1782217078.090867:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952e7c6c9000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1782217078.090872:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952d42459000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1782217078.090876:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff952d4245f800 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1782217078.090880:0:36:0:(genops.c:906:class_export_put()) final put ffff952d4245e000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1782217078.090882:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952d4245e000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1782217078.090887:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1782217078.090912:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952e7396f000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1782217078.090916:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952e749ef000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1782217078.092666:0:15406:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1782217078.092674:0:15406:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1782217078.092679:0:15406:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1782217078.092686:0:15406:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1782217078.092736:0:15406:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782217078.092746:0:15406:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1782217078.092780:0:15406:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782217078.092785:0:15406:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1782217078.092789:0:15406:0:(genops.c:906:class_export_put()) final put ffff952e7b2ba000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1782217078.092794:0:15406:0:(genops.c:865:class_export_destroy()) destroying export ffff952e7b2ba000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1782217078.092801:0:15406:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1782217078.092951:0:15406:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f8fe0 00000020:00000080:0.0:1782217078.092957:0:15406:0:(genops.c:906:class_export_put()) final put ffff952e46d5f800/lustre-MDD0001_UUID 00000020:01000000:0.0:1782217078.092961:0:15406:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1782217078.092964:0:15406:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782217078.092968:0:15406:0:(obd_config.c:955:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1782217078.092971:0:15406:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff952e7397cd40) has no exports 00000020:00000080:0.0:1782217078.092987:0:15406:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782217078.092990:0:15406:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1782217078.092993:0:15406:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f8fe7 00000020:00000080:0.0:1782217078.092997:0:15406:0:(genops.c:906:class_export_put()) final put ffff952e46d5b800/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1782217078.093012:0:15406:0:(tgt_mount.c:187:server_put_mount()) put mount ffff952e7b38d800 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1782217078.093015:0:15406:0:(obd_mount.c:701:lustre_put_lsi()) put ffff952e7b38d800 2 00000020:01000004:0.0:1782217078.093018:0:15406:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff952e7b38d800 from lustre-MDT0001 00000020:00000080:0.0:1782217078.093035:0:15406:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782217078.093039:0:15406:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1782217078.093042:0:15406:0:(genops.c:906:class_export_put()) final put ffff952e7b07a000/lustre-MDT0001_UUID 00000020:00000080:0.0:1782217078.093044:0:15406:0:(genops.c:865:class_export_destroy()) destroying export ffff952e7b07a000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1782217078.093050:0:15406:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1782217078.093082:0:15406:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1782217078.093086:0:15406:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1782217078.093089:0:15406:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782217078.093092:0:15406:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1782217078.093099:0:15406:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff952e74b79800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1782217078.093104:0:15406:0:(genops.c:1574:class_disconnect_exports()) OBD device 14 (ffff952e4e2899c0) has exports, disconnecting them 00000020:00080000:0.0:1782217078.093108:0:15406:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff952e74b79800), last request at 1782216841 00000020:00000080:0.0:1782217078.093112:0:15406:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f903b 00000020:00080000:0.0:1782217078.093125:0:15406:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff952e74b79800): rc 0 00000020:00000080:0.0:1782217078.093128:0:15406:0:(genops.c:906:class_export_put()) final put ffff952e74b79800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1782217078.093814:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff952e749e9000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1782217078.093823:0:36:0:(genops.c:906:class_export_put()) final put ffff952e749e9800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1782217078.093826:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952e749e9800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1782217078.093831:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1782217078.093939:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952e46d5f800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1782217078.093944:0:36:0:(genops.c:906:class_export_put()) final put ffff952e7b2bc000/lustre-MDD0001_UUID 00000020:00000080:1.0:1782217078.093945:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952e7b2bc000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1782217078.093948:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1782217078.094112:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952e46d5b800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1782217078.094119:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952e74b79800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1782217078.094144:0:15406:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1782217078.094147:0:15406:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1782217078.094150:0:15406:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1782217078.094154:0:15406:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1782217078.094171:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff952e74b7b800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1782217078.094260:0:15406:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782217078.094266:0:15406:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1782217078.094269:0:15406:0:(genops.c:906:class_export_put()) final put ffff952e74b5c800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1782217078.094272:0:15406:0:(genops.c:865:class_export_destroy()) destroying export ffff952e74b5c800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1782217078.094275:0:15406:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1782217078.094302:0:15406:0:(obd_mount.c:701:lustre_put_lsi()) put ffff952e7b38d800 1 00000020:00000080:1.0:1782217078.094306:0:15406:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f8f77 00000020:00000080:1.0:1782217078.094310:0:15406:0:(genops.c:906:class_export_put()) final put ffff952e64e4f800/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1782217078.094318:0:15406:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1782217078.094325:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952e64e4f800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1782217078.094332:0:15406:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782217078.094336:0:15406:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1782217078.094338:0:15406:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff952e4e28b380) has no exports 00000020:00000080:1.0:1782217078.152215:0:15406:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782217078.152227:0:15406:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1782217078.152233:0:15406:0:(genops.c:906:class_export_put()) final put ffff952e7b38d000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1782217078.152238:0:15406:0:(genops.c:865:class_export_destroy()) destroying export ffff952e7b38d000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1782217078.152250:0:15406:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1782217078.152359:0:15406:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff952e7b38c000 00000020:01000000:1.0:1782217078.152375:0:15406:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1782217078.152378:0:15406:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782217078.152382:0:15406:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1782217078.152386:0:15406:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff952e4e28cd40) has no exports 00000100:00100000:0.0:1782217078.152649:0:6518:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff952e44d3fe00:6518] 0 exiting: rc = 1 00000100:00100000:0.0:1782217078.152759:0:6548:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff952e6fb6b200:6548] 3 exiting: rc = 0 00000100:00100000:3.0:1782217078.152932:0:6520:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff952e44d3f200:6520] 2 exiting: rc = 0 00000100:00100000:3.0:1782217078.153013:0:6519:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff952e44d3ea00:6519] 1 exiting: rc = 0 00000100:00100000:1.0:1782217078.153251:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153260:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153265:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153271:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153277:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153283:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153288:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153293:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153298:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153303:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153308:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153313:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153318:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153323:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153328:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153333:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153339:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153344:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153350:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153355:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153361:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153366:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153370:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153375:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153380:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153384:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153388:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153393:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153399:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153404:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153409:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153414:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153419:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153424:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153430:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153445:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153451:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153466:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153471:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153477:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153482:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153487:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153492:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153497:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153502:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153506:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153511:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153516:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153521:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153526:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153820:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153828:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153833:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153838:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153843:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153848:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153853:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153858:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153863:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153868:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153873:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153878:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153883:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.153897:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217078.157105:0:6522:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff952e54ed2e00:6522] 1 exiting: rc = 0 00000100:00100000:2.0:1782217078.157263:0:6521:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff952e54ed3800:6521] 0 exiting: rc = 1 00000100:00100000:1.0:1782217078.157373:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.157381:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.157387:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.157394:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.157400:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.157406:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.157426:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.157431:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.157436:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.157442:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.157447:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.157461:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.157468:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.157473:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.157478:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.157482:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.157488:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.157492:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.157497:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.157501:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.157506:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.157511:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.157515:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.157520:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.157525:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.157530:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.157535:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.157540:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.157545:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.157550:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.157555:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.157560:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.157565:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.157570:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.157576:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.157930:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.157939:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.157944:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.157949:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.157954:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.157959:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.157973:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.157977:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.157981:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.157986:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.157991:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.157995:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.158000:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.158005:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.158011:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.158017:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.158021:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.158026:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.158031:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.158037:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.158042:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.158047:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.158052:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.158056:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.158061:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.158066:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.158070:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.158076:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.158082:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.158518:0:6523:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff952e52b87800:6523] 0 exiting: rc = 1 00000100:00100000:3.0:1782217078.158794:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff952e52b86000:6524] 1 exiting: rc = 0 00000100:00100000:0.0:1782217078.158898:0:7938:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff952e749de200:7938] 2 exiting: rc = 0 00000100:00100000:1.0:1782217078.158994:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159002:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159008:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159014:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159020:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159025:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159030:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159036:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159041:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159067:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159074:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159088:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159093:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159099:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159104:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159109:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159114:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159119:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159125:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159131:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159137:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159156:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159163:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159169:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159174:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159179:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159185:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159190:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159195:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159201:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159206:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159212:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159217:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159236:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159242:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159248:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159253:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159258:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159263:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159269:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159274:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159280:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159286:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159291:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159298:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159318:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159329:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159336:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159343:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159349:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159354:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159360:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159366:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159372:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159377:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159382:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159387:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159411:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159418:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159423:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159428:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159434:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159440:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.159465:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217078.169154:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff952e52b87200:6525] 0 exiting: rc = 1 00000100:00100000:2.0:1782217078.169275:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff952e52b87000:6526] 1 exiting: rc = 0 00000100:00100000:1.0:1782217078.169378:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169385:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169390:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169395:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169401:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169405:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169410:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169415:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169419:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169424:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169428:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169433:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169437:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169442:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169447:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169462:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169468:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169485:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169490:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169495:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169500:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169505:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169510:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169515:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169519:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169523:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169528:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169790:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169795:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169800:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169805:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169810:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169815:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169820:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169825:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169829:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169833:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169838:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169842:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169846:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169851:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169855:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169860:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169864:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169869:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169873:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169877:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169882:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169887:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169891:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169895:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169900:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169911:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169915:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169920:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169924:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169929:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169934:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169938:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169942:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169947:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169951:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169956:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.169961:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217078.170293:0:6527:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff952e52b86800:6527] 0 exiting: rc = 1 00000100:00100000:3.0:1782217078.170383:0:6528:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff952e52b87a00:6528] 1 exiting: rc = 0 00000100:00100000:1.0:1782217078.170472:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.170478:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.170482:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.170487:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.170491:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.170496:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.170501:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.170506:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.170517:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.170522:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.170527:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.170543:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.170555:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.170561:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.170566:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.170572:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.170577:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.170793:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.170803:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.170808:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.170813:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.170817:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.170824:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.170840:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.170845:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.170850:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.170855:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.170860:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.170866:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.170870:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.170876:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.170881:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.170886:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.170890:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.170895:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.170900:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.170905:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.170910:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.170916:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.170921:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.170927:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.170932:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.170937:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.170942:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.170947:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.170952:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.170957:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.170962:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.170966:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.170971:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.170977:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.171004:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.171011:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.171016:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.171020:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.171025:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.171030:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.171035:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.171048:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.171052:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.171056:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.171061:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.171065:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.171070:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217078.171540:0:6530:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff952e6fadc600:6530] 1 exiting: rc = 0 00000100:00100000:0.0:1782217078.171826:0:6529:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff952e6fadd000:6529] 0 exiting: rc = 1 00000100:00100000:1.0:1782217078.171917:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.171923:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.171928:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.171933:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.171939:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.171943:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.171949:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.171953:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.171958:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.171964:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.171968:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.171973:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.171978:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.171982:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.171987:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.171992:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.171997:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.172001:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.172006:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.172010:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.172015:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.172019:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.172024:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.172028:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.172032:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.172037:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.172041:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.172046:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.172050:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.172064:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.172068:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.172072:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.172077:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.172080:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.172085:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.172089:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.172094:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.172099:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.172104:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.172108:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.172113:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.172119:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.172124:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.172129:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.172134:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.172138:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.172143:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.172148:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.172152:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.172157:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.172161:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.172166:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.172170:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.172175:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.172178:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.172183:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.172187:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.172192:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.172196:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.172200:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.172205:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.172209:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.172214:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.172219:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217078.172954:0:6532:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff952e6fadc200:6532] 1 exiting: rc = 0 00000100:00100000:3.0:1782217078.173176:0:6531:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff952e6fadc800:6531] 0 exiting: rc = 1 00000100:00100000:2.0:1782217078.173370:0:6533:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff952e6fadd400:6533] 2 exiting: rc = 0 00000100:00100000:1.0:1782217078.173500:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.173524:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.173925:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.173934:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.173939:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.173944:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.173949:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.173955:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.173961:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.173966:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.173972:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.173977:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.173983:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.173989:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.173994:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.174000:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.174006:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.174011:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.174017:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.174022:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.174028:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.174035:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.174040:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.174045:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.174050:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.174069:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.174075:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.174081:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.174086:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.174091:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.174101:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.174107:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.174113:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.174118:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.174124:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.174138:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.174144:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.174150:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.174156:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.174161:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.174167:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.174173:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.174179:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.174184:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.174190:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.174195:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.174199:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.174205:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.174210:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.174228:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.174234:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.174240:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.174244:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.174249:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.174254:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.174260:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.174265:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.174270:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.174275:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.174280:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.174286:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.174292:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.174298:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217078.174303:0:15406:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1782217078.182950:0:15406:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782217078.182963:0:15406:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1782217078.182968:0:15406:0:(genops.c:906:class_export_put()) final put ffff952e516ae000/MDS_uuid 00000020:00000080:0.0:1782217078.182973:0:15406:0:(genops.c:865:class_export_destroy()) destroying export ffff952e516ae000/MDS_uuid for MDS 00000020:01000000:0.0:1782217078.182983:0:15406:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1782217078.183127:0:15406:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1782217078.265201:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217079.288682:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217080.316486:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1782217080.376963:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) 17bce19a-7a0f-4c9d-b31c-4e0155298487->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1782217080.376972:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) 17bce19a-7a0f-4c9d-b31c-4e0155298487->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782217080.376975:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1782217080.376978:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1782217080.376981:0:37:0:(import.c:65:import_set_state_nolock()) ffff952d42006800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782217080.377006:0:37:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 438 00000100:00080000:3.0:1782217080.377012:0:37:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1782217080.377020:0:37:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff952d42006800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1782217080.377057:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff952e7c6f2300 x1868789713109632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782217080.377113:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1782217080.377130:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1782217080.377131:0:37:0:(import.c:65:import_set_state_nolock()) ffff952d430ff800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782217080.377135:0:37:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 438 00000100:00080000:3.0:1782217080.377138:0:37:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1782217080.377143:0:37:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff952d430ff800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1782217080.377156:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff952e7c6f2680 x1868789713109888/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782217080.377190:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1868789713109760:0@lo:400:kworker.0 00000400:00000100:0.0:1782217080.377239:0:3648:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868789713109760 offset 0 length 224: 4 00000100:00100000:1.0:1782217080.377299:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1868789713109632:0@lo:38:kworker.0 00000100:00100000:0.0:1782217080.377314:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1868789713110016:0@lo:400:kworker.0 00000400:00000100:1.0:1782217080.377322:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868789713109632 offset 0 length 520: 4 00000400:00000100:0.0:1782217080.377330:0:3649:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868789713110016 offset 0 length 224: 4 00000100:00100000:1.0:1782217080.377334:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1868789713109888:0@lo:38:kworker.0 00000400:00000100:1.0:1782217080.377360:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868789713109888 offset 0 length 520: 4 00010000:00010000:0.0:1782217081.336820:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1782217082.043469:0:15606:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1782217082.058776:0:15606:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1782217082.058827:0:15606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7b362600/0x92b8e04cbf5f93bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f93c2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217082.058841:0:15606:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7b362600/0x92b8e04cbf5f93bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f93c2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217082.058849:0:15606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7b362600/0x92b8e04cbf5f93bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x92b8e04cbf5f93c2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217082.058857:0:15606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff952e7b362600/0x92b8e04cbf5f93bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x92b8e04cbf5f93c2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217082.058877:0:15606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1782217082.058883:0:15606:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1782217082.058903:0:15606:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1782217082.058913:0:15606:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff952e7c6f2300 x1868789713109632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1782217095 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782217082.058928:0:15606:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1782217082.058934:0:15606:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1782217082.058940:0:15606:0:(import.c:65:import_set_state_nolock()) ffff952d42006800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1782217082.058945:0:15606:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1782217082.058949:0:15606:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff952e7c6f2300 x1868789713109632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1782217095 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782217082.058956:0:15606:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1782217082.058959:0:15606:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00010000:00010000:2.0:1782217082.059015:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782217082.059022:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e7b362600/0x92b8e04cbf5f93bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x92b8e04cbf5f93c2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217082.059030:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362600 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:2.0:1782217082.059034:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e7b362600/0x92b8e04cbf5f93bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x92b8e04cbf5f93c2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217082.059042:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e7b362600/0x92b8e04cbf5f93bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x92b8e04cbf5f93c2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782217082.059050:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e7b362600/0x92b8e04cbf5f93bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x92b8e04cbf5f93c2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782217082.059056:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1782217082.059058:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1782217082.059061:0:6507:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1782217082.059072:0:6507:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff952e64ec6800 00010000:00010000:2.0:1782217082.059076:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e7b362600/0x92b8e04cbf5f93bb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x92b8e04cbf5f93c2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217082.059083:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e7b362600/0x92b8e04cbf5f93bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x92b8e04cbf5f93c2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217082.059093:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217082.059095:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217082.059097:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782217082.059199:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1868789713109632:0@lo:38:kworker.0 00000100:00080000:1.0:1782217082.060159:0:15606:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1782217082.060383:0:15606:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff952e7c6f2a00 x1868789713109760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217096 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782217082.060401:0:15606:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1782217082.060406:0:15606:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1782217082.060435:0:15606:0:(import.c:65:import_set_state_nolock()) ffff952d4245c000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1782217082.060485:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1868789713110144:0@lo:39:umount.0 00000400:00000100:2.0:1782217082.060534:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868789713110144 offset 0 length 224: 4 00000100:00100000:0.0:1782217082.060665:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1868789713109760:0@lo:400:kworker.0 00010000:00010000:0.0:1782217082.361781:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782217082.425535:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) 17bce19a-7a0f-4c9d-b31c-4e0155298487->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1782217082.425545:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) 17bce19a-7a0f-4c9d-b31c-4e0155298487->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1782217082.425548:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1782217082.425552:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1782217082.425827:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1868789713110272:0@lo:400:kworker.0 00000400:00000100:2.0:1782217082.425888:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868789713110272 offset 0 length 224: 4 00010000:00010000:1.0:1782217083.386982:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1782217083.965821:0:8428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1782217083.965832:0:8428:0:(genops.c:906:class_export_put()) final put ffff952d4229a000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1782217083.966033:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952d4229a000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1782217083.966093:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff952d4229b000 for lustre-OST0000 00000001:00100000:3.0:1782217083.968164:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1782217083.968172:0:9512:0:(genops.c:906:class_export_put()) final put ffff952e7c6ca000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1782217083.968254:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff952e7c6ca000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1782217083.968309:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff952e7c6cd800 for lustre-OST0001 00010000:00010000:0.0:1782217084.408744:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217085.432920:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1782217085.433717:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) 17bce19a-7a0f-4c9d-b31c-4e0155298487->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1782217085.433725:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) 17bce19a-7a0f-4c9d-b31c-4e0155298487->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782217085.433728:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1782217085.433732:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1782217085.433835:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43cb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1868789713110400:0@lo:400:kworker.0 00000400:00000100:3.0:1782217085.433888:0:3647:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868789713110400 offset 0 length 224: 4 00010000:00010000:0.0:1782217086.456748:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782217087.160766:0:3646:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782217077/real 1782217077] req@ffff952e46da5500 x1868789713109248/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1782217087 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782217087.160812:0:3646:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff952e46da5500 x1868789713109248/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1782217087 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1782217087.160833:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952e64ec6800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1782217087.160863:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1782217087.160867:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:17bce19a-7a0f-4c9d-b31c-4e0155298487:3646:1868789713109248:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:0.0:1782217087.161022:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) 17bce19a-7a0f-4c9d-b31c-4e0155298487->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1782217087.161027:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1782217087.161030:0:37:0:(import.c:65:import_set_state_nolock()) ffff952e64ec6800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782217087.161035:0:37:0:(import.c:512:import_select_connection()) MGC192.168.203.130@tcp: connect to NID 0@lo last attempt 440 00000100:00080000:0.0:1782217087.161039:0:37:0:(import.c:591:import_select_connection()) MGC192.168.203.130@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1782217087.161045:0:37:0:(import.c:626:import_select_connection()) MGC192.168.203.130@tcp: import ffff952e64ec6800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1782217087.161090:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff952e46da7100 x1868789713110528/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782217087.161126:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1782217087.161130:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1782217087.161234:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1868789713110656:0@lo:400:kworker.0 00000400:00000100:3.0:1782217087.161283:0:3648:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868789713110656 offset 0 length 224: 4 00000100:00100000:2.0:1782217087.161620:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:17bce19a-7a0f-4c9d-b31c-4e0155298487:3646:1868789713110528:0@lo:250:kworker.0 00000400:00000100:2.0:1782217087.161645:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1868789713110528 offset 0 length 520: 4 00010000:00010000:1.0:1782217087.480822:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217088.509963:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217089.528824:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217090.552738:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217091.576796:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782217092.281314:0:3646:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782217082/real 1782217082] req@ffff952d4441ca80 x1868789713110144/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782217092 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782217092.281415:0:3646:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff952d4441ca80 x1868789713110144/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782217092 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1782217092.281437:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952d4245c000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1782217092.281519:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1868789713110144:0@lo:39:umount.0 00000100:00080000:1.0:1782217092.281611:0:15606:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1782217092.281616:0:15606:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1782217092.281620:0:15606:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1782217092.282693:0:15606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7c449200/0x92b8e04cbf5f93c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f93d0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217092.282709:0:15606:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7c449200/0x92b8e04cbf5f93c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f93d0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217092.282716:0:15606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7c449200/0x92b8e04cbf5f93c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x92b8e04cbf5f93d0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217092.282722:0:15606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff952e7c449200/0x92b8e04cbf5f93c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x92b8e04cbf5f93d0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217092.282815:0:15606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782217092.282837:0:15606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e72e2da00/0x92b8e04cbf5f9646 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f964d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217092.282858:0:15606:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e72e2da00/0x92b8e04cbf5f9646 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f964d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217092.282864:0:15606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e72e2da00/0x92b8e04cbf5f9646 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x92b8e04cbf5f964d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217092.282868:0:15606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff952e72e2da00/0x92b8e04cbf5f9646 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x92b8e04cbf5f964d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217092.283152:0:10337:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782217092.283160:0:10337:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e7c449200/0x92b8e04cbf5f93c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x92b8e04cbf5f93d0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217092.283167:0:10337:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7c449200 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:0.0:1782217092.283170:0:10337:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e7c449200/0x92b8e04cbf5f93c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x92b8e04cbf5f93d0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217092.283178:0:10337:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e7c449200/0x92b8e04cbf5f93c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x92b8e04cbf5f93d0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782217092.283185:0:10337:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e7c449200/0x92b8e04cbf5f93c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x92b8e04cbf5f93d0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782217092.283189:0:10337:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1782217092.283192:0:10337:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:0.0:1782217092.283205:0:10337:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff952e64ec6800 00010000:00010000:0.0:1782217092.283209:0:10337:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e7c449200/0x92b8e04cbf5f93c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x92b8e04cbf5f93d0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217092.283216:0:10337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e7c449200/0x92b8e04cbf5f93c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x92b8e04cbf5f93d0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217092.283241:0:10337:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782217092.283244:0:10337:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e72e2da00/0x92b8e04cbf5f9646 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x92b8e04cbf5f964d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217092.283249:0:10337:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2da00 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:0.0:1782217092.283251:0:10337:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e72e2da00/0x92b8e04cbf5f9646 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x92b8e04cbf5f964d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217092.283257:0:10337:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e72e2da00/0x92b8e04cbf5f9646 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x92b8e04cbf5f964d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782217092.283262:0:10337:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e72e2da00/0x92b8e04cbf5f9646 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x92b8e04cbf5f964d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782217092.283266:0:10337:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1782217092.283268:0:10337:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1782217092.283272:0:10337:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff952e64ec6800 00010000:00010000:0.0:1782217092.283276:0:10337:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e72e2da00/0x92b8e04cbf5f9646 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x92b8e04cbf5f964d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217092.283281:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217092.283283:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217092.283284:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217092.283450:0:15606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1782217092.283456:0:15606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e72e2da00/0x92b8e04cbf5f9646 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x92b8e04cbf5f964d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782217092.283465:0:15606:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1782217092.283471:0:15606:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:1.0:1782217092.283474:0:15606:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1782217092.283501:0:15606:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1782217092.283505:0:15606:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1782217092.283511:0:15606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782217092.283516:0:15606:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1782217092.283520:0:15606:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff952e50218000) has no exports 00000020:00080000:1.0:1782217092.283541:0:15606:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff952e50218000) has no exports 00010000:00010000:2.0:1782217092.284962:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1782217092.285800:0:15606:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff952d4262cb40 - data ffff952d41c0ce58/ffff952e7c6f6c00 00000020:01000000:1.0:1782217092.285985:0:15606:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff952d421d33c0 - data ffff952e65289948/ffff952d42289800 00100000:10000000:1.0:1782217092.293369:0:15606:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1782217092.315007:0:15606:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f9114 00000020:00000080:1.0:1782217092.315019:0:15606:0:(genops.c:906:class_export_put()) final put ffff952e7b2ca800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1782217092.315039:0:15606:0:(tgt_mount.c:187:server_put_mount()) put mount ffff952e74b5e800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1782217092.315043:0:15606:0:(obd_mount.c:701:lustre_put_lsi()) put ffff952e74b5e800 2 00000020:01000004:1.0:1782217092.315055:0:15606:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff952e74b5e800 from lustre-OST0000 00000020:00000080:1.0:1782217092.315075:0:15606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782217092.315084:0:15606:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1782217092.315087:0:15606:0:(genops.c:906:class_export_put()) final put ffff952e7b2b9800/lustre-OST0000_UUID 00000020:00000080:1.0:1782217092.315091:0:15606:0:(genops.c:865:class_export_destroy()) destroying export ffff952e7b2b9800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1782217092.315096:0:15606:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1782217092.315148:0:15606:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1782217092.315151:0:15606:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1782217092.315154:0:15606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782217092.315158:0:15606:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1782217092.315164:0:15606:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff952d42004800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1782217092.315169:0:15606:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffff952e73978000) has exports, disconnecting them 00000020:00080000:1.0:1782217092.315173:0:15606:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff952d42004800), last request at 1782216858 00000020:00000080:1.0:1782217092.315177:0:15606:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f913e 00000020:00080000:1.0:1782217092.315185:0:15606:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff952d42004800): rc 0 00000020:00000080:1.0:1782217092.315195:0:15606:0:(genops.c:906:class_export_put()) final put ffff952d42004800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1782217092.315975:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff952e7b2ca800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1782217092.315989:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff952d42004800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1782217092.316013:0:15606:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1782217092.316017:0:15606:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1782217092.316021:0:15606:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1782217092.316025:0:15606:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1782217092.316127:0:15606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782217092.316133:0:15606:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1782217092.316138:0:15606:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1782217092.316141:0:15606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782217092.316145:0:15606:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1782217092.316149:0:15606:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff952d42459800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1782217092.316154:0:15606:0:(genops.c:1574:class_disconnect_exports()) OBD device 20 (ffff952e739799c0) has exports, disconnecting them 00000020:00080000:2.0:1782217092.316157:0:15606:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff952d42459800), last request at 1782216858 00000020:00000080:2.0:1782217092.316160:0:15606:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f9153 00000020:00080000:2.0:1782217092.316171:0:15606:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff952d42459800): rc 0 00000020:00000080:2.0:1782217092.316175:0:15606:0:(genops.c:906:class_export_put()) final put ffff952d42459800/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1782217092.316814:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff952d42006800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1782217092.316834:0:37:0:(genops.c:906:class_export_put()) final put ffff952d42003000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1782217092.316837:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff952d42003000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1782217092.316843:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1782217092.316896:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff952d42459800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1782217092.316915:0:15606:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1782217092.316918:0:15606:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1782217092.316920:0:15606:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1782217092.316924:0:15606:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1782217092.316937:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff952d4245c000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1782217092.317023:0:15606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782217092.317028:0:15606:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1782217092.317039:0:15606:0:(genops.c:906:class_export_put()) final put ffff952d42005800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1782217092.317041:0:15606:0:(genops.c:865:class_export_destroy()) destroying export ffff952d42005800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1782217092.317044:0:15606:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1782217092.317067:0:15606:0:(obd_mount.c:701:lustre_put_lsi()) put ffff952e74b5e800 1 00000020:00000080:3.0:1782217092.317071:0:15606:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f90dc 00000020:00000080:3.0:1782217092.317075:0:15606:0:(genops.c:906:class_export_put()) final put ffff952e74b79000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1782217092.317081:0:15606:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1782217092.317087:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff952e74b79000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1782217092.317096:0:15606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782217092.317099:0:15606:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1782217092.317101:0:15606:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff952e74c84d40) has no exports 00000020:00000080:3.0:1782217092.382773:0:15606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782217092.382787:0:15606:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1782217092.382793:0:15606:0:(genops.c:906:class_export_put()) final put ffff952e42f8e800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1782217092.382797:0:15606:0:(genops.c:865:class_export_destroy()) destroying export ffff952e42f8e800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1782217092.382809:0:15606:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1782217092.383110:0:15606:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff952e74b58000 00000020:02000400:3.0:1782217092.383277:0:15606:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1782217092.604747:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782217092.667652:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) 17bce19a-7a0f-4c9d-b31c-4e0155298487->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1782217092.667662:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) 17bce19a-7a0f-4c9d-b31c-4e0155298487->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1782217092.667665:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1782217092.667667:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1782217092.667735:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782217092.667749:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1868789713110784:0@lo:400:kworker.0 00000400:00000100:0.0:1782217092.667794:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868789713110784 offset 0 length 224: 4 00010000:00010000:1.0:1782217093.629202:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217094.650884:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782217095.357777:0:3646:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782217080/real 1782217080] req@ffff952e7c6f2680 x1868789713109888/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1782217095 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782217095.357824:0:3646:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff952e7c6f2680 x1868789713109888/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1782217095 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1782217095.357844:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952d430ff800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1782217095.357862:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1782217095.357867:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1868789713109888:0@lo:38:kworker.0 00000100:00080000:2.0:1782217095.357897:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) 17bce19a-7a0f-4c9d-b31c-4e0155298487->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1782217095.357908:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) 17bce19a-7a0f-4c9d-b31c-4e0155298487->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782217095.357911:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1782217095.357914:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1782217095.357917:0:37:0:(import.c:65:import_set_state_nolock()) ffff952d430ff800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782217095.357921:0:37:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 443 00000100:00080000:2.0:1782217095.357926:0:37:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1782217095.357933:0:37:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff952d430ff800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1782217095.357963:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff952d43cb2680 x1868789713110912/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782217095.358035:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43cb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1868789713111040:0@lo:400:kworker.0 00000400:00000100:2.0:1782217095.358082:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868789713111040 offset 0 length 224: 4 00000100:00100000:2.0:1782217095.358140:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43cb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1868789713110912:0@lo:38:kworker.0 00000400:00000100:2.0:1782217095.358160:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868789713110912 offset 0 length 520: 4 00010000:00010000:0.0:1782217095.673426:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1782217096.085268:0:15808:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1782217096.104046:0:15808:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1782217096.104138:0:15808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7b363400/0x92b8e04cbf5f9398 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f939f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217096.104152:0:15808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7b363400/0x92b8e04cbf5f9398 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f939f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217096.104159:0:15808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7b363400/0x92b8e04cbf5f9398 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x92b8e04cbf5f939f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217096.104167:0:15808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff952e7b363400/0x92b8e04cbf5f9398 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x92b8e04cbf5f939f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217096.104202:0:15808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1782217096.104208:0:15808:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1782217096.104233:0:15808:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1782217096.104244:0:15808:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff952d43cb2680 x1868789713110912/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1782217115 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217096.104262:0:15808:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1782217096.104268:0:15808:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1782217096.104273:0:15808:0:(import.c:65:import_set_state_nolock()) ffff952d430ff800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1782217096.104278:0:15808:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1782217096.104281:0:15808:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff952d43cb2680 x1868789713110912/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1782217115 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217096.104289:0:15808:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1782217096.104292:0:15808:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00010000:00010000:0.0:1782217096.104564:0:10336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782217096.104571:0:10336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e7b363400/0x92b8e04cbf5f9398 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x92b8e04cbf5f939f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217096.104580:0:10336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b363400 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:0.0:1782217096.104608:0:10336:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e7b363400/0x92b8e04cbf5f9398 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x92b8e04cbf5f939f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217096.104618:0:10336:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e7b363400/0x92b8e04cbf5f9398 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x92b8e04cbf5f939f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782217096.104626:0:10336:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e7b363400/0x92b8e04cbf5f9398 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x92b8e04cbf5f939f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782217096.104633:0:10336:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1782217096.104635:0:10336:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1782217096.104638:0:10336:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1782217096.104650:0:10336:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff952e64ec6800 00010000:00010000:0.0:1782217096.104654:0:10336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e7b363400/0x92b8e04cbf5f9398 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x92b8e04cbf5f939f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217096.104661:0:10336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e7b363400/0x92b8e04cbf5f9398 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x92b8e04cbf5f939f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217096.104672:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217096.104680:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217096.104682:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782217096.105162:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43cb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1868789713110912:0@lo:38:kworker.0 00000100:00080000:3.0:1782217096.106431:0:15808:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1782217096.106442:0:15808:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff952e7c6f3100 x1868789713110016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217096 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217096.106474:0:15808:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff952e46da4700 x1868789713110272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217098 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217096.106489:0:15808:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff952d43cb3480 x1868789713110400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217101 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217096.106506:0:15808:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff952e46da4380 x1868789713110656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217103 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217096.106520:0:15808:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff952e46da5880 x1868789713110784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217108 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217096.106528:0:15808:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff952d43cb1880 x1868789713111040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217111 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217096.106550:0:15808:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:3.0:1782217096.106578:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1868789713110656:0@lo:400:kworker.0 00000100:00080000:3.0:1782217096.106623:0:15808:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1782217096.106643:0:15808:0:(import.c:65:import_set_state_nolock()) ffff952e7dbbf800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1782217096.107119:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43cb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1868789713111040:0@lo:400:kworker.0 00000100:00100000:2.0:1782217096.107129:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1868789713110784:0@lo:400:kworker.0 00000100:00100000:2.0:1782217096.107135:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1868789713110272:0@lo:400:kworker.0 00000100:00100000:2.0:1782217096.107162:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1868789713111168:0@lo:39:umount.0 00000400:00000100:2.0:1782217096.107203:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1868789713111168 offset 0 length 224: 4 00000100:00100000:0.0:1782217096.107361:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1868789713110016:0@lo:400:kworker.0 00000100:00100000:0.0:1782217096.107413:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43cb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1868789713110400:0@lo:400:kworker.0 00010000:00010000:1.0:1782217096.700851:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217097.722008:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217098.744776:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217099.769673:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217100.797536:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782217100.857170:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) 17bce19a-7a0f-4c9d-b31c-4e0155298487->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1782217100.857180:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) 17bce19a-7a0f-4c9d-b31c-4e0155298487->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1782217101.817538:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782217102.265346:0:3646:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782217087/real 1782217087] req@ffff952e46da7100 x1868789713110528/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1782217102 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782217102.265519:0:3646:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff952e46da7100 x1868789713110528/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1782217102 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1782217102.265539:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952e64ec6800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1782217102.265567:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1782217102.265570:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:17bce19a-7a0f-4c9d-b31c-4e0155298487:3646:1868789713110528:0@lo:250:kworker.0 00000100:00080000:3.0:1782217102.265673:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) 17bce19a-7a0f-4c9d-b31c-4e0155298487->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1782217102.265679:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1782217102.265682:0:37:0:(import.c:65:import_set_state_nolock()) ffff952e64ec6800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782217102.265686:0:37:0:(import.c:512:import_select_connection()) MGC192.168.203.130@tcp: connect to NID 0@lo last attempt 450 00000100:00080000:3.0:1782217102.265692:0:37:0:(import.c:591:import_select_connection()) MGC192.168.203.130@tcp: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1782217102.265699:0:37:0:(import.c:626:import_select_connection()) MGC192.168.203.130@tcp: import ffff952e64ec6800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1782217102.265726:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff952e7c6f1180 x1868789713111296/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782217102.265994:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:17bce19a-7a0f-4c9d-b31c-4e0155298487:3646:1868789713111296:0@lo:250:kworker.0 00000400:00000100:2.0:1782217102.266032:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1868789713111296 offset 0 length 520: 4 00010000:00010000:0.0:1782217102.841645:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217103.864853:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217104.889200:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217105.912739:0:10337:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782217106.362751:0:3646:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782217096/real 1782217096] req@ffff952e7c6f0e00 x1868789713111168/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782217106 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782217106.362783:0:3646:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff952e7c6f0e00 x1868789713111168/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782217106 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1782217106.362804:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952e7dbbf800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1782217106.362829:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1868789713111168:0@lo:39:umount.0 00000100:00080000:3.0:1782217106.365446:0:15808:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1782217106.365454:0:15808:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1782217106.365461:0:15808:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1782217106.367301:0:15808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7b363800/0x92b8e04cbf5f93ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f93b4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217106.367389:0:15808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7b363800/0x92b8e04cbf5f93ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f93b4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217106.367396:0:15808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7b363800/0x92b8e04cbf5f93ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x92b8e04cbf5f93b4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217106.367402:0:15808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff952e7b363800/0x92b8e04cbf5f93ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x92b8e04cbf5f93b4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217106.367446:0:15808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782217106.367454:0:15808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e4121d400/0x92b8e04cbf5f9638 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5f963f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217106.367461:0:15808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e4121d400/0x92b8e04cbf5f9638 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5f963f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217106.367467:0:15808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e4121d400/0x92b8e04cbf5f9638 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x92b8e04cbf5f963f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217106.367473:0:15808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff952e4121d400/0x92b8e04cbf5f9638 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x92b8e04cbf5f963f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217106.367494:0:15808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1782217106.367499:0:15808:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1782217106.367528:0:15808:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1782217106.367533:0:15808:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1782217106.367539:0:15808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782217106.367544:0:15808:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1782217106.367547:0:15808:0:(genops.c:1579:class_disconnect_exports()) OBD device 24 (ffff952e502199c0) has no exports 00000020:00080000:3.0:1782217106.367569:0:15808:0:(genops.c:1579:class_disconnect_exports()) OBD device 24 (ffff952e502199c0) has no exports 00010000:00010000:0.0:1782217106.368698:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782217106.368719:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e7b363800/0x92b8e04cbf5f93ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x92b8e04cbf5f93b4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217106.368730:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b363800 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:0.0:1782217106.368734:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e7b363800/0x92b8e04cbf5f93ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x92b8e04cbf5f93b4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217106.368744:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e7b363800/0x92b8e04cbf5f93ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x92b8e04cbf5f93b4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782217106.368752:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e7b363800/0x92b8e04cbf5f93ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x92b8e04cbf5f93b4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782217106.368758:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1782217106.368760:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1782217106.368763:0:6507:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1782217106.368788:0:6507:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff952e64ec6800 00010000:00010000:0.0:1782217106.368800:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e7b363800/0x92b8e04cbf5f93ad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x92b8e04cbf5f93b4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217106.368807:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e7b363800/0x92b8e04cbf5f93ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x92b8e04cbf5f93b4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217106.368820:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782217106.368824:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e4121d400/0x92b8e04cbf5f9638 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x92b8e04cbf5f963f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217106.368830:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121d400 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:0.0:1782217106.368832:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e4121d400/0x92b8e04cbf5f9638 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x92b8e04cbf5f963f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217106.368838:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e4121d400/0x92b8e04cbf5f9638 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x92b8e04cbf5f963f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782217106.368844:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e4121d400/0x92b8e04cbf5f9638 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x92b8e04cbf5f963f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782217106.368849:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1782217106.368851:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1782217106.368853:0:6507:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1782217106.368857:0:6507:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff952e64ec6800 00010000:00010000:0.0:1782217106.368860:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e4121d400/0x92b8e04cbf5f9638 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x92b8e04cbf5f963f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217106.368866:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e4121d400/0x92b8e04cbf5f9638 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x92b8e04cbf5f963f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217106.368877:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217106.368882:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217106.368884:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217106.368937:0:10336:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1782217106.374970:0:15808:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff952e7c4acd20 - data ffff952d41c39e58/ffff952e7c79e400 00000020:01000000:3.0:1782217106.375098:0:15808:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff952d4262cde0 - data ffff952e6519ca20/ffff952e7c6f6800 00100000:10000000:3.0:1782217106.387307:0:15808:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1782217106.407813:0:15808:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f923a 00000020:00000080:3.0:1782217106.407824:0:15808:0:(genops.c:906:class_export_put()) final put ffff952d430f8000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1782217106.407902:0:15808:0:(tgt_mount.c:187:server_put_mount()) put mount ffff952e7dbbd800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1782217106.407907:0:15808:0:(obd_mount.c:701:lustre_put_lsi()) put ffff952e7dbbd800 2 00000020:01000004:3.0:1782217106.407910:0:15808:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff952e7dbbd800 from lustre-OST0001 00000020:00000080:3.0:1782217106.407949:0:15808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782217106.407959:0:15808:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1782217106.407962:0:15808:0:(genops.c:906:class_export_put()) final put ffff952d430f8800/lustre-OST0001_UUID 00000020:00000080:3.0:1782217106.407965:0:15808:0:(genops.c:865:class_export_destroy()) destroying export ffff952d430f8800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1782217106.407971:0:15808:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1782217106.408118:0:15808:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import 17bce19a-7a0f-4c9d-b31c-4e0155298487->MGS 00010000:00010000:3.0:1782217106.408131:0:15808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e413fd400/0x92b8e04cbf5f8f93 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x92b8e04cbf5f8f9a expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782217106.408143:0:15808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e413fd400/0x92b8e04cbf5f8f93 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x92b8e04cbf5f8f9a expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782217106.408150:0:15808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1782217106.408153:0:15808:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1782217106.408155:0:15808:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1782217106.408180:0:15808:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff952e64ec6800 00010000:00010000:3.0:1782217106.408183:0:15808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e413fd400/0x92b8e04cbf5f8f93 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x92b8e04cbf5f8f9a expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217106.408198:0:15808:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e7b363600/0x92b8e04cbf5f9416 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x92b8e04cbf5f941d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782217106.408205:0:15808:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e7b363600/0x92b8e04cbf5f9416 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x92b8e04cbf5f941d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782217106.408210:0:15808:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1782217106.408212:0:15808:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1782217106.408213:0:15808:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1782217106.408230:0:15808:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff952e64ec6800 00010000:00010000:3.0:1782217106.408233:0:15808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e7b363600/0x92b8e04cbf5f9416 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x92b8e04cbf5f941d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1782217106.408654:0:15808:0:(import.c:65:import_set_state_nolock()) ffff952e64ec6800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1782217106.408659:0:15808:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1782217106.408662:0:15808:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1782217106.408663:0:15808:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1782217106.408667:0:15808:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1782217106.408678:0:15808:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff952e7c6f1180 x1868789713111296/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1782217122 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1782217106.408700:0:15808:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1782217106.408703:0:15808:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 21s for inflight to error out 00000100:00100000:3.0:1782217106.408753:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:17bce19a-7a0f-4c9d-b31c-4e0155298487:3646:1868789713111296:0@lo:250:kworker.0 10000000:01000000:3.0:1782217106.408781:0:15808:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1782217106.408787:0:15808:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f8e90 00000020:00000080:3.0:1782217106.408791:0:15808:0:(genops.c:906:class_export_put()) final put ffff952e42f88800/17bce19a-7a0f-4c9d-b31c-4e0155298487 00000020:00000080:0.0:1782217106.416340:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952d430f8000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1782217106.420383:0:15808:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.203.130@tcp (flags='') 00000020:00000080:1.0:1782217106.420539:0:15808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782217106.420547:0:15808:0:(obd_config.c:955:class_cleanup()) MGC192.168.203.130@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1782217106.420551:0:15808:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff952e5021b380) has no exports 00000020:00000080:0.0:1782217106.420742:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952e42f88800/17bce19a-7a0f-4c9d-b31c-4e0155298487 for MGC192.168.203.130@tcp 10000000:01000000:3.0:1782217106.420827:0:6516:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1782217106.420933:0:15808:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.203.130@tcp: client import never connected 00000100:00080000:1.0:1782217106.420938:0:15808:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1782217106.420942:0:15808:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1782217106.420945:0:15808:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1782217106.420947:0:15808:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1782217106.420990:0:15808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782217106.420996:0:15808:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.130@tcp (uuid 17bce19a-7a0f-4c9d-b31c-4e0155298487) 00000020:01000000:1.0:1782217106.421001:0:15808:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1782217106.421019:0:15808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782217106.421024:0:15808:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1782217106.421031:0:15808:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff952e7b2ce000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1782217106.421037:0:15808:0:(genops.c:1574:class_disconnect_exports()) OBD device 25 (ffff952d43340000) has exports, disconnecting them 00000020:00080000:1.0:1782217106.421042:0:15808:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff952e7b2ce000), last request at 1782216881 00000020:00000080:1.0:1782217106.421047:0:15808:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f9264 00000020:00080000:1.0:1782217106.421061:0:15808:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff952e7b2ce000): rc 0 00000020:00000080:1.0:1782217106.421065:0:15808:0:(genops.c:906:class_export_put()) final put ffff952e7b2ce000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1782217106.422183:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff952e64ec6800 for MGC192.168.203.130@tcp 00000020:00000080:0.0:1782217106.422194:0:36:0:(genops.c:906:class_export_put()) final put ffff952e64ec0800/17bce19a-7a0f-4c9d-b31c-4e0155298487 00000020:00000080:0.0:1782217106.422198:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952e64ec0800/17bce19a-7a0f-4c9d-b31c-4e0155298487 for MGC192.168.203.130@tcp 00000020:01000000:0.0:1782217106.422206:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.130@tcp (17bce19a-7a0f-4c9d-b31c-4e0155298487) 00000020:00000080:0.0:1782217106.422491:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952e7b2ce000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1782217106.422530:0:15808:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1782217106.422534:0:15808:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1782217106.422538:0:15808:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1782217106.422543:0:15808:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1782217106.422691:0:15808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782217106.422699:0:15808:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1782217106.422705:0:15808:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1782217106.422709:0:15808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782217106.422713:0:15808:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1782217106.422719:0:15808:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff952d4229b800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1782217106.422725:0:15808:0:(genops.c:1574:class_disconnect_exports()) OBD device 26 (ffff952d433419c0) has exports, disconnecting them 00000020:00080000:0.0:1782217106.422729:0:15808:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff952d4229b800), last request at 1782216881 00000020:00000080:0.0:1782217106.422732:0:15808:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f9272 00000020:00080000:0.0:1782217106.422744:0:15808:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff952d4229b800): rc 0 00000020:00000080:0.0:1782217106.422749:0:15808:0:(genops.c:906:class_export_put()) final put ffff952d4229b800/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1782217106.423375:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff952d430ff800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1782217106.423383:0:36:0:(genops.c:906:class_export_put()) final put ffff952d430fd000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1782217106.423386:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952d430fd000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1782217106.423394:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1782217106.423446:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952d4229b800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1782217106.506662:0:15808:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1782217106.506672:0:15808:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1782217106.506677:0:15808:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1782217106.506684:0:15808:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1782217106.506720:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff952e7dbbf800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1782217106.507299:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1782217106.507638:0:10337:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1782217106.508466:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:3.0:1782217106.508678:0:10336:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:3.0:1782217106.508787:0:6503:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff952e7081c800:6503] 1 exiting: rc = 0 00000100:00100000:2.0:1782217106.510645:0:6502:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff952e42c72a00:6502] 0 exiting: rc = 1 00000100:00100000:3.0:1782217106.510865:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.511129:0:8449:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff952d41be2400:8449] 3 exiting: rc = 0 00000100:00100000:3.0:1782217106.511190:0:6505:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff952e6fa26c00:6505] 1 exiting: rc = 0 00000100:00100000:2.0:1782217106.513261:0:13731:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff952d432f1e00:13731] 4 exiting: rc = 0 00000100:00100000:2.0:1782217106.513404:0:6504:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff952e42c72c00:6504] 0 exiting: rc = 1 00000100:00100000:2.0:1782217106.513474:0:6506:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff952e6fa27e00:6506] 2 exiting: rc = 0 00000100:00100000:3.0:1782217106.513606:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513616:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513633:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513640:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513645:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513650:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513656:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513662:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513667:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513673:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513678:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513683:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513689:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513695:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513701:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513707:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513713:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513719:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513724:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513733:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513740:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513745:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513750:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513755:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513760:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513765:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513771:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513776:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513783:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513789:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513793:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513798:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513816:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513822:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513827:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513832:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513836:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513841:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513846:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513851:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513855:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513860:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513865:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513869:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513874:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513879:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513883:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513889:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513894:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513899:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513904:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513909:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513914:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513919:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513924:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513930:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513935:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513940:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513945:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513950:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513955:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513960:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513965:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.513969:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1782217106.516184:0:15808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782217106.516196:0:15808:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1782217106.516202:0:15808:0:(genops.c:906:class_export_put()) final put ffff952d430fd800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1782217106.516216:0:15808:0:(genops.c:865:class_export_destroy()) destroying export ffff952d430fd800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1782217106.516222:0:15808:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1782217106.516280:0:15808:0:(obd_mount.c:701:lustre_put_lsi()) put ffff952e7dbbd800 1 00000020:00000080:3.0:1782217106.516287:0:15808:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x92b8e04cbf5f9209 00000020:00000080:3.0:1782217106.516294:0:15808:0:(genops.c:906:class_export_put()) final put ffff952d4229e800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1782217106.516311:0:15808:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1782217106.516323:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff952d4229e800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1782217106.516335:0:15808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782217106.516340:0:15808:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1782217106.516344:0:15808:0:(genops.c:1579:class_disconnect_exports()) OBD device 23 (ffff952d4272b380) has no exports 00000020:00000080:3.0:1782217106.578726:0:15808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782217106.578739:0:15808:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1782217106.578744:0:15808:0:(genops.c:906:class_export_put()) final put ffff952e7dbbe800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1782217106.578749:0:15808:0:(genops.c:865:class_export_destroy()) destroying export ffff952e7dbbe800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1782217106.578755:0:15808:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1782217106.579155:0:15808:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff952e7dbbf000 00000020:01000000:3.0:1782217106.583012:0:15808:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1782217106.583022:0:15808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782217106.583028:0:15808:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1782217106.583033:0:15808:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff952e74c83380) has no exports 00000020:00000080:3.0:1782217106.583066:0:15808:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782217106.583077:0:15808:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1782217106.583081:0:15808:0:(genops.c:906:class_export_put()) final put ffff952e74b7c800/OSS_uuid 00000020:00000080:3.0:1782217106.583085:0:15808:0:(genops.c:865:class_export_destroy()) destroying export ffff952e74b7c800/OSS_uuid for OSS 00000020:01000000:3.0:1782217106.583090:0:15808:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1782217106.583398:0:14273:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff952e54d7f800:14273] 4 exiting: rc = 0 00000100:00100000:0.0:1782217106.583505:0:8432:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff952e4897d000:8432] 0 exiting: rc = 1 00000100:00100000:0.0:1782217106.583561:0:8435:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff952e7c438400:8435] 2 exiting: rc = 0 00000100:00080000:0.0:1782217106.583643:0:6515:0:(pinger.c:550:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1782217106.583674:0:8434:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff952e7c42ec00:8434] 1 exiting: rc = 0 00000100:00100000:0.0:1782217106.583743:0:10025:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff952d427ada00:10025] 3 exiting: rc = 0 00000100:00100000:3.0:1782217106.583825:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.583915:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.583924:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.583929:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.583934:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.583939:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.583943:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.583969:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.583975:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.583979:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.583984:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.583988:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.583993:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.583998:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.584003:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.584086:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.584094:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.584099:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.584105:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.584109:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.584114:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.584119:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.584124:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.584129:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.584134:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.584138:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.584143:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.584148:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.584152:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.584157:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.584294:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.584300:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.584305:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.584310:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.584316:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.584321:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.584326:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.584331:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.584336:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.584341:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.584347:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.584352:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.584364:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.584368:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.584373:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.584378:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.584382:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.584387:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.584391:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.584396:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.584401:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.584406:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.584410:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.584416:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.584420:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.584425:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.584431:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.584435:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.584440:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.584444:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.584449:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.584454:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.584459:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.584463:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782217106.586082:0:8437:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff952e74b56800:8437] 1 exiting: rc = 0 00000100:00100000:1.0:1782217106.589514:0:10535:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff952d43671e00:10535] 2 exiting: rc = 0 00000100:00100000:2.0:1782217106.590488:0:8436:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff952e74b57400:8436] 0 exiting: rc = 1 00000100:00100000:0.0:1782217106.590814:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.590823:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.590829:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.590898:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.590909:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.590914:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.590918:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.590923:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.590928:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.590933:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.590939:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.590944:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.590949:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.590954:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.590958:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.590963:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.590968:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.590972:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.590977:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.590982:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.590986:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.590991:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.590996:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.591001:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.591005:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.591011:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.591016:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.591021:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.591026:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.591032:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.591037:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.591042:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.591047:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.591063:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.591068:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.591073:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.591078:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.591082:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.591087:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.591092:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.591097:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.591102:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.591107:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.591112:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.591117:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.591126:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.591131:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.591137:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.591142:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.591147:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.591153:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.591228:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.591237:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.591241:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.591255:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.591261:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.591265:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.591270:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.591275:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.591280:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.591285:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.591289:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.591294:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.591305:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.593929:0:8439:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff952e749fbc00:8439] 1 exiting: rc = 0 00000100:00100000:1.0:1782217106.594115:0:8438:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff952e749fbe00:8438] 0 exiting: rc = 1 00000100:00100000:0.0:1782217106.597773:0:8440:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff952e4608ee00:8440] 2 exiting: rc = 0 00000100:00100000:1.0:1782217106.597869:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.597879:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.597886:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.597892:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.597898:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.597904:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.597909:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.597915:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.597919:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.597925:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.597931:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.597936:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.597941:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.597946:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.597951:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.597957:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.597978:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.597985:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.597991:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.598006:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.598013:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.598018:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.598024:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.598029:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.598035:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.598040:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.598045:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.598050:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.598055:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.598060:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.598065:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.598070:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.598076:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.598080:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.598085:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.598091:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.598097:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.598102:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.598107:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.598113:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.598131:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.598139:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.598145:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.598150:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.598156:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.598162:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.598167:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.598173:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.598179:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.598184:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.598189:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.598195:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.598200:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.598206:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.598220:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.598225:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.598231:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.598245:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.598267:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.598290:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.598296:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.598302:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.598306:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.598327:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782217106.605850:0:8442:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff952e7c42cc00:8442] 1 exiting: rc = 0 00000100:00100000:0.0:1782217106.605870:0:8441:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff952e7081c200:8441] 0 exiting: rc = 1 00000100:00100000:0.0:1782217106.608113:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608122:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608139:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608144:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608149:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608307:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608317:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608322:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608327:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608333:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608338:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608344:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608348:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608354:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608379:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608386:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608391:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608397:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608402:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608407:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608412:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608417:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608422:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608427:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608433:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608438:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608443:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608447:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608509:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608518:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608523:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608528:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608533:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608538:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608544:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608548:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608553:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608564:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608573:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608579:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608643:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608649:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608655:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608661:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608665:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608670:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608675:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608681:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608691:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608699:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608703:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608708:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608712:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608717:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608721:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608726:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608731:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608736:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608740:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608744:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608749:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608753:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608757:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782217106.608761:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.621777:0:8444:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff952d41b35c00:8444] 1 exiting: rc = 0 00000100:00100000:1.0:1782217106.622819:0:8443:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff952e7081c000:8443] 0 exiting: rc = 1 00000100:00100000:2.0:1782217106.623032:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623040:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623059:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623079:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623086:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623092:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623098:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623104:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623110:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623116:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623122:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623128:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623133:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623139:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623145:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623162:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623167:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623173:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623179:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623185:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623192:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623198:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623203:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623212:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623217:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623223:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623229:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623259:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623268:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623286:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623292:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623298:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623304:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623318:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623324:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623331:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623338:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623352:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623358:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623378:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623386:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623393:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623399:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623406:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623411:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623417:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623424:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623429:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623435:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623440:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623446:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623467:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623474:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623481:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623486:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623492:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623498:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623505:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623510:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623517:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623522:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623527:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623533:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782217106.623550:0:15808:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1782217106.649198:0:15808:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1782217127.603024:0:16574:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1782217137.856678:0:17173:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1782217137.856684:0:17173:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1782217137.856686:0:17173:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1782217137.856793:0:17173:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff952d43f05800 00000020:01000004:2.0:1782217137.856807:0:17173:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1782217137.856814:0:17173:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1782217137.856828:0:17173:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff952e7dbdcd40) 00000020:00000080:2.0:1782217137.856846:0:17173:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1782217138.004620:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1782217138.007687:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1782217138.014090:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1782217138.015363:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1782217138.015794:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1782217138.015996:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1782217138.016326:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1782217138.020213:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1782217138.020748:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1782217138.022810:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1782217138.023212:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1782217138.023420:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1782217138.023824:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1782217138.024047:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1782217138.024290:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1782217138.028181:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1782217138.028768:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1782217138.031368:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1782217138.031902:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1782217138.033452:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1782217138.033995:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1782217138.034515:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1782217138.035211:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1782217138.035483:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1782217138.035945:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1782217138.036226:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1782217138.036931:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1782217138.037234:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1782217138.037502:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1782217138.037974:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1782217138.038195:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1782217138.038426:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1782217138.039009:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1782217138.041056:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1782217138.042348:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1782217138.049154:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1782217138.049566:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1782217138.049841:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1782217138.050159:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1782217138.050439:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1782217138.051009:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1782217138.051221:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1782217138.051551:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1782217138.051841:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1782217138.052015:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1782217138.052218:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1782217138.052400:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1782217138.053311:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1782217138.054482:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1782217138.055246:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1782217138.055806:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1782217138.055995:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1782217138.056184:0:17173:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:3.0:1782217138.057177:0:17173:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1782217138.057384:0:17173:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1782217138.057392:0:17173:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1782217138.057403:0:17173:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x92b8e04cbf5fa44d 00000020:01000004:3.0:1782217138.057409:0:17173:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1782217138.057414:0:17173:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1782217138.057420:0:17173:0:(tgt_mount.c:101:server_register_mount()) register mount ffff952d43f05800 from MGS 00000020:01000004:3.0:1782217138.057424:0:17173:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1782217138.057433:0:17173:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff952d433419c0) 00000020:00000080:3.0:1782217138.057443:0:17173:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1782217138.057637:0:17173:0:(tgt_mount.c:153:server_get_mount()) get mount ffff952d43f05800 from MGS, refs=2 00080000:01000000:3.0:1782217138.057643:0:17173:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1782217138.057648:0:17173:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x92b8e04cbf5fa45b 00000100:00100000:3.0:1782217138.057737:0:17173:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1782217138.057852:0:17173:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1782217138.057859:0:17173:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1782217138.058439:0:17173:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1782217138.058446:0:17173:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1782217138.059227:0:17173:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782217138.059367:0:17173:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1782217138.059372:0:17173:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1782217138.059897:0:17173:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1782217138.059903:0:17173:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1782217138.060168:0:17173:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1782217138.060174:0:17173:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1782217138.060720:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217138.060724:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217138.060725:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217138.061039:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217138.061041:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217138.061043:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217138.061430:0:17173:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1782217138.063006:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1782217138.066291:0:17173:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1782217138.067096:0:17185:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1782217138.067151:0:17173:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1782217138.067190:0:17173:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1782217138.067922:0:17173:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1782217138.068261:0:17173:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782217138.068406:0:17173:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1782217138.068414:0:17173:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1782217138.069090:0:17173:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1782217138.069152:0:17173:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1782217138.073955:0:17173:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1782217138.073969:0:17173:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1782217138.074657:0:17173:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1782217138.074678:0:17173:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.203.130@tcp' 00000020:01000004:2.0:1782217138.074680:0:17173:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1782217138.074706:0:17173:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.203.130@tcp (typ=mgc) 00000020:00000080:2.0:1782217138.074717:0:17173:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.130@tcp (ffff952e7dbdb380) 00000020:00000080:2.0:1782217138.074732:0:17173:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1782217138.074805:0:17173:0:(ldlm_lib.c:102:import_set_conn()) imp ffff952d43f05000@MGC192.168.203.130@tcp: add connection 192.168.203.130@tcp at head 00010000:00010000:2.0:1782217138.074942:0:17173:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.130@tcp-0 is initialized 00000040:01000000:2.0:1782217138.074948:0:17173:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.130@tcp ctxt 1 is initialized 00000100:00080000:1.0:1782217138.075281:0:17190:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1782217138.080167:0:17191:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1782217138.080261:0:17173:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.130@tcp (uuid a1470210-3884-42c5-8d09-248d2ed946c2) 00000020:00000080:0.0:1782217138.080342:0:17173:0:(genops.c:1406:class_connect()) connect: client a1470210-3884-42c5-8d09-248d2ed946c2, cookie 0x92b8e04cbf5fa469 00000100:00080000:0.0:1782217138.080356:0:17173:0:(import.c:512:import_select_connection()) MGC192.168.203.130@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782217138.080361:0:17173:0:(import.c:626:import_select_connection()) MGC192.168.203.130@tcp: import ffff952d43f05000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1782217138.080447:0:17173:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff952e46da4000 x1868789713111424/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782217138.080474:0:17173:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import a1470210-3884-42c5-8d09-248d2ed946c2->MGS 00000020:01000004:0.0:1782217138.080487:0:17173:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1782217138.080491:0:17173:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1782217138.080503:0:17173:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff952e74c83380) 00000020:00000080:0.0:1782217138.080514:0:17173:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1782217138.084618:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a1470210-3884-42c5-8d09-248d2ed946c2:3646:1868789713111424:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1782217138.084704:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217138.085073:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713111424 00000100:00100000:3.0:1782217138.085081:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713111424 00000100:00100000:3.0:1782217138.085125:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782217138.085133:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42289050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3646:x1868789713111424:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1782217138.085160:0:17186:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from a1470210-3884-42c5-8d09-248d2ed946c2@0@lo t0 exp 0000000000000000 cur 501 last 0 00000020:00000080:3.0:1782217138.085188:0:17186:0:(genops.c:1406:class_connect()) connect: client a1470210-3884-42c5-8d09-248d2ed946c2, cookie 0x92b8e04cbf5fa477 00000100:00080000:3.0:1782217138.085311:0:17186:0:(import.c:65:import_set_state_nolock()) ffff952e589ee000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782217138.085368:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42289050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+5:3646:x1868789713111424:12345-0@lo:250:mount.lustre.0 Request processed in 234us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217138.085376:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782217138.085413:0:3646:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.203.130@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1782217138.085422:0:3646:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.203.130@tcp: connect to target with instance 0 00000100:00080000:3.0:1782217138.085430:0:3646:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.203.130@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1782217138.085434:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1782217138.085438:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952d43f05000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1782217138.085440:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1782217138.085457:0:3646:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1782217138.085465:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a1470210-3884-42c5-8d09-248d2ed946c2:3646:1868789713111424:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1782217138.094138:0:17173:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782217138.094318:0:17173:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1782217138.094323:0:17173:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1782217138.095655:0:17173:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1782217138.095665:0:17173:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1782217138.097305:0:17173:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1782217138.097317:0:17173:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1782217138.098199:0:17173:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782217138.098349:0:17173:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1782217138.098355:0:17173:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1782217138.099254:0:17173:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1782217138.099262:0:17173:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1782217138.138657:0:17173:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782217138.138830:0:17173:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1782217138.138835:0:17173:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1782217138.140066:0:17173:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1782217138.140076:0:17173:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1782217138.141554:0:17173:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782217138.141919:0:17173:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1782217138.141924:0:17173:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1782217138.142557:0:17173:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1782217138.142564:0:17173:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1782217138.143116:0:17173:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782217138.143401:0:17173:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1782217138.143406:0:17173:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1782217138.143885:0:17173:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1782217138.143892:0:17173:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1782217138.147225:0:17173:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782217138.147392:0:17173:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1782217138.147398:0:17173:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1782217138.148222:0:17173:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1782217138.148230:0:17173:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1782217138.166871:0:17173:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782217138.167069:0:17173:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1782217138.167077:0:17173:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1782217138.168197:0:17173:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1782217138.168206:0:17173:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1782217138.168928:0:17173:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1782217138.168936:0:17173:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1782217138.169783:0:17173:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1782217138.169810:0:17173:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1782217138.169817:0:17173:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.130@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1782217138.169914:0:17173:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.130@tcp ctxt 0 is initialized 00000020:01000004:3.0:1782217138.169947:0:17173:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.130@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1782217138.169952:0:17173:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1782217138.169953:0:17173:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782217138.169955:0:17173:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782217138.169956:0:17173:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782217138.169957:0:17173:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782217138.169958:0:17173:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782217138.169959:0:17173:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782217138.169961:0:17173:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782217138.169962:0:17173:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782217138.169964:0:17173:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782217138.169966:0:17173:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1782217138.169969:0:17173:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782217138.169970:0:17173:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782217138.169971:0:17173:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782217138.169972:0:17173:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782217138.169973:0:17173:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782217138.169974:0:17173:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782217138.169975:0:17173:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782217138.169976:0:17173:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782217138.169977:0:17173:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782217138.169978:0:17173:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782217138.170003:0:17173:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1782217138.170030:0:17173:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17173:1868789713111552:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1782217138.170101:0:17173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217138.170155:0:17173:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e42d449c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782217138.170218:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713111552 00000100:00100000:0.0:1782217138.170226:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713111552 00000100:00100000:0.0:1782217138.170268:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782217138.170283:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4228a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+5:17173:x1868789713111552:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1782217138.170325:0:17189:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1782217138.170328:0:17189:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1782217138.170331:0:17189:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1782217138.170525:0:17210:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1782217138.171097:0:17189:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:2.0:1782217138.172981:0:17211:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1782217138.172987:0:17211:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1782217138.172990:0:17211:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1782217138.172993:0:17211:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1782217138.173190:0:17211:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1782217138.173398:0:17189:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1782217138.173408:0:17189:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1782217138.175798:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4228a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+5:17173:x1868789713111552:12345-0@lo:253:mount.lustre.0 Request processed in 5511us (5691us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217138.175812:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782217138.176211:0:17173:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17173:1868789713111552:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1782217138.176227:0:17173:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1782217138.176230:0:17173:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782217138.176232:0:17173:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782217138.176233:0:17173:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782217138.176234:0:17173:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782217138.176235:0:17173:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782217138.176236:0:17173:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782217138.176238:0:17173:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782217138.176239:0:17173:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782217138.176241:0:17173:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782217138.176242:0:17173:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1782217138.176263:0:17173:0:(tgt_mount.c:101:server_register_mount()) register mount ffff952d43f05800 from lustre-MDT0000 10000000:01000000:3.0:1782217138.176292:0:17173:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1782217138.176294:0:17173:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1782217138.176299:0:17173:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff952e7dbdb380 10000000:01000000:3.0:1782217138.176303:0:17173:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782217138.176311:0:17173:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff952e7dbdb380 from 1 10000000:01000000:3.0:1782217138.176314:0:17173:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1782217138.176350:0:17173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e41681800/0x92b8e04cbf5fa47e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217138.176360:0:17173:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e41681800/0x92b8e04cbf5fa47e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217138.176369:0:17173:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e41681800/0x92b8e04cbf5fa47e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217138.176388:0:17173:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17173:1868789713111680:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782217138.176426:0:17173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217138.176463:0:17173:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e42d44780 going to sleep for 11 seconds 00000100:00100000:2.0:1782217138.176527:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713111680 00000100:00100000:2.0:1782217138.176533:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713111680 00000100:00100000:2.0:1782217138.176577:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782217138.176600:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42289c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+5:17173:x1868789713111680:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782217138.176622:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217138.176636:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e72e2d400/0x92b8e04cbf5fa485 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5fa47e expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217138.176657:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e72e2d400/0x92b8e04cbf5fa485 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa47e expref: 6 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217138.176667:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e72e2d400/0x92b8e04cbf5fa485 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa47e expref: 6 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217138.176675:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2d400, rc 0) 00000100:00100000:2.0:1782217138.176716:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42289c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+6:17173:x1868789713111680:12345-0@lo:101:mount.lustre.0 Request processed in 118us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217138.176721:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782217138.177323:0:17173:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17173:1868789713111680:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782217138.177338:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e41681800/0x92b8e04cbf5fa47e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa485 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217138.177347:0:17173:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e41681800/0x92b8e04cbf5fa47e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5fa485 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217138.177402:0:17173:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17173:1868789713111808:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782217138.177434:0:17173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217138.177465:0:17173:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e51ac3180 going to sleep for 11 seconds 00000100:00100000:2.0:1782217138.177633:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713111808 00000100:00100000:2.0:1782217138.177638:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713111808 00000100:00100000:2.0:1782217138.177667:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782217138.177675:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42288850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+6:17173:x1868789713111808:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782217138.177793:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42288850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+6:17173:x1868789713111808:12345-0@lo:501:mount.lustre.0 Request processed in 72us (311us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782217138.177802:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782217138.177878:0:17173:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17173:1868789713111808:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1782217138.177905:0:17173:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1782217138.177971:0:17173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e41681800/0x92b8e04cbf5fa47e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa485 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217138.177979:0:17173:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e41681800/0x92b8e04cbf5fa47e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa485 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782217138.177999:0:17173:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff952d43f05800 10000000:01000000:0.0:1782217138.178004:0:17173:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1782217138.178009:0:17173:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff952d43f05800 10000000:01000000:0.0:1782217138.178011:0:17173:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1782217138.178014:0:17173:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff952d43f05800 from 1 10000000:01000000:0.0:1782217138.178029:0:17173:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1782217138.178050:0:17173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e4121d000/0x92b8e04cbf5fa48c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217138.178057:0:17173:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e4121d000/0x92b8e04cbf5fa48c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217138.178065:0:17173:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e4121d000/0x92b8e04cbf5fa48c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217138.178077:0:17173:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17173:1868789713111936:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1782217138.178104:0:17173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217138.178129:0:17173:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e51ac3180 going to sleep for 11 seconds 00000100:00100000:2.0:1782217138.179635:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713111936 00000100:00100000:2.0:1782217138.179644:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713111936 00000100:00100000:2.0:1782217138.179686:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782217138.179695:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+6:17173:x1868789713111936:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782217138.179708:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217138.179723:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e72e2da00/0x92b8e04cbf5fa493 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5fa48c expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217138.179761:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e72e2da00/0x92b8e04cbf5fa493 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa48c expref: 7 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217138.179770:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e72e2da00/0x92b8e04cbf5fa493 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa48c expref: 7 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217138.179780:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2da00, rc 0) 00000100:00100000:2.0:1782217138.179828:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+7:17173:x1868789713111936:12345-0@lo:101:mount.lustre.0 Request processed in 133us (1723us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217138.179835:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782217138.179946:0:17173:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17173:1868789713111936:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782217138.179964:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e4121d000/0x92b8e04cbf5fa48c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa493 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217138.179973:0:17173:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e4121d000/0x92b8e04cbf5fa48c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5fa493 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782217138.179987:0:17173:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1782217138.179993:0:17173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e4121d000/0x92b8e04cbf5fa48c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa493 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217138.180024:0:17173:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e4121d000/0x92b8e04cbf5fa48c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa493 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782217138.180032:0:17173:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1782217138.180037:0:17173:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1782217138.180042:0:17173:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff952d43f05800 10000000:01000000:0.0:1782217138.180044:0:17173:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1782217138.180048:0:17173:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1782217138.180050:0:17173:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1782217138.180072:0:17173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e4121dc00/0x92b8e04cbf5fa49a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217138.180080:0:17173:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e4121dc00/0x92b8e04cbf5fa49a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217138.180088:0:17173:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e4121dc00/0x92b8e04cbf5fa49a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217138.180104:0:17173:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17173:1868789713112064:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1782217138.180134:0:17173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217138.180167:0:17173:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e51ac3180 going to sleep for 11 seconds 00000100:00100000:2.0:1782217138.180213:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713112064 00000100:00100000:2.0:1782217138.180218:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713112064 00000100:00100000:2.0:1782217138.180239:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782217138.180245:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4228b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+7:17173:x1868789713112064:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782217138.180252:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217138.180259:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e72e2c200/0x92b8e04cbf5fa4a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5fa49a expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217138.180272:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e72e2c200/0x92b8e04cbf5fa4a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa49a expref: 8 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217138.180281:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e72e2c200/0x92b8e04cbf5fa4a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa49a expref: 8 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217138.180288:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2c200, rc 0) 00000100:00100000:2.0:1782217138.180324:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4228b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+8:17173:x1868789713112064:12345-0@lo:101:mount.lustre.0 Request processed in 78us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217138.180330:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782217138.180399:0:17173:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17173:1868789713112064:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782217138.180410:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e4121dc00/0x92b8e04cbf5fa49a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa4a1 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217138.180418:0:17173:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e4121dc00/0x92b8e04cbf5fa49a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5fa4a1 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217138.180479:0:17173:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17173:1868789713112192:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782217138.180504:0:17173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217138.180523:0:17173:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e51ac3180 going to sleep for 11 seconds 00000100:00100000:2.0:1782217138.180569:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713112192 00000100:00100000:2.0:1782217138.180573:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713112192 00000100:00100000:2.0:1782217138.180610:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782217138.180618:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42288050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+8:17173:x1868789713112192:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782217138.180737:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42288050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+9:17173:x1868789713112192:12345-0@lo:501:mount.lustre.0 Request processed in 119us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217138.180744:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782217138.180900:0:17173:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17173:1868789713112192:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782217138.180926:0:17173:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17173:1868789713112320:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782217138.180961:0:17173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217138.180987:0:17173:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e51ac3180 going to sleep for 11 seconds 00000100:00100000:3.0:1782217138.181054:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713112320 00000100:00100000:3.0:1782217138.181064:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713112320 00000100:00100000:3.0:1782217138.181111:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782217138.181117:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4228a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+9:17173:x1868789713112320:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782217138.181939:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4228a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+9:17173:x1868789713112320:12345-0@lo:503:mount.lustre.0 Request processed in 819us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217138.181948:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782217138.182060:0:17173:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17173:1868789713112320:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782217138.184464:0:17212:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a1470210-3884-42c5-8d09-248d2ed946c2:17212:1868789713112448:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782217138.184631:0:17212:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217138.184666:0:17212:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e64b929c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782217138.184695:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713112448 00000100:00100000:2.0:1782217138.184701:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713112448 00000100:00100000:2.0:1782217138.184779:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782217138.184789:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4228a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+9:17212:x1868789713112448:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782217138.185555:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4228a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+9:17212:x1868789713112448:12345-0@lo:502:llog_process_th.0 Request processed in 764us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217138.185564:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782217138.185616:0:17212:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a1470210-3884-42c5-8d09-248d2ed946c2:17212:1868789713112448:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782217138.185707:0:17212:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782217138.185720:0:17212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782217138.185722:0:17212:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1782217138.185728:0:17212:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1782217138.185730:0:17212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782217138.185743:0:17212:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff952d42728000) 00000020:00000080:1.0:1782217138.185756:0:17212:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1782217138.185761:0:17212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1782217138.185832:0:17212:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:1.0:1782217138.185838:0:17212:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x92b8e04cbf5fa4af 00000020:00000080:1.0:1782217138.186009:0:17212:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1782217138.186013:0:17212:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782217138.186025:0:17212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782217138.186026:0:17212:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1782217138.186030:0:17212:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782217138.186033:0:17212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782217138.186034:0:17212:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1782217138.186037:0:17212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782217138.186044:0:17212:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff952d427299c0) 00000020:00000080:1.0:1782217138.186052:0:17212:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1782217138.186056:0:17212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1782217138.186058:0:17212:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1782217138.186060:0:17212:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1782217138.186065:0:17212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1782217138.186195:0:17212:0:(tgt_mount.c:153:server_get_mount()) get mount ffff952d43f05800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1782217138.186273:0:17212:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff952d4272cd40) 00000020:00000080:1.0:1782217138.186282:0:17212:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1782217138.186348:0:17212:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1782217138.186357:0:17212:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x92b8e04cbf5fa4c4 00000020:00000080:1.0:1782217138.186444:0:17212:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1782217138.186450:0:17212:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1782217138.186454:0:17212:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x92b8e04cbf5fa4cb 00080000:01000000:1.0:1782217138.186458:0:17212:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1782217138.186461:0:17212:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x92b8e04cbf5fa4d2 00010000:00010000:1.0:1782217138.251479:0:17212:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1782217138.251995:0:17212:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967530 00000001:00080000:1.0:1782217138.253438:0:17212:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1782217138.253878:0:17212:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff952d4272b380) 00000020:00000080:1.0:1782217138.253895:0:17212:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1782217138.253975:0:17212:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:1.0:1782217138.253981:0:17212:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x92b8e04cbf5fa4e0 00000020:00000080:0.0:1782217138.260349:0:17212:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1782217138.266038:0:17212:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x92b8e04cbf5fa4e7 00000020:00000080:1.0:1782217138.277283:0:17212:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1782217138.277295:0:17212:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782217138.277301:0:17212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782217138.277303:0:17212:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1782217138.277307:0:17212:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1782217138.277309:0:17212:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1782217138.277310:0:17212:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1782217138.277312:0:17212:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1782217138.277313:0:17212:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1782217138.277315:0:17212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782217138.277316:0:17212:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1782217138.277319:0:17212:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782217138.277323:0:17212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782217138.277324:0:17212:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1782217138.277329:0:17212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1782217138.277377:0:17212:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1782217138.277391:0:17212:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782217138.277394:0:17212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782217138.277395:0:17212:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1782217138.277397:0:17212:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782217138.277414:0:17212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782217138.277415:0:17212:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1782217138.277419:0:17212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1782217138.277424:0:17212:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:00000080:1.0:1782217138.277448:0:17212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782217138.277464:0:17212:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff952e4e28cd40) 00000020:00000080:1.0:1782217138.277481:0:17212:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1782217138.277486:0:17212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1782217138.277554:0:17212:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1782217138.277559:0:17212:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:1.0:1782217138.277566:0:17212:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x92b8e04cbf5fa4f5 00010000:00080000:1.0:1782217138.277624:0:17212:0:(ldlm_lib.c:102:import_set_conn()) imp ffff952e64e46800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.130@tcp at head 00010000:00010000:1.0:1782217138.281048:0:17212:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:0.0:1782217138.282488:0:17212:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1782217138.282503:0:17212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1782217138.282541:0:17212:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1782217138.282563:0:17212:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x92b8e04cbf5fa4fc 00000100:00080000:0.0:1782217138.282575:0:17212:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782217138.282691:0:17212:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff952e64e46800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1782217138.282730:0:17212:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff952e46da4a80 x1868789713112576/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782217138.282759:0:17212:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1782217138.282851:0:17212:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782217138.282856:0:17212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782217138.282858:0:17212:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1782217138.282862:0:17212:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1782217138.282864:0:17212:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:0.0:1782217138.282866:0:17212:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1782217138.282876:0:17212:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1782217138.282878:0:17212:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1782217138.282881:0:17212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782217138.282882:0:17212:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:0.0:1782217138.282885:0:17212:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1782217138.282890:0:17212:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1782217138.282894:0:17212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782217138.282895:0:17212:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1782217138.282898:0:17212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1782217138.282902:0:17212:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:01000000:0.0:1782217138.282927:0:17212:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1782217138.282930:0:17212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1782217138.282941:0:17212:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff952e74c819c0) 00000020:00000080:0.0:1782217138.282952:0:17212:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1782217138.282958:0:17212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1782217138.283036:0:17212:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1782217138.283042:0:17212:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:0.0:1782217138.283049:0:17212:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x92b8e04cbf5fa50a 00010000:00080000:0.0:1782217138.283090:0:17212:0:(ldlm_lib.c:102:import_set_conn()) imp ffff952e749ef800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.130@tcp at head 00000100:00100000:1.0:1782217138.283196:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1868789713112576:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1782217138.283264:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217138.283374:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713112576 00000100:00100000:0.0:1782217138.283381:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713112576 00000100:00100000:0.0:1782217138.283408:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782217138.283415:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4441c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1868789713112576:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1782217138.283429:0:17199:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00010000:2.0:1782217138.291886:0:17212:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1782217138.292624:0:17212:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1782217138.292811:0:17212:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1782217138.294468:0:17212:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782217138.294742:0:17212:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000100:00100000:0.0:1782217138.302380:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4441c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1868789713112576:12345-0@lo:38:llog_process_th.0 Request processed in 18956us (19109us total) trans 0 rc -19/-19 00000100:00100000:0.0:1782217138.302393:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1782217138.302481:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952e64e46800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782217138.302488:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1782217138.302493:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1868789713112576:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1782217138.302925:0:17212:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1782217138.303525:0:17218:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1782217138.303531:0:17218:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1782217138.304467:0:17212:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1782217138.304480:0:17212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1782217138.304514:0:17212:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1782217138.304532:0:17212:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x92b8e04cbf5fa511 00000100:00080000:2.0:1782217138.304540:0:17212:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782217138.304546:0:17212:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff952e749ef800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1782217138.304578:0:17212:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff952d43cb1880 x1868789713112704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782217138.304732:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43cb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1868789713112704:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1782217138.304783:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868789713112704 offset 0 length 520: 4 00000100:00080000:2.0:1782217138.304852:0:17212:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1782217138.304917:0:17212:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782217138.304921:0:17212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782217138.304923:0:17212:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1782217138.304926:0:17212:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1782217138.304928:0:17212:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1782217138.304930:0:17212:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1782217138.304932:0:17212:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1782217138.304933:0:17212:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1782217138.304936:0:17212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782217138.304937:0:17212:0:(obd_config.c:1561:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1782217138.304939:0:17212:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1782217138.304943:0:17212:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1782217138.304946:0:17212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782217138.304947:0:17212:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1782217138.304950:0:17212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1782217138.304954:0:17212:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:01000000:2.0:1782217138.304972:0:17212:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1782217138.304975:0:17212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782217138.304985:0:17212:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff952e7dbd8000) 00000020:00000080:2.0:1782217138.304995:0:17212:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1782217138.305000:0:17212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1782217138.305071:0:17212:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1782217138.305076:0:17212:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:2.0:1782217138.305082:0:17212:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x92b8e04cbf5fa51f 00010000:00080000:2.0:1782217138.305129:0:17212:0:(ldlm_lib.c:102:import_set_conn()) imp ffff952e7b2cd000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.130@tcp at head 00010000:00010000:2.0:1782217138.305316:0:17212:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1782217138.305376:0:17212:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1782217138.305389:0:17212:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1782217138.306622:0:17212:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782217138.306885:0:17212:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1782217138.307031:0:17212:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1782217138.307429:0:17220:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1782217138.307434:0:17220:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1782217138.308576:0:17212:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1782217138.308619:0:17212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1782217138.308661:0:17212:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1782217138.308682:0:17212:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x92b8e04cbf5fa526 00000100:00080000:1.0:1782217138.308700:0:17212:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782217138.308707:0:17212:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff952e7b2cd000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1782217138.308740:0:17212:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff952d4441d180 x1868789713112832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782217138.308764:0:17212:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1782217138.308827:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1868789713112832:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1782217138.308880:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868789713112832 offset 0 length 520: 4 00000020:01000000:1.0:1782217138.308887:0:17212:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782217138.308891:0:17212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782217138.308893:0:17212:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1782217138.308895:0:17212:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782217138.308899:0:17212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782217138.308900:0:17212:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1782217138.308903:0:17212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1782217138.308905:0:17212:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1782217138.308907:0:17212:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782217138.308909:0:17212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782217138.308910:0:17212:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:1.0:1782217138.308912:0:17212:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782217138.308914:0:17212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782217138.308915:0:17212:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1782217138.308918:0:17212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1782217138.308943:0:17212:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a1470210-3884-42c5-8d09-248d2ed946c2:17212:1868789713112960:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782217138.308988:0:17212:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217138.309010:0:17212:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e460e8240 going to sleep for 11 seconds 00000100:00100000:3.0:1782217138.309045:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713112960 00000100:00100000:3.0:1782217138.309051:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713112960 00000100:00100000:3.0:1782217138.309097:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782217138.309114:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+9:17212:x1868789713112960:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782217138.309233:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+9:17212:x1868789713112960:12345-0@lo:502:llog_process_th.0 Request processed in 128us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217138.309241:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782217138.309258:0:17212:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a1470210-3884-42c5-8d09-248d2ed946c2:17212:1868789713112960:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782217138.309282:0:17212:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782217138.309286:0:17212:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782217138.309287:0:17212:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1782217138.309290:0:17212:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1782217138.309437:0:17173:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1782217138.309458:0:17173:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1782217138.309480:0:17173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e4121dc00/0x92b8e04cbf5fa49a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa4a1 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217138.309496:0:17173:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e4121dc00/0x92b8e04cbf5fa49a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa4a1 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782217138.309504:0:17173:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff952d43f05800 from 1 10000000:01000000:0.0:1782217138.309506:0:17173:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1782217138.309530:0:17173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e4121d200/0x92b8e04cbf5fa52d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217138.309537:0:17173:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e4121d200/0x92b8e04cbf5fa52d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217138.309545:0:17173:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e4121d200/0x92b8e04cbf5fa52d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217138.309558:0:17173:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17173:1868789713113088:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1782217138.309614:0:17173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217138.309631:0:17173:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e529a2000 going to sleep for 11 seconds 00000100:00100000:1.0:1782217138.309985:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713113088 00000100:00100000:1.0:1782217138.309990:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713113088 00000100:00100000:1.0:1782217138.310033:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782217138.310040:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+9:17173:x1868789713113088:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782217138.310049:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217138.310063:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952d43073400/0x92b8e04cbf5fa534 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5fa52d expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217138.310082:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952d43073400/0x92b8e04cbf5fa534 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa52d expref: 10 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217138.310091:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952d43073400/0x92b8e04cbf5fa534 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa52d expref: 10 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217138.310110:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43073400, rc 0) 00000100:00100000:1.0:1782217138.310139:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+10:17173:x1868789713113088:12345-0@lo:101:mount.lustre.0 Request processed in 99us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217138.310145:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782217138.310283:0:17173:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17173:1868789713113088:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782217138.310296:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e4121d200/0x92b8e04cbf5fa52d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa534 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217138.310304:0:17173:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e4121d200/0x92b8e04cbf5fa52d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5fa534 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217138.310912:0:17173:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17173:1868789713113216:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1782217138.310952:0:17173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217138.311025:0:17173:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e529a2000 going to sleep for 11 seconds 00000100:00100000:3.0:1782217138.311339:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713113216 00000100:00100000:3.0:1782217138.311345:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713113216 00000100:00100000:3.0:1782217138.311413:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782217138.311421:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+10:17173:x1868789713113216:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1782217138.311438:0:17186:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1782217138.311443:0:17186:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1782217138.311515:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+10:17173:x1868789713113216:12345-0@lo:256:mount.lustre.0 Request processed in 94us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217138.311522:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782217138.311601:0:17173:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17173:1868789713113216:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1782217138.312177:0:17173:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1782217138.312203:0:17173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e4121d200/0x92b8e04cbf5fa52d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa534 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217138.312214:0:17173:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e4121d200/0x92b8e04cbf5fa52d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa534 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782217138.312222:0:17173:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff952d43f05800 from 1 10000000:01000000:0.0:1782217138.312225:0:17173:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782217138.312252:0:17173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e4121d600/0x92b8e04cbf5fa53b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217138.312259:0:17173:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e4121d600/0x92b8e04cbf5fa53b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217138.312267:0:17173:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e4121d600/0x92b8e04cbf5fa53b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217138.312282:0:17173:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17173:1868789713113344:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1782217138.312315:0:17173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217138.312965:0:17173:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e529a2000 going to sleep for 11 seconds 00000100:00100000:1.0:1782217138.313052:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713113344 00000100:00100000:1.0:1782217138.313059:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713113344 00000100:00100000:1.0:1782217138.313328:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782217138.313339:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+10:17173:x1868789713113344:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782217138.313351:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217138.313366:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952d43072c00/0x92b8e04cbf5fa542 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5fa53b expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217138.313387:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952d43072c00/0x92b8e04cbf5fa542 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa53b expref: 11 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217138.313397:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952d43072c00/0x92b8e04cbf5fa542 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa53b expref: 11 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217138.313419:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43072c00, rc 0) 00000100:00100000:1.0:1782217138.313467:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+11:17173:x1868789713113344:12345-0@lo:101:mount.lustre.0 Request processed in 130us (1150us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217138.313474:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782217138.314648:0:17173:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17173:1868789713113344:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782217138.314671:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e4121d600/0x92b8e04cbf5fa53b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa542 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217138.314681:0:17173:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e4121d600/0x92b8e04cbf5fa53b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5fa542 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217138.314767:0:17173:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17173:1868789713113472:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782217138.314806:0:17173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217138.314840:0:17173:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e529a2000 going to sleep for 11 seconds 00000100:00100000:1.0:1782217138.314915:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713113472 00000100:00100000:1.0:1782217138.314921:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713113472 00000100:00100000:1.0:1782217138.314949:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782217138.314957:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+11:17173:x1868789713113472:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782217138.315121:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+11:17173:x1868789713113472:12345-0@lo:501:mount.lustre.0 Request processed in 165us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217138.315128:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782217138.315246:0:17173:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17173:1868789713113472:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782217138.315273:0:17173:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17173:1868789713113600:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782217138.315313:0:17173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217138.315339:0:17173:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e529a2000 going to sleep for 11 seconds 00000100:00100000:3.0:1782217138.315522:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713113600 00000100:00100000:3.0:1782217138.315527:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713113600 00000100:00100000:3.0:1782217138.315547:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782217138.315562:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+11:17173:x1868789713113600:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782217138.315670:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+11:17173:x1868789713113600:12345-0@lo:503:mount.lustre.0 Request processed in 109us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217138.315677:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782217138.315773:0:17173:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17173:1868789713113600:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782217138.316515:0:17222:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a1470210-3884-42c5-8d09-248d2ed946c2:17222:1868789713113728:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782217138.316565:0:17222:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217138.316626:0:17222:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e50194900 going to sleep for 11 seconds 00000100:00100000:0.0:1782217138.316674:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713113728 00000100:00100000:0.0:1782217138.316680:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713113728 00000100:00100000:0.0:1782217138.316710:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782217138.316717:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+11:17222:x1868789713113728:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782217138.317146:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+11:17222:x1868789713113728:12345-0@lo:502:llog_process_th.0 Request processed in 428us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217138.317154:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782217138.317377:0:17222:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a1470210-3884-42c5-8d09-248d2ed946c2:17222:1868789713113728:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782217138.317406:0:17222:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782217138.317416:0:17222:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782217138.317418:0:17222:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1782217138.317426:0:17222:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff952d43f05800 00000020:00000080:3.0:1782217138.317429:0:17222:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1782217138.317437:0:17222:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782217138.317439:0:17222:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782217138.317440:0:17222:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1782217138.317443:0:17222:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782217138.317445:0:17222:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782217138.317446:0:17222:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1782217138.317449:0:17222:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff952d43f05800 00000020:00000080:3.0:1782217138.317451:0:17222:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1782217138.317500:0:17222:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782217138.317503:0:17222:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782217138.317505:0:17222:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1782217138.317507:0:17222:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782217138.317509:0:17222:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782217138.317510:0:17222:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1782217138.317514:0:17222:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff952d43f05800 00000020:00000080:3.0:1782217138.317516:0:17222:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1782217138.317543:0:17222:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782217138.317545:0:17222:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782217138.317547:0:17222:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1782217138.317549:0:17222:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782217138.317551:0:17222:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782217138.317553:0:17222:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1782217138.317556:0:17222:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff952d43f05800 00000020:00000080:3.0:1782217138.317558:0:17222:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1782217138.317623:0:17222:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a1470210-3884-42c5-8d09-248d2ed946c2:17222:1868789713113856:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782217138.317661:0:17222:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217138.317688:0:17222:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e50194900 going to sleep for 11 seconds 00000100:00100000:1.0:1782217138.317741:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713113856 00000100:00100000:1.0:1782217138.317747:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713113856 00000100:00100000:1.0:1782217138.317777:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782217138.317783:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+11:17222:x1868789713113856:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782217138.317867:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+11:17222:x1868789713113856:12345-0@lo:502:llog_process_th.0 Request processed in 83us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217138.317874:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782217138.317942:0:17222:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a1470210-3884-42c5-8d09-248d2ed946c2:17222:1868789713113856:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782217138.317960:0:17222:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782217138.317965:0:17222:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782217138.317966:0:17222:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1782217138.317969:0:17222:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1782217138.326192:0:17173:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1782217138.326231:0:17173:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782217138.326248:0:17173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e4121d600/0x92b8e04cbf5fa53b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa542 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217138.326262:0:17173:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e4121d600/0x92b8e04cbf5fa53b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa542 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782217138.326331:0:17173:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1782217138.326334:0:17173:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff952d43f05800 10000000:01000000:1.0:1782217138.326337:0:17173:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff952d43f05800 10000000:01000000:1.0:1782217138.326341:0:17173:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782217138.326347:0:17173:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff952d43f05800 from 1 10000000:01000000:1.0:1782217138.326350:0:17173:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782217138.326387:0:17173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952d43072800/0x92b8e04cbf5fa549 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217138.326395:0:17173:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952d43072800/0x92b8e04cbf5fa549 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217138.326405:0:17173:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952d43072800/0x92b8e04cbf5fa549 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217138.326429:0:17173:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17173:1868789713113984:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782217138.326493:0:17173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217138.326528:0:17173:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e52b6e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782217138.326552:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713113984 00000100:00100000:1.0:1782217138.326560:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713113984 00000100:00100000:1.0:1782217138.326616:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1782217138.326624:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+11:17173:x1868789713113984:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782217138.326637:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217138.326649:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952d43072e00/0x92b8e04cbf5fa550 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5fa549 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217138.326670:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952d43072e00/0x92b8e04cbf5fa550 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa549 expref: 12 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217138.326691:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952d43072e00/0x92b8e04cbf5fa550 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa549 expref: 12 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217138.326699:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43072e00, rc 0) 00000100:00100000:1.0:1782217138.326736:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+12:17173:x1868789713113984:12345-0@lo:101:mount.lustre.0 Request processed in 113us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217138.326742:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1782217138.326790:0:17173:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17173:1868789713113984:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782217138.326805:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952d43072800/0x92b8e04cbf5fa549 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa550 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217138.326813:0:17173:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952d43072800/0x92b8e04cbf5fa549 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5fa550 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217138.326861:0:17173:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17173:1868789713114112:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782217138.326887:0:17173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217138.326902:0:17173:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e52b6e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782217138.326980:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713114112 00000100:00100000:2.0:1782217138.326984:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713114112 00000100:00100000:2.0:1782217138.327258:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782217138.327268:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+12:17173:x1868789713114112:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782217138.327381:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+12:17173:x1868789713114112:12345-0@lo:501:mount.lustre.0 Request processed in 114us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217138.327387:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782217138.330167:0:17173:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17173:1868789713114112:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782217138.330235:0:17173:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17173:1868789713114240:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782217138.330299:0:17173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217138.330332:0:17173:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e52b6e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782217138.330352:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713114240 00000100:00100000:1.0:1782217138.330357:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713114240 00000100:00100000:1.0:1782217138.330407:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1782217138.330415:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+12:17173:x1868789713114240:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782217138.330521:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+12:17173:x1868789713114240:12345-0@lo:503:mount.lustre.0 Request processed in 106us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217138.330528:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1782217138.330576:0:17173:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17173:1868789713114240:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782217138.331534:0:17226:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a1470210-3884-42c5-8d09-248d2ed946c2:17226:1868789713114368:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782217138.331603:0:17226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217138.331631:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713114368 00000100:00100000:0.0:1782217138.331635:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713114368 00000100:00100000:0.0:1782217138.331663:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782217138.331670:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+12:17226:x1868789713114368:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782217138.331756:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+12:17226:x1868789713114368:12345-0@lo:502:llog_process_th.0 Request processed in 85us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217138.331772:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782217138.331823:0:17226:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e7b3e8900 going to sleep for 11 seconds 00000100:00100000:0.0:1782217138.331838:0:17226:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a1470210-3884-42c5-8d09-248d2ed946c2:17226:1868789713114368:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1782217138.331889:0:17226:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1782217138.331904:0:17226:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff952e74c84d40) 00000020:00000080:0.0:1782217138.331922:0:17226:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1782217138.335254:0:17226:0:(tgt_mount.c:153:server_get_mount()) get mount ffff952d43f05800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1782217138.335264:0:17226:0:(tgt_mount.c:187:server_put_mount()) put mount ffff952d43f05800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1782217138.335267:0:17226:0:(obd_mount.c:701:lustre_put_lsi()) put ffff952d43f05800 4 00010000:00080000:1.0:1782217138.335301:0:17226:0:(ldlm_lib.c:102:import_set_conn()) imp ffff952e7b2c9800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.130@tcp at head 00010000:00010000:1.0:1782217138.336898:0:17226:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1782217138.337004:0:17226:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1782217138.337065:0:17226:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1782217138.337078:0:17226:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x92b8e04cbf5fa55e 00000100:00080000:1.0:1782217138.337088:0:17226:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782217138.337094:0:17226:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff952e7b2c9800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1782217138.337130:0:17226:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff952d4441fb80 x1868789713114496/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782217138.337160:0:17226:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1782217138.337977:0:17226:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a1470210-3884-42c5-8d09-248d2ed946c2:17226:1868789713114624:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782217138.338060:0:17226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217138.338105:0:17226:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e51f28900 going to sleep for 11 seconds 00000100:00100000:3.0:1782217138.340249:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1868789713114496:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1782217138.340312:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217138.342121:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713114496 00000100:00100000:0.0:1782217138.342134:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713114496 00000100:00100000:0.0:1782217138.342175:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782217138.342182:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1868789713114496:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1782217138.342262:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1868789713114496:12345-0@lo:38:llog_process_th.0 Request processed in 79us (1949us total) trans 0 rc -11/-11 00000100:00100000:0.0:1782217138.342269:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782217138.342313:0:3646:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782217138.342320:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952e7b2c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782217138.342324:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1782217138.342327:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1868789713114496:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1782217138.346175:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713114624 00000100:00100000:2.0:1782217138.346187:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713114624 00000100:00100000:2.0:1782217138.346242:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1782217138.346251:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+12:17226:x1868789713114624:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782217138.346455:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+12:17226:x1868789713114624:12345-0@lo:502:llog_process_th.0 Request processed in 204us (8394us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217138.346463:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782217138.350636:0:17226:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a1470210-3884-42c5-8d09-248d2ed946c2:17226:1868789713114624:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782217138.350713:0:17226:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a1470210-3884-42c5-8d09-248d2ed946c2:17226:1868789713114752:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782217138.350776:0:17226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217138.350812:0:17226:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e51f28900 going to sleep for 11 seconds 00000100:00100000:1.0:1782217138.351253:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713114752 00000100:00100000:1.0:1782217138.351262:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713114752 00000100:00100000:1.0:1782217138.351307:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782217138.351316:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+12:17226:x1868789713114752:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782217138.351442:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+12:17226:x1868789713114752:12345-0@lo:502:llog_process_th.0 Request processed in 126us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217138.351449:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782217138.351526:0:17226:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a1470210-3884-42c5-8d09-248d2ed946c2:17226:1868789713114752:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1782217138.351549:0:17226:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1782217138.352200:0:17173:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1782217138.352226:0:17173:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1782217138.352254:0:17173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952d43072800/0x92b8e04cbf5fa549 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa550 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217138.352266:0:17173:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952d43072800/0x92b8e04cbf5fa549 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa550 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1782217138.352312:0:17173:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1782217138.352314:0:17173:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1782217138.352315:0:17173:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782217138.352317:0:17173:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782217138.352318:0:17173:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782217138.352319:0:17173:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782217138.352321:0:17173:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1782217138.352322:0:17173:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1782217138.352324:0:17173:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782217138.352325:0:17173:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1782217138.352329:0:17173:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1782217138.352332:0:17173:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1782217138.352333:0:17173:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1782217138.352334:0:17173:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782217138.352336:0:17173:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782217138.352337:0:17173:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782217138.352338:0:17173:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782217138.352339:0:17173:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1782217138.352340:0:17173:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1782217138.352341:0:17173:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782217138.352342:0:17173:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1782217138.352357:0:17173:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1782217138.352370:0:17173:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17173:1868789713114880:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1782217138.352408:0:17173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217138.352435:0:17173:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e52b6e900 going to sleep for 11 seconds 00000100:00100000:1.0:1782217138.352455:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713114880 00000100:00100000:1.0:1782217138.352461:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713114880 00000100:00100000:1.0:1782217138.352491:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1782217138.352498:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+12:17173:x1868789713114880:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1782217138.352528:0:17186:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1782217138.352540:0:17186:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1782217138.355905:0:17186:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1782217138.355924:0:17186:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1782217138.357307:0:17210:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1782217138.357316:0:17210:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1782217138.357339:0:17210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff952d43073800/0x92b8e04cbf5fa565 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217138.357356:0:17210:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952d43073400/0x92b8e04cbf5fa534 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa52d expref: 12 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217138.357364:0:17210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff952d43073800/0x92b8e04cbf5fa565 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217138.357405:0:17210:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952d43073400/0x92b8e04cbf5fa534 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5fa52d expref: 12 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217138.357480:0:17210:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff952d43073400/0x92b8e04cbf5fa534 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5fa52d expref: 12 pid: 17187 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217138.357496:0:17210:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17210:1868789713115008:0@lo:104: 00000100:00100000:1.0:1782217138.357554:0:17210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217138.357617:0:17210:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e52b6ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1782217138.357788:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+12:17173:x1868789713114880:12345-0@lo:253:mount.lustre.0 Request processed in 5288us (5377us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217138.357797:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1782217138.357869:0:17173:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17173:1868789713114880:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1782217138.357879:0:17173:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1782217138.357882:0:17173:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782217138.357884:0:17173:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1782217138.357885:0:17173:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782217138.357886:0:17173:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782217138.357887:0:17173:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782217138.357888:0:17173:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782217138.357889:0:17173:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782217138.357898:0:17173:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1782217138.357900:0:17173:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782217138.357901:0:17173:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1782217138.357912:0:17173:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1782217138.358252:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713115008 00000100:00100000:3.0:1782217138.358259:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713115008 00000100:00100000:3.0:1782217138.358324:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782217138.358332:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4441df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a1470210-3884-42c5-8d09-248d2ed946c2+3:17210:x1868789713115008:12345-0@lo:104: 00010000:00010000:3.0:1782217138.358345:0:17177:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff952e4121d200/0x92b8e04cbf5fa52d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5fa534 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217138.358395:0:17177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782217138.358407:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4441df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a1470210-3884-42c5-8d09-248d2ed946c2+3:17210:x1868789713115008:12345-0@lo:104: Request processed in 76us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217138.358414:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782217138.358513:0:17210:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17210:1868789713115008:0@lo:104: 00010000:00010000:3.0:1782217138.358526:0:17210:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff952d43073800/0x92b8e04cbf5fa565 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217138.358780:0:17183:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782217138.358787:0:17183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e4121d200/0x92b8e04cbf5fa52d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5fa534 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217138.358795:0:17183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121d200 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:0.0:1782217138.358799:0:17183:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e4121d200/0x92b8e04cbf5fa52d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5fa534 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217138.358807:0:17183:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e4121d200/0x92b8e04cbf5fa52d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5fa534 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782217138.358814:0:17183:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e4121d200/0x92b8e04cbf5fa52d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5fa534 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782217138.358820:0:17183:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1782217138.358852:0:17183:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e4121d200/0x92b8e04cbf5fa52d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5fa534 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217138.358859:0:17183:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782217138.358877:0:17183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e4121d200/0x92b8e04cbf5fa52d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5fa534 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217138.358884:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e4121d200/0x92b8e04cbf5fa52d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5fa534 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217138.358899:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217138.358900:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217138.358902:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782217138.358929:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a1470210-3884-42c5-8d09-248d2ed946c2:3647:1868789713115136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782217138.358961:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217138.359053:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713115136 00000100:00100000:0.0:1782217138.359059:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713115136 00010000:00010000:0.0:1782217138.359077:0:17179:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952d43073400/0x92b8e04cbf5fa534 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5fa52d expref: 12 pid: 17187 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217138.359102:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782217138.359109:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1470210-3884-42c5-8d09-248d2ed946c2+12:3647:x1868789713115136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782217138.359120:0:17179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217138.359124:0:17179:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952d43073400/0x92b8e04cbf5fa534 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5fa52d expref: 12 pid: 17187 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217138.359134:0:17179:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952d43073400/0x92b8e04cbf5fa534 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5fa52d expref: 12 pid: 17187 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217138.359147:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952d43073400/0x92b8e04cbf5fa534 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5fa52d expref: 12 pid: 17187 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217138.359160:0:17179:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff952d43073800/0x92b8e04cbf5fa565 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217138.359168:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952d43073800/0x92b8e04cbf5fa565 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1782217138.359181:0:17179:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001865980s 00010000:00010000:0.0:1782217138.359185:0:17179:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff952d43073800/0x92b8e04cbf5fa565 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217138.359191:0:17179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff952d43073800/0x92b8e04cbf5fa565 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217138.359198:0:17179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff952d43073800/0x92b8e04cbf5fa565 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217138.359210:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff952d43073800/0x92b8e04cbf5fa565 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217138.359216:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43073800 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:0.0:1782217138.359219:0:17179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff952d43073800/0x92b8e04cbf5fa565 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217138.359227:0:17179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff952d43073800/0x92b8e04cbf5fa565 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217138.359240:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff952d43073800/0x92b8e04cbf5fa565 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217138.359249:0:17179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217138.359277:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1470210-3884-42c5-8d09-248d2ed946c2+11:3647:x1868789713115136:12345-0@lo:103:ldlm_bl.0 Request processed in 169us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217138.359284:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782217138.359312:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a1470210-3884-42c5-8d09-248d2ed946c2:3647:1868789713115136:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782217138.359328:0:17210:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff952d43073800/0x92b8e04cbf5fa565 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217138.359334:0:17210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff952d43073800/0x92b8e04cbf5fa565 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217138.359340:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952d43073800/0x92b8e04cbf5fa565 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1782217138.371901:0:17173:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1782217138.372231:0:17173:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1782217138.372510:0:17234:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1782217138.372801:0:17173:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:0.0:1782217138.373032:0:17234:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782217138.375068:0:17234:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1782217138.375154:0:17234:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000020:00080000:1.0:1782217138.375512:0:17233:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1782217138.375517:0:17233:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1782217138.376255:0:17173:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1782217138.376293:0:17173:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1782217138.376829:0:17173:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1782217138.376838:0:17173:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1782217138.376873:0:17173:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782217138.378907:0:17173:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1782217138.379571:0:17173:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000100:00080000:1.0:1782217138.381341:0:17235:0:(client.c:1831:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff952d4441ed80 x1868789713115264/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782217138.381354:0:17235:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e52b6ee40 going to sleep for 0 seconds 00000040:01000000:0.0:1782217138.381466:0:17173:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1782217138.384424:0:17173:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:0.0:1782217138.386326:0:17173:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1782217138.397427:0:17173:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1782217138.397471:0:17173:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa4bf81c53988 00100000:10000000:0.0:1782217138.397479:0:17173:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1782217138.399365:0:17173:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1782217138.399384:0:17173:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.130@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1782217138.399406:0:17173:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1782217138.399428:0:17173:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1782217138.400269:0:17173:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782217138.400472:0:17173:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1782217139.067257:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1782217139.385324:0:17230:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1782217139.388281:0:17235:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e52b6ee40 going to sleep for 0 seconds 10000000:01000000:3.0:1782217139.512722:0:17191:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1782217139.512729:0:17191:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff952d43f05800 from 7 10000000:01000000:3.0:1782217139.512734:0:17191:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1782217139.512780:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e41681a00/0x92b8e04cbf5fa56c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217139.512792:0:17191:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e41681a00/0x92b8e04cbf5fa56c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217139.512802:0:17191:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e41681a00/0x92b8e04cbf5fa56c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217139.512827:0:17191:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713115392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782217139.512890:0:17191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217139.513003:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713115392 00000100:00100000:2.0:1782217139.513020:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713115392 00000100:00100000:2.0:1782217139.513070:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782217139.513079:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c619050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+11:17191:x1868789713115392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782217139.513093:0:17189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217139.513107:0:17189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e72e2ca00/0x92b8e04cbf5fa573 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5fa56c expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217139.513128:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e72e2ca00/0x92b8e04cbf5fa573 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa56c expref: 12 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217139.513140:0:17189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e72e2ca00/0x92b8e04cbf5fa573 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa56c expref: 12 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217139.513148:0:17189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2ca00, rc 0) 00000100:00100000:2.0:1782217139.514517:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c619050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+12:17191:x1868789713115392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1432us (1620us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217139.514528:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1782217139.514780:0:17191:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43d1c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782217139.514807:0:17191:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713115392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782217139.514829:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e41681a00/0x92b8e04cbf5fa56c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa573 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217139.514840:0:17191:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e41681a00/0x92b8e04cbf5fa56c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5fa573 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217139.515927:0:17191:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713115520:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1782217139.516119:0:17191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217139.516156:0:17191:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43d1c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782217139.516204:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713115520 00000100:00100000:1.0:1782217139.516212:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713115520 00000100:00100000:1.0:1782217139.516260:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782217139.516277:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c619450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+12:17191:x1868789713115520:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1782217139.516299:0:17186:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1782217139.516313:0:17186:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1782217139.516316:0:17186:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1782217139.516406:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c619450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+12:17191:x1868789713115520:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 130us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217139.516413:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782217139.516516:0:17191:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713115520:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1782217139.516559:0:17191:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1782217139.516569:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e41681a00/0x92b8e04cbf5fa56c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa573 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217139.516614:0:17191:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e41681a00/0x92b8e04cbf5fa56c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa573 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217140.094171:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782217140.408693:0:17235:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e52b6ee40 going to sleep for 0 seconds 00000040:00080000:3.0:1782217140.410737:0:17230:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1782217141.118756:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782217141.435015:0:17235:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e52b6ee40 going to sleep for 0 seconds 00010000:00010000:1.0:1782217142.140758:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782217142.464278:0:17235:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e52b6ee40 going to sleep for 0 seconds 00000001:02000400:0.0:1782217142.751463:0:17479:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1782217143.160974:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782217143.357873:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a1470210-3884-42c5-8d09-248d2ed946c2:3648:1868789713115648:0@lo:400:kworker.0 00000100:00100000:0.0:1782217143.357977:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217143.358159:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713115648 00000100:00100000:2.0:1782217143.358169:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713115648 00000100:00100000:2.0:1782217143.358233:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782217143.358245:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c61a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+12:3648:x1868789713115648:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1782217143.359541:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1782217143.359552:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1782217143.359557:0:37:0:(import.c:65:import_set_state_nolock()) ffff952e64e46800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782217143.359565:0:37:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 501 00000100:00080000:1.0:1782217143.359571:0:37:0:(import.c:591:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1782217143.359595:0:37:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff952e64e46800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1782217143.359641:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff952d4441e300 x1868789713115776/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782217143.359670:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782217143.359675:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1782217143.359678:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782217143.359681:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1782217143.359684:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1782217143.359686:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1782217143.359688:0:37:0:(import.c:65:import_set_state_nolock()) ffff952e7b2c9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782217143.359694:0:37:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff952e7b2c9800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1782217143.359718:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff952d4441f480 x1868789713115904/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782217143.359784:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1868789713115776:0@lo:38:kworker.0 00000100:00100000:1.0:1782217143.359913:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217143.359960:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1868789713115904:0@lo:38:kworker.0 00000100:00100000:1.0:1782217143.360000:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217143.360057:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713115776 00000100:00100000:1.0:1782217143.360064:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713115776 00000100:00100000:1.0:1782217143.360091:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782217143.360098:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4441e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1868789713115776:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1782217143.360116:0:17200:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1782217143.360560:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c61a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+12:3648:x1868789713115648:12345-0@lo:400:kworker.0 Request processed in 2313us (2579us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217143.360570:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782217143.360642:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713115904 00000100:00100000:3.0:1782217143.360648:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713115904 00000100:00100000:3.0:1782217143.360672:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782217143.360678:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4441c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1868789713115904:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1782217143.360700:0:17196:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 506 last 0 00000020:00000080:3.0:1782217143.360750:0:17196:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x92b8e04cbf5fa57a 00000004:00100000:3.0:1782217143.360769:0:17196:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1782217143.360997:0:17196:0:(import.c:65:import_set_state_nolock()) ffff952e58395800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782217143.361073:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4441c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1868789713115904:12345-0@lo:38:kworker.0 Request processed in 393us (1071us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217143.361080:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782217143.361780:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a1470210-3884-42c5-8d09-248d2ed946c2:3648:1868789713115648:0@lo:400:kworker.0 00010000:00080000:0.0:1782217143.366730:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff952d4441f480 x1868789713115904/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782217153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1782217143.366751:0:3646:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1782217143.366761:0:3646:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1782217143.366768:0:3646:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1782217143.366791:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952e7b2c9800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1782217143.366799:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1868789713115904:0@lo:38:kworker.0 00000100:00100000:1.0:1782217143.384038:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4441e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1868789713115776:12345-0@lo:38:kworker.0 Request processed in 23923us (24109us total) trans 0 rc -19/-19 00000100:00100000:1.0:1782217143.384053:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1782217143.384075:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952e64e46800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782217143.384082:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1782217143.384088:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1868789713115776:0@lo:38:kworker.0 00000100:00100000:0.0:1782217143.480909:0:17235:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e52b6ee40 going to sleep for 0 seconds 00000020:00000004:1.0:1782217143.621077:0:17531:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782217143.621278:0:17531:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1782217144.185052:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1782217144.379007:0:17581:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1782217144.379186:0:17581:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1782217144.505676:0:17235:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e52b6ee40 going to sleep for 0 seconds 00010000:00010000:2.0:1782217145.224977:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782217145.529131:0:17235:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e52b6ee40 going to sleep for 0 seconds 00010000:00010000:1.0:1782217146.234384:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782217146.556766:0:17235:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e52b6ee40 going to sleep for 0 seconds 00010000:00010000:2.0:1782217147.266054:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782217147.576653:0:17235:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e52b6ee40 going to sleep for 0 seconds 00010000:00010000:1.0:1782217148.280798:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1782217148.479193:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1782217148.479202:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1782217148.479206:0:36:0:(import.c:65:import_set_state_nolock()) ffff952e64e46800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1782217148.479246:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43cb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a1470210-3884-42c5-8d09-248d2ed946c2:3649:1868789713116032:0@lo:400:kworker.0 00000100:00080000:2.0:1782217148.479284:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 506 00000100:00080000:2.0:1782217148.479290:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1782217148.479297:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff952e64e46800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1782217148.479324:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217148.479324:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff952d43cb0380 x1868789713116160/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782217148.479345:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782217148.479349:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782217148.479351:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782217148.479354:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1782217148.479394:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43cb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1868789713116288:0@lo:400:kworker.0 00000100:00100000:3.0:1782217148.479463:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713116032 00000100:00100000:2.0:1782217148.479467:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217148.479477:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713116032 00000100:00100000:2.0:1782217148.479523:0:3646:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782217138/real 1782217138] req@ffff952d4441d180 x1868789713112832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782217148 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217148.479525:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782217148.479536:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c61b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+12:3649:x1868789713116032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217148.479549:0:3646:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff952d4441d180 x1868789713112832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782217148 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782217148.479560:0:3646:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782217138/real 1782217138] req@ffff952d43cb1880 x1868789713112704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782217148 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782217148.479574:0:3646:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff952d43cb1880 x1868789713112704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782217148 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782217148.479614:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43cb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1868789713116160:0@lo:38:kworker.0 00000100:00100000:3.0:1782217148.479673:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c61b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+12:3649:x1868789713116032:12345-0@lo:400:kworker.0 Request processed in 137us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217148.479680:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782217148.479736:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43cb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a1470210-3884-42c5-8d09-248d2ed946c2:3649:1868789713116032:0@lo:400:kworker.0 00000100:00100000:3.0:1782217148.479771:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713116288 00000100:00100000:3.0:1782217148.479774:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713116288 00000100:00100000:3.0:1782217148.479795:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782217148.479801:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1868789713116288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217148.479874:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1782217148.479895:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952e7b2cd000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1782217148.479906:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1782217148.479909:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1868789713112832:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1782217148.479913:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952e749ef800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1782217148.479917:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1782217148.479919:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43cb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1868789713112704:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1782217148.479959:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713116160 00000100:00100000:2.0:1782217148.479963:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713116160 00000100:00100000:2.0:1782217148.479985:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782217148.479990:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1868789713116160:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1782217148.480006:0:17199:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1782217148.480883:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1868789713116288:12345-0@lo:400:kworker.0 Request processed in 1078us (1412us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217148.480893:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1782217148.480961:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782217148.480966:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1782217148.480968:0:36:0:(import.c:65:import_set_state_nolock()) ffff952e749ef800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782217148.480972:0:36:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 501 00000100:00080000:3.0:1782217148.480977:0:36:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1782217148.480982:0:36:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff952e749ef800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1782217148.481006:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff952e7c6f1180 x1868789713116416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782217148.481023:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782217148.481026:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1782217148.481028:0:36:0:(import.c:65:import_set_state_nolock()) ffff952e7b2cd000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782217148.481036:0:36:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 501 00000100:00080000:3.0:1782217148.481038:0:36:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1782217148.481042:0:36:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff952e7b2cd000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1782217148.481053:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff952e7c6f1f80 x1868789713116544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782217148.481089:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1868789713116416:0@lo:8:kworker.0 00000400:00000100:3.0:1782217148.481120:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868789713116416 offset 0 length 520: 4 00000100:00100000:3.0:1782217148.481144:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1868789713116544:0@lo:8:kworker.0 00000400:00000100:3.0:1782217148.481160:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868789713116544 offset 0 length 520: 4 00010000:00080000:0.0:1782217148.488704:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff952d43cb0a80 x1868789713116288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782217148.488724:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43cb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1868789713116288:0@lo:400:kworker.0 00000100:00100000:2.0:1782217148.498648:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1868789713116160:12345-0@lo:38:kworker.0 Request processed in 18649us (18767us total) trans 0 rc -19/-19 00000100:00100000:2.0:1782217148.498669:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1782217148.498723:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952e64e46800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1782217148.498729:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1782217148.498733:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43cb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1868789713116160:0@lo:38:kworker.0 00000100:00100000:1.0:1782217148.600922:0:17235:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e52b6ee40 going to sleep for 0 seconds 00010000:00010000:0.0:1782217149.312896:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782217149.627434:0:17235:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e52b6ee40 going to sleep for 0 seconds 00010000:00010000:1.0:1782217150.328822:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782217150.653273:0:17235:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e52b6ee40 going to sleep for 0 seconds 00000040:00080000:1.0:1782217150.657780:0:17230:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:1.0:1782217150.829055:0:17926:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1782217150.829059:0:17926:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1782217150.829068:0:17926:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1782217150.829173:0:17926:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff952e7c65c000 00000020:01000004:1.0:1782217150.829186:0:17926:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1782217150.829199:0:17926:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1782217150.829211:0:17926:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff952e4e28b380) 00000020:00000080:1.0:1782217150.829226:0:17926:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1782217150.899270:0:17926:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1782217150.899494:0:17926:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1782217150.903300:0:17926:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1782217150.903562:0:17926:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1782217150.903964:0:17926:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1782217150.904213:0:17926:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1782217150.904405:0:17926:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1782217150.904901:0:17926:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1782217150.905118:0:17926:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1782217150.905297:0:17926:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1782217150.905579:0:17926:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1782217150.905764:0:17926:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1782217150.905988:0:17926:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1782217150.906195:0:17926:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1782217150.906391:0:17926:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1782217150.906608:0:17926:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1782217150.906787:0:17926:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1782217150.906961:0:17926:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1782217150.907260:0:17926:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1782217150.907472:0:17926:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1782217150.907880:0:17926:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1782217150.908134:0:17926:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1782217150.908318:0:17926:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1782217150.908523:0:17926:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1782217150.908826:0:17926:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1782217150.909056:0:17926:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1782217150.909241:0:17926:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1782217150.909396:0:17926:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1782217150.909736:0:17926:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1782217150.909933:0:17926:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1782217150.910144:0:17926:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1782217150.910336:0:17926:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1782217150.910513:0:17926:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1782217150.910804:0:17926:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1782217150.911921:0:17926:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1782217150.912344:0:17926:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1782217150.912530:0:17926:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1782217150.912843:0:17926:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1782217150.913049:0:17926:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1782217150.913371:0:17926:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1782217150.913678:0:17926:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1782217150.913864:0:17926:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1782217150.914144:0:17926:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1782217150.914972:0:17926:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1782217150.915237:0:17926:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1782217150.915435:0:17926:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:01000000:2.0:1782217150.916529:0:17926:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1782217150.916890:0:17926:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1782217150.916901:0:17926:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1782217150.916913:0:17926:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x92b8e04cbf5fa588 00000020:01000004:2.0:1782217150.916919:0:17926:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1782217150.916951:0:17926:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.130@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1782217150.916954:0:17926:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1782217150.916959:0:17926:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1782217150.916985:0:17926:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1782217150.916989:0:17926:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.130@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1782217150.920446:0:17926:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.130@tcp ctxt 0 is initialized 00000020:01000004:2.0:1782217150.920492:0:17926:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.130@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1782217150.920497:0:17926:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1782217150.920499:0:17926:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1782217150.920500:0:17926:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782217150.920502:0:17926:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782217150.920503:0:17926:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782217150.920504:0:17926:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782217150.920505:0:17926:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782217150.920508:0:17926:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782217150.920509:0:17926:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782217150.920512:0:17926:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1782217150.920515:0:17926:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782217150.920516:0:17926:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1782217150.920517:0:17926:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782217150.920518:0:17926:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782217150.920519:0:17926:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782217150.920520:0:17926:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782217150.920526:0:17926:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782217150.920527:0:17926:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782217150.920528:0:17926:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782217150.920555:0:17926:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1782217150.920574:0:17926:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43cb0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17926:1868789713116672:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1782217150.920772:0:17926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217150.920863:0:17926:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43759a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782217150.920942:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713116672 00000100:00100000:0.0:1782217150.920950:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713116672 00000100:00100000:0.0:1782217150.921034:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782217150.921043:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c619c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+12:17926:x1868789713116672:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1782217150.921073:0:17189:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1782217150.921076:0:17189:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1782217150.921083:0:17189:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1782217150.921411:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c619c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+12:17926:x1868789713116672:12345-0@lo:253:mount.lustre.0 Request processed in 368us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217150.921419:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1782217150.921489:0:17926:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43cb0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17926:1868789713116672:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1782217150.921500:0:17926:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1782217150.921502:0:17926:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782217150.921503:0:17926:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1782217150.921505:0:17926:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782217150.921506:0:17926:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782217150.921507:0:17926:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782217150.921508:0:17926:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782217150.921509:0:17926:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782217150.921511:0:17926:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782217150.921512:0:17926:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1782217150.921528:0:17926:0:(tgt_mount.c:101:server_register_mount()) register mount ffff952e7c65c000 from lustre-MDT0001 10000000:01000000:2.0:1782217150.921553:0:17926:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1782217150.921555:0:17926:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1782217150.921578:0:17926:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff952e7dbdb380 local copy 00010000:00010000:2.0:1782217150.921610:0:17926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e41681800/0x92b8e04cbf5fa47e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa485 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217150.921685:0:17926:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43cb0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17926:1868789713116800:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782217150.921713:0:17926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217150.921840:0:17926:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d426cc0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782217150.921919:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713116800 00000100:00100000:3.0:1782217150.921934:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713116800 00000100:00100000:3.0:1782217150.921960:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1782217150.921966:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c61ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+12:17926:x1868789713116800:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782217150.922045:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c61ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+12:17926:x1868789713116800:12345-0@lo:501:mount.lustre.0 Request processed in 78us (331us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782217150.922052:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1782217150.922163:0:17926:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43cb0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17926:1868789713116800:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1782217150.922175:0:17926:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1782217150.922191:0:17926:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1782217150.922205:0:17926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e41681800/0x92b8e04cbf5fa47e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa485 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.922213:0:17926:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e41681800/0x92b8e04cbf5fa47e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa485 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782217150.922235:0:17926:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff952e7c65c000 10000000:01000000:2.0:1782217150.922240:0:17926:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1782217150.922245:0:17926:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff952e7dbdb380 10000000:01000000:2.0:1782217150.922247:0:17926:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1782217150.922250:0:17926:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff952e7dbdb380 from 1 10000000:01000000:2.0:1782217150.922253:0:17926:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782217150.922277:0:17926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e72e2d000/0x92b8e04cbf5fa58f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.922286:0:17926:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e72e2d000/0x92b8e04cbf5fa58f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.922294:0:17926:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e72e2d000/0x92b8e04cbf5fa58f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217150.922307:0:17926:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43cb0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17926:1868789713116928:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1782217150.922333:0:17926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217150.922354:0:17926:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d426cc0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782217150.922386:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713116928 00000100:00100000:0.0:1782217150.922391:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713116928 00000100:00100000:0.0:1782217150.922412:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782217150.922418:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c61a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+12:17926:x1868789713116928:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782217150.922433:0:17189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217150.922447:0:17189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e4121d800/0x92b8e04cbf5fa596 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5fa58f expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217150.922467:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e4121d800/0x92b8e04cbf5fa596 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa58f expref: 13 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217150.922477:0:17189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e4121d800/0x92b8e04cbf5fa596 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa58f expref: 13 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217150.922486:0:17189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e4121d800, rc 0) 00000100:00100000:0.0:1782217150.922613:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c61a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+13:17926:x1868789713116928:12345-0@lo:101:mount.lustre.0 Request processed in 194us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217150.922620:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782217150.922793:0:17926:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43cb0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17926:1868789713116928:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782217150.922807:0:17926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e72e2d000/0x92b8e04cbf5fa58f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa596 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.922817:0:17926:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e72e2d000/0x92b8e04cbf5fa58f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5fa596 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782217150.922843:0:17926:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782217150.922898:0:17926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e72e2d000/0x92b8e04cbf5fa58f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa596 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.922905:0:17926:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e72e2d000/0x92b8e04cbf5fa58f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa596 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782217150.922913:0:17926:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff952e7c65c000 10000000:01000000:2.0:1782217150.922916:0:17926:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1782217150.922920:0:17926:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff952e7c65c000 from 1 10000000:01000000:2.0:1782217150.922922:0:17926:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1782217150.922944:0:17926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e72e2d800/0x92b8e04cbf5fa59d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.922950:0:17926:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e72e2d800/0x92b8e04cbf5fa59d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217150.922957:0:17926:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e72e2d800/0x92b8e04cbf5fa59d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217150.922970:0:17926:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43cb0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17926:1868789713117056:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1782217150.922994:0:17926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217150.923123:0:17926:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d426cc0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782217150.923178:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713117056 00000100:00100000:0.0:1782217150.923183:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713117056 00000100:00100000:0.0:1782217150.923237:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782217150.923245:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+13:17926:x1868789713117056:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782217150.923253:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217150.923261:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e4121d400/0x92b8e04cbf5fa5a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5fa59d expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217150.923274:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e4121d400/0x92b8e04cbf5fa5a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa59d expref: 14 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217150.923283:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e4121d400/0x92b8e04cbf5fa5a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa59d expref: 14 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217150.923290:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e4121d400, rc 0) 00000100:00100000:0.0:1782217150.923371:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+14:17926:x1868789713117056:12345-0@lo:101:mount.lustre.0 Request processed in 127us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217150.923377:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782217150.923441:0:17926:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43cb0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17926:1868789713117056:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782217150.923453:0:17926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e72e2d800/0x92b8e04cbf5fa59d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa5a4 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.923461:0:17926:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e72e2d800/0x92b8e04cbf5fa59d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5fa5a4 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782217150.923472:0:17926:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1782217150.923511:0:17926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e72e2d800/0x92b8e04cbf5fa59d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa5a4 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.923519:0:17926:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e72e2d800/0x92b8e04cbf5fa59d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa5a4 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782217150.923525:0:17926:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1782217150.923534:0:17926:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782217150.923539:0:17926:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff952e7c65c000 10000000:01000000:3.0:1782217150.923541:0:17926:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1782217150.923544:0:17926:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1782217150.923546:0:17926:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1782217150.923562:0:17926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e41681400/0x92b8e04cbf5fa5ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.923569:0:17926:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e41681400/0x92b8e04cbf5fa5ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.923577:0:17926:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e41681400/0x92b8e04cbf5fa5ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217150.923609:0:17926:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17926:1868789713117184:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782217150.923636:0:17926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217150.923656:0:17926:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e50087300 going to sleep for 11 seconds 00000100:00100000:1.0:1782217150.923714:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713117184 00000100:00100000:1.0:1782217150.923720:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713117184 00000100:00100000:1.0:1782217150.923750:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1782217150.923756:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c61a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+14:17926:x1868789713117184:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782217150.923763:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217150.923771:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952d43073600/0x92b8e04cbf5fa5b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5fa5ab expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217150.923783:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952d43073600/0x92b8e04cbf5fa5b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa5ab expref: 15 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217150.923791:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952d43073600/0x92b8e04cbf5fa5b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa5ab expref: 15 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217150.923797:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43073600, rc 0) 00000100:00100000:1.0:1782217150.923825:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c61a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+15:17926:x1868789713117184:12345-0@lo:101:mount.lustre.0 Request processed in 69us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217150.923832:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1782217150.923902:0:17926:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17926:1868789713117184:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782217150.923912:0:17926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e41681400/0x92b8e04cbf5fa5ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa5b2 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217150.923920:0:17926:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e41681400/0x92b8e04cbf5fa5ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5fa5b2 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782217150.925187:0:17926:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:3.0:1782217150.925807:0:17926:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782217150.929507:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1782217150.929565:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1782217150.929752:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1782217150.929772:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1782217150.929801:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:3.0:1782217150.929816:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:3.0:1782217150.929828:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:3.0:1782217150.929842:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1782217150.929853:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1782217150.929865:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:3.0:1782217150.929881:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:3.0:1782217150.929894:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:3.0:1782217150.929908:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:3.0:1782217150.929921:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1782217150.929946:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1782217150.929960:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:3.0:1782217150.929973:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1782217150.929985:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1782217150.929997:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:3.0:1782217150.930091:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1782217150.930104:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1782217150.930115:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1782217150.930126:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1782217150.930149:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:3.0:1782217150.930153:0:17926:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:3.0:1782217150.930238:0:17926:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17926:1868789713117312:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782217150.930299:0:17926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217150.930380:0:17926:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e50087180 going to sleep for 11 seconds 00000100:00100000:1.0:1782217150.930420:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713117312 00000100:00100000:1.0:1782217150.930429:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713117312 00000100:00100000:1.0:1782217150.930503:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782217150.930513:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c61bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+15:17926:x1868789713117312:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782217150.930686:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c61bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+15:17926:x1868789713117312:12345-0@lo:501:mount.lustre.0 Request processed in 174us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217150.930701:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1782217150.930780:0:17926:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17926:1868789713117312:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782217150.930812:0:17926:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17926:1868789713117440:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782217150.930848:0:17926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217150.931043:0:17926:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e42c44000 going to sleep for 11 seconds 00000100:00100000:3.0:1782217150.931177:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713117440 00000100:00100000:3.0:1782217150.931182:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713117440 00000100:00100000:3.0:1782217150.931203:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1782217150.931208:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+15:17926:x1868789713117440:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782217150.931835:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+15:17926:x1868789713117440:12345-0@lo:503:mount.lustre.0 Request processed in 624us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217150.931844:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1782217150.931941:0:17926:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17926:1868789713117440:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1782217150.932350:0:17926:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782217150.932425:0:17926:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17926:1868789713117568:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782217150.932464:0:17926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217150.932497:0:17926:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e42c44000 going to sleep for 11 seconds 00000100:00100000:1.0:1782217150.932609:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713117568 00000100:00100000:1.0:1782217150.932615:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713117568 00000100:00100000:1.0:1782217150.932646:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1782217150.932654:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c61b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+15:17926:x1868789713117568:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782217150.933654:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c61b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+15:17926:x1868789713117568:12345-0@lo:502:mount.lustre.0 Request processed in 997us (1186us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217150.933664:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1782217150.933822:0:17926:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17926:1868789713117568:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1782217150.934089:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1782217150.934115:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:0.0:1782217150.934127:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:0.0:1782217150.934138:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:0.0:1782217150.934149:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:0.0:1782217150.934161:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:0.0:1782217150.934171:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:0.0:1782217150.934182:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:0.0:1782217150.934192:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:0.0:1782217150.934203:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:0.0:1782217150.934214:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:0.0:1782217150.934224:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:0.0:1782217150.934235:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:0.0:1782217150.934244:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:0.0:1782217150.934264:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:0.0:1782217150.934275:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:0.0:1782217150.934288:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:0.0:1782217150.934302:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:0.0:1782217150.934315:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:0.0:1782217150.934327:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:0.0:1782217150.934341:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:0.0:1782217150.934354:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:0.0:1782217150.934365:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:0.0:1782217150.934377:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:0.0:1782217150.934388:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:0.0:1782217150.934399:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:0.0:1782217150.934412:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:0.0:1782217150.934424:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:0.0:1782217150.934446:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:0.0:1782217150.934463:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:0.0:1782217150.934476:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:0.0:1782217150.934488:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:0.0:1782217150.934499:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:0.0:1782217150.934513:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:0.0:1782217150.934527:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:0.0:1782217150.934539:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:0.0:1782217150.934550:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:0.0:1782217150.934562:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:0.0:1782217150.934573:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:0.0:1782217150.934669:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:0.0:1782217150.934686:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:0.0:1782217150.934701:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:0.0:1782217150.934712:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:0.0:1782217150.934727:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:0.0:1782217150.934758:0:17926:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17926:1868789713117696:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782217150.934805:0:17926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217150.934895:0:17926:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e42c44000 going to sleep for 11 seconds 00000100:00100000:2.0:1782217150.935167:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713117696 00000100:00100000:2.0:1782217150.935174:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713117696 00000100:00100000:1.0:1782217150.935255:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1782217150.935264:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c618050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+15:17926:x1868789713117696:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782217150.935363:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c618050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+15:17926:x1868789713117696:12345-0@lo:502:mount.lustre.0 Request processed in 100us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217150.935370:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1782217150.935455:0:17926:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17926:1868789713117696:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1782217150.935500:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:0.0:1782217150.935509:0:17926:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1782217150.936323:0:17930:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782217150.936334:0:17930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782217150.936336:0:17930:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1782217150.936341:0:17930:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1782217150.936345:0:17930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782217150.936358:0:17930:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff952e4e2899c0) 00000020:00000080:1.0:1782217150.936376:0:17930:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1782217150.936382:0:17930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1782217150.936460:0:17930:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1782217150.936467:0:17930:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x92b8e04cbf5fa5c0 00000020:00000080:1.0:1782217150.936682:0:17930:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1782217150.936686:0:17930:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782217150.936689:0:17930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782217150.936690:0:17930:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1782217150.936693:0:17930:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782217150.936703:0:17930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782217150.936705:0:17930:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1782217150.936708:0:17930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782217150.936714:0:17930:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff952e4e288000) 00000020:00000080:1.0:1782217150.936724:0:17930:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1782217150.936727:0:17930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1782217150.936729:0:17930:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1782217150.936732:0:17930:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1782217150.936736:0:17930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1782217150.936774:0:17930:0:(tgt_mount.c:153:server_get_mount()) get mount ffff952e7c65c000 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1782217150.936785:0:17930:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff952e5021b380) 00000020:00000080:1.0:1782217150.936793:0:17930:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1782217150.936859:0:17930:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1782217150.936864:0:17930:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x92b8e04cbf5fa5d5 00000020:00000080:1.0:1782217150.936966:0:17930:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1782217150.936973:0:17930:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1782217150.936976:0:17930:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x92b8e04cbf5fa5dc 00080000:01000000:1.0:1782217150.936982:0:17930:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:1.0:1782217150.936986:0:17930:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x92b8e04cbf5fa5e3 00010000:00010000:0.0:1782217150.984942:0:17930:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:0.0:1782217150.985364:0:17930:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:0.0:1782217150.985715:0:17930:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1782217150.990397:0:17930:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1782217150.990410:0:17930:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782217150.990416:0:17930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782217150.990418:0:17930:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1782217150.990422:0:17930:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782217150.990427:0:17930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782217150.990428:0:17930:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1782217150.990432:0:17930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1782217150.990437:0:17930:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:00000080:1.0:1782217150.990462:0:17930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782217150.990477:0:17930:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff952e502199c0) 00000020:00000080:1.0:1782217150.990497:0:17930:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1782217150.990501:0:17930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1782217150.990566:0:17930:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1782217150.990571:0:17930:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1782217150.990670:0:17930:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x92b8e04cbf5fa5f1 00010000:00080000:1.0:1782217150.990703:0:17930:0:(ldlm_lib.c:102:import_set_conn()) imp ffff952d4245f000@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.130@tcp at head 00010000:00010000:1.0:1782217150.993489:0:17930:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1782217150.995811:0:17930:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1782217150.995825:0:17930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1782217150.995876:0:17930:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1782217150.995897:0:17930:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x92b8e04cbf5fa5f8 00000100:00080000:0.0:1782217150.995908:0:17930:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782217150.995914:0:17930:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff952d4245f000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1782217150.995960:0:17930:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff952e46da6300 x1868789713117824/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782217150.995985:0:17930:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1782217150.996049:0:17930:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782217150.996054:0:17930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782217150.996056:0:17930:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1782217150.996059:0:17930:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1782217150.996062:0:17930:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1782217150.996064:0:17930:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1782217150.996065:0:17930:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1782217150.996067:0:17930:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1782217150.996069:0:17930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782217150.996070:0:17930:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1782217150.996072:0:17930:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782217150.996077:0:17930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782217150.996078:0:17930:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1782217150.996083:0:17930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1782217150.996122:0:17930:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1782217150.996136:0:17930:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782217150.996140:0:17930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782217150.996141:0:17930:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1782217150.996144:0:17930:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1782217150.996145:0:17930:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1782217150.996146:0:17930:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1782217150.996147:0:17930:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1782217150.996149:0:17930:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1782217150.996151:0:17930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782217150.996152:0:17930:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1782217150.996155:0:17930:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1782217150.996158:0:17930:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1782217150.996161:0:17930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782217150.996162:0:17930:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1782217150.996165:0:17930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1782217150.996169:0:17930:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:01000000:0.0:1782217150.996191:0:17930:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1782217150.996194:0:17930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1782217150.996206:0:17930:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff952e74c80000) 00000020:00000080:0.0:1782217150.996217:0:17930:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1782217150.996223:0:17930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1782217150.996274:0:17930:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1782217150.996280:0:17930:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:0.0:1782217150.996285:0:17930:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x92b8e04cbf5fa606 00010000:00080000:0.0:1782217150.996321:0:17930:0:(ldlm_lib.c:102:import_set_conn()) imp ffff952d43666800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.130@tcp at head 00010000:00010000:0.0:1782217150.996513:0:17930:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:1.0:1782217150.997040:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1782217150.997046:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1782217150.997050:0:36:0:(import.c:65:import_set_state_nolock()) ffff952e64e46800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782217150.997055:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 511 00000100:00080000:1.0:1782217150.997060:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1782217150.997065:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff952e64e46800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1782217150.997090:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff952d4441dc00 x1868789713117952/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782217150.997101:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782217150.997105:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1782217150.997107:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782217150.997110:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1782217150.997149:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782217150.997162:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1868789713118080:0@lo:400:kworker.0 00000100:00100000:1.0:1782217150.997221:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217150.997290:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713118080 00000100:00100000:1.0:1782217150.997297:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713118080 00000100:00100000:1.0:1782217150.997338:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782217150.997347:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4441e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1868789713118080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217150.997395:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4441e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1868789713118080:12345-0@lo:400:kworker.0 Request processed in 49us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217150.997402:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1782217150.997450:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff952d4441d180 x1868789713118080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782217150.997462:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1868789713118080:0@lo:400:kworker.0 00000100:00100000:3.0:1782217150.997696:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1868789713117824:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1782217150.997733:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217150.997766:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1868789713117952:0@lo:38:kworker.0 00000100:00100000:3.0:1782217150.997789:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217150.997854:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713117824 00000100:00100000:0.0:1782217150.997860:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713117824 00000100:00100000:0.0:1782217150.997874:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713117952 00000100:00100000:0.0:1782217150.997876:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713117952 00000100:00100000:0.0:1782217150.997885:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782217150.997896:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1868789713117824:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1782217150.997916:0:17200:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 513 last 0 00000020:00000080:0.0:1782217150.997966:0:17200:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x92b8e04cbf5fa60d 00000004:00100000:0.0:1782217150.997978:0:17200:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1782217150.997983:0:17200:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000040:01000000:1.0:1782217150.998534:0:17930:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1782217150.998855:0:17930:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1782217151.004029:0:17930:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782217151.004837:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1782217151.005016:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000100:00080000:0.0:1782217151.005632:0:17200:0:(import.c:65:import_set_state_nolock()) ffff952d42005000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782217151.005723:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1868789713117824:12345-0@lo:38:llog_process_th.0 Request processed in 7824us (7987us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217151.005734:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782217151.005760:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782217151.005766:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1868789713117952:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1782217151.005806:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1868789713117952:12345-0@lo:38:kworker.0 Request processed in 39us (8016us total) trans 0 rc -11/-11 00000100:00100000:0.0:1782217151.005812:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782217151.005894:0:3646:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1782217151.005903:0:3646:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1782217151.005911:0:3646:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1782217151.005916:0:3646:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1782217151.005919:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952d4245f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1782217151.005949:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1868789713117824:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1782217151.005962:0:3646:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1782217151.005966:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952e64e46800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782217151.005970:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1782217151.005973:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1868789713117952:0@lo:38:kworker.0 00000100:00100000:0.0:1782217151.006075:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713118208:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782217151.006116:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217151.006194:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713118208 00000100:00100000:3.0:1782217151.006201:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713118208 00000100:00100000:3.0:1782217151.006231:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782217151.006238:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3648:x1868789713118208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782217151.006262:0:17200:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1782217151.006306:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3648:x1868789713118208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217151.006312:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782217151.006419:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713118208:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1782217151.007163:0:17935:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1782217151.007169:0:17935:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1782217151.008234:0:17930:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1782217151.008245:0:17930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1782217151.008286:0:17930:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1782217151.008308:0:17930:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x92b8e04cbf5fa614 00000100:00080000:0.0:1782217151.008319:0:17930:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782217151.008325:0:17930:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff952d43666800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1782217151.008359:0:17930:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff952e46da6680 x1868789713118336/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782217151.008430:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1868789713118336:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1782217151.008501:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868789713118336 offset 0 length 520: 4 00000100:00080000:0.0:1782217151.008551:0:17930:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1782217151.008632:0:17930:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782217151.008636:0:17930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782217151.008638:0:17930:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1782217151.008641:0:17930:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1782217151.008643:0:17930:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1782217151.008645:0:17930:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1782217151.008646:0:17930:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1782217151.008647:0:17930:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1782217151.008650:0:17930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782217151.008651:0:17930:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1782217151.008653:0:17930:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1782217151.008656:0:17930:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1782217151.008659:0:17930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782217151.008660:0:17930:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1782217151.008662:0:17930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1782217151.008666:0:17930:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:01000000:0.0:1782217151.008684:0:17930:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1782217151.008686:0:17930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1782217151.008699:0:17930:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff952e64e199c0) 00000020:00000080:0.0:1782217151.008709:0:17930:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:0.0:1782217151.008713:0:17930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1782217151.008774:0:17930:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1782217151.008783:0:17930:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:0.0:1782217151.008788:0:17930:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x92b8e04cbf5fa622 00010000:00080000:0.0:1782217151.008812:0:17930:0:(ldlm_lib.c:102:import_set_conn()) imp ffff952d42002000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.130@tcp at head 00010000:00010000:0.0:1782217151.009014:0:17930:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1782217151.009084:0:17930:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1782217151.009100:0:17930:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:1.0:1782217151.009638:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782217151.009644:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1782217151.009646:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782217151.009650:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1782217151.011182:0:17930:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782217151.011545:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1782217151.011763:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1782217151.012251:0:17937:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1782217151.012257:0:17937:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1782217151.012883:0:17930:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1782217151.012900:0:17930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1782217151.012949:0:17930:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1782217151.012974:0:17930:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x92b8e04cbf5fa629 00000100:00080000:0.0:1782217151.012984:0:17930:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782217151.012990:0:17930:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff952d42002000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1782217151.013095:0:17930:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff952e46da5f80 x1868789713118464/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782217151.013162:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1868789713118464:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1782217151.013213:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868789713118464 offset 0 length 520: 4 00000100:00080000:0.0:1782217151.013266:0:17930:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1782217151.013318:0:17930:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782217151.013322:0:17930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782217151.013324:0:17930:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1782217151.013328:0:17930:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782217151.013332:0:17930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782217151.013333:0:17930:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1782217151.013335:0:17930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782217151.013337:0:17930:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1782217151.013339:0:17930:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782217151.013341:0:17930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782217151.013343:0:17930:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1782217151.013345:0:17930:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782217151.013347:0:17930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782217151.013348:0:17930:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1782217151.013352:0:17930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1782217151.013376:0:17930:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782217151.013378:0:17930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782217151.013380:0:17930:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1782217151.013383:0:17930:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:0.0:1782217151.013434:0:17926:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1782217151.013463:0:17926:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1782217151.013480:0:17926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e41681400/0x92b8e04cbf5fa5ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa5b2 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.013501:0:17926:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e41681400/0x92b8e04cbf5fa5ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa5b2 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782217151.013508:0:17926:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff952e7c65c000 from 1 10000000:01000000:0.0:1782217151.013511:0:17926:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1782217151.013535:0:17926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e4121ca00/0x92b8e04cbf5fa630 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.013542:0:17926:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e4121ca00/0x92b8e04cbf5fa630 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.013553:0:17926:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e4121ca00/0x92b8e04cbf5fa630 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217151.013568:0:17926:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17926:1868789713118592:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1782217151.013630:0:17926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217151.013649:0:17926:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e52a059c0 going to sleep for 11 seconds 00000100:00080000:1.0:1782217151.013821:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782217151.013826:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1782217151.013829:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782217151.013831:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1782217151.013850:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713118592 00000100:00100000:1.0:1782217151.013856:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713118592 00000100:00100000:1.0:1782217151.013901:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1782217151.013910:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c61b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+15:17926:x1868789713118592:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782217151.013932:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217151.013943:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952d43073e00/0x92b8e04cbf5fa637 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5fa630 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217151.013965:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952d43073e00/0x92b8e04cbf5fa637 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa630 expref: 16 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217151.013983:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952d43073e00/0x92b8e04cbf5fa637 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa630 expref: 16 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217151.013992:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43073e00, rc 0) 00000100:00100000:1.0:1782217151.014044:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c61b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+16:17926:x1868789713118592:12345-0@lo:101:mount.lustre.0 Request processed in 135us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217151.014050:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1782217151.014134:0:17926:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17926:1868789713118592:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782217151.014150:0:17926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e4121ca00/0x92b8e04cbf5fa630 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa637 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.014158:0:17926:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e4121ca00/0x92b8e04cbf5fa630 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5fa637 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217151.014982:0:17926:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17926:1868789713118720:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1782217151.015089:0:17926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217151.015157:0:17926:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e52a059c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782217151.015278:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713118720 00000100:00100000:2.0:1782217151.015284:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713118720 00000100:00100000:2.0:1782217151.015358:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1782217151.015366:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c618850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+16:17926:x1868789713118720:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1782217151.015386:0:17187:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1782217151.015400:0:17187:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1782217151.015403:0:17187:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1782217151.015482:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c618850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+16:17926:x1868789713118720:12345-0@lo:256:mount.lustre.0 Request processed in 117us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217151.015489:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1782217151.015546:0:17926:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17926:1868789713118720:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1782217151.016170:0:17926:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1782217151.016184:0:17926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e4121ca00/0x92b8e04cbf5fa630 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa637 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.016194:0:17926:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e4121ca00/0x92b8e04cbf5fa630 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa637 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782217151.016201:0:17926:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff952e7c65c000 from 1 10000000:01000000:0.0:1782217151.016204:0:17926:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782217151.016226:0:17926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e4121d200/0x92b8e04cbf5fa63e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.016234:0:17926:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e4121d200/0x92b8e04cbf5fa63e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.016242:0:17926:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e4121d200/0x92b8e04cbf5fa63e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217151.016255:0:17926:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17926:1868789713118848:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1782217151.016285:0:17926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217151.016541:0:17926:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e52a059c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782217151.016716:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713118848 00000100:00100000:1.0:1782217151.016722:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713118848 00000100:00100000:1.0:1782217151.016752:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1782217151.016759:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e47e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+16:17926:x1868789713118848:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782217151.016768:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217151.016779:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952d43072600/0x92b8e04cbf5fa645 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5fa63e expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217151.016799:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952d43072600/0x92b8e04cbf5fa645 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa63e expref: 17 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217151.016808:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952d43072600/0x92b8e04cbf5fa645 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa63e expref: 17 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217151.016815:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43072600, rc 0) 00000100:00100000:1.0:1782217151.016890:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e47e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+17:17926:x1868789713118848:12345-0@lo:101:mount.lustre.0 Request processed in 131us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217151.016896:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1782217151.016959:0:17926:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17926:1868789713118848:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782217151.016971:0:17926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e4121d200/0x92b8e04cbf5fa63e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa645 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.016980:0:17926:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e4121d200/0x92b8e04cbf5fa63e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5fa645 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782217151.017121:0:17926:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782217151.017150:0:17926:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17926:1868789713118976:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782217151.017178:0:17926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217151.017205:0:17926:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e52a05480 going to sleep for 11 seconds 00000100:00100000:1.0:1782217151.017307:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713118976 00000100:00100000:1.0:1782217151.017311:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713118976 00000100:00100000:1.0:1782217151.017340:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1782217151.017346:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e47e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+17:17926:x1868789713118976:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782217151.017432:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e47e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+17:17926:x1868789713118976:12345-0@lo:501:mount.lustre.0 Request processed in 85us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217151.017439:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1782217151.017506:0:17926:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17926:1868789713118976:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782217151.017531:0:17926:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17926:1868789713119104:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782217151.017568:0:17926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217151.017614:0:17926:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e52a05480 going to sleep for 11 seconds 00000100:00100000:1.0:1782217151.017660:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713119104 00000100:00100000:1.0:1782217151.017663:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713119104 00000100:00100000:1.0:1782217151.017681:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1782217151.017686:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72df9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+17:17926:x1868789713119104:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782217151.017766:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72df9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+17:17926:x1868789713119104:12345-0@lo:503:mount.lustre.0 Request processed in 79us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217151.017773:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1782217151.017844:0:17926:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17926:1868789713119104:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1782217151.018274:0:17926:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782217151.018329:0:17926:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17926:1868789713119232:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782217151.018363:0:17926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217151.018429:0:17926:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e52a059c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782217151.018518:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713119232 00000100:00100000:2.0:1782217151.018523:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713119232 00000100:00100000:1.0:1782217151.018569:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1782217151.018577:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72dfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+17:17926:x1868789713119232:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782217151.018667:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72dfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+17:17926:x1868789713119232:12345-0@lo:502:mount.lustre.0 Request processed in 90us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217151.018673:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1782217151.018771:0:17926:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17926:1868789713119232:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1782217151.018959:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1782217151.018982:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:0.0:1782217151.018994:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:0.0:1782217151.019100:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:0.0:1782217151.019116:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:0.0:1782217151.019127:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:0.0:1782217151.019138:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:0.0:1782217151.019163:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:0.0:1782217151.019175:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1782217151.019186:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:0.0:1782217151.019197:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:0.0:1782217151.019220:0:17926:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17926:1868789713119360:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782217151.019251:0:17926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217151.019278:0:17926:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e52a059c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782217151.019325:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713119360 00000100:00100000:1.0:1782217151.019329:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713119360 00000100:00100000:1.0:1782217151.019350:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1782217151.019355:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72df8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+17:17926:x1868789713119360:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782217151.019421:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72df8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+17:17926:x1868789713119360:12345-0@lo:502:mount.lustre.0 Request processed in 65us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217151.019427:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1782217151.019811:0:17926:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17926:1868789713119360:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1782217151.019852:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:0.0:1782217151.019860:0:17926:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1782217151.020386:0:17939:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782217151.020394:0:17939:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782217151.020396:0:17939:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1782217151.020402:0:17939:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff952e7c65c000 00000020:00000080:0.0:1782217151.020405:0:17939:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782217151.020412:0:17939:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782217151.020414:0:17939:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782217151.020415:0:17939:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1782217151.020418:0:17939:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782217151.020420:0:17939:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782217151.020421:0:17939:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1782217151.020425:0:17939:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff952e7c65c000 00000020:00000080:0.0:1782217151.020427:0:17939:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782217151.020479:0:17939:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782217151.020483:0:17939:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782217151.020485:0:17939:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1782217151.020487:0:17939:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782217151.020490:0:17939:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782217151.020491:0:17939:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1782217151.020494:0:17939:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff952e7c65c000 00000020:00000080:0.0:1782217151.020496:0:17939:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782217151.020513:0:17939:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782217151.020516:0:17939:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782217151.020517:0:17939:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1782217151.020519:0:17939:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782217151.020527:0:17939:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782217151.020528:0:17939:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1782217151.020532:0:17939:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff952e7c65c000 00000020:00000080:0.0:1782217151.020534:0:17939:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782217151.020557:0:17939:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782217151.020559:0:17939:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782217151.020561:0:17939:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1782217151.020564:0:17939:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:1.0:1782217151.021110:0:17926:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1782217151.021136:0:17926:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782217151.021166:0:17926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e4121d200/0x92b8e04cbf5fa63e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa645 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217151.021177:0:17926:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e4121d200/0x92b8e04cbf5fa63e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa645 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782217151.021227:0:17926:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1782217151.021230:0:17926:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff952e7c65c000 10000000:01000000:1.0:1782217151.021233:0:17926:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff952e7c65c000 10000000:01000000:1.0:1782217151.021237:0:17926:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782217151.021243:0:17926:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff952e7c65c000 from 1 10000000:01000000:1.0:1782217151.021246:0:17926:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782217151.021276:0:17926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952d43072000/0x92b8e04cbf5fa64c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217151.021285:0:17926:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952d43072000/0x92b8e04cbf5fa64c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217151.021295:0:17926:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952d43072000/0x92b8e04cbf5fa64c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217151.021313:0:17926:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17926:1868789713119488:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782217151.021363:0:17926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217151.021391:0:17926:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e50194840 going to sleep for 11 seconds 00000100:00100000:1.0:1782217151.021408:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713119488 00000100:00100000:1.0:1782217151.021414:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713119488 00000100:00100000:1.0:1782217151.021448:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1782217151.021457:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72dfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+17:17926:x1868789713119488:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782217151.021469:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217151.021481:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952d43073200/0x92b8e04cbf5fa653 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5fa64c expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217151.021509:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952d43073200/0x92b8e04cbf5fa653 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa64c expref: 18 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217151.021519:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952d43073200/0x92b8e04cbf5fa653 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa64c expref: 18 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217151.021528:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43073200, rc 0) 00000100:00100000:1.0:1782217151.021561:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72dfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+18:17926:x1868789713119488:12345-0@lo:101:mount.lustre.0 Request processed in 106us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217151.021568:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1782217151.021636:0:17926:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17926:1868789713119488:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782217151.021649:0:17926:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952d43072000/0x92b8e04cbf5fa64c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa653 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217151.021658:0:17926:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952d43072000/0x92b8e04cbf5fa64c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5fa653 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782217151.024314:0:17926:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1782217151.024971:0:17926:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782217151.025178:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1782217151.025217:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:1.0:1782217151.025233:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:1.0:1782217151.025260:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:1.0:1782217151.025275:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:1.0:1782217151.025289:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:1.0:1782217151.025300:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:1.0:1782217151.025312:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:1.0:1782217151.025324:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:1.0:1782217151.025349:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:1.0:1782217151.025364:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:1.0:1782217151.025378:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:1.0:1782217151.025391:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:1.0:1782217151.025406:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:1.0:1782217151.025419:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:1.0:1782217151.025432:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:1.0:1782217151.025446:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:1.0:1782217151.025472:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:1.0:1782217151.025487:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:1.0:1782217151.025501:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:1.0:1782217151.025514:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:1.0:1782217151.025527:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:1.0:1782217151.025540:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:1.0:1782217151.025552:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:1.0:1782217151.025566:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:1.0:1782217151.025579:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:1.0:1782217151.025626:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:1.0:1782217151.025638:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:1.0:1782217151.025655:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:1.0:1782217151.025660:0:17926:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1782217151.025734:0:17926:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17926:1868789713119616:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782217151.025796:0:17926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217151.025837:0:17926:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e501943c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782217151.028201:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713119616 00000100:00100000:0.0:1782217151.028214:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713119616 00000100:00100000:0.0:1782217151.028263:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1782217151.028273:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72dfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+18:17926:x1868789713119616:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782217151.028423:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72dfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+18:17926:x1868789713119616:12345-0@lo:501:mount.lustre.0 Request processed in 151us (2626us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217151.028431:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1782217151.028534:0:17926:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17926:1868789713119616:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782217151.031250:0:17926:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17926:1868789713119744:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782217151.031326:0:17926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217151.031370:0:17926:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e501943c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782217151.034443:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713119744 00000100:00100000:0.0:1782217151.034455:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713119744 00000100:00100000:0.0:1782217151.034503:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1782217151.034513:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72df9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+18:17926:x1868789713119744:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782217151.034685:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72df9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+18:17926:x1868789713119744:12345-0@lo:503:mount.lustre.0 Request processed in 174us (3359us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217151.034692:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1782217151.035125:0:17926:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17926:1868789713119744:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1782217151.035550:0:17926:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782217151.035660:0:17926:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17926:1868789713119872:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782217151.035710:0:17926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217151.035741:0:17926:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43d1c480 going to sleep for 11 seconds 00000100:00100000:0.0:1782217151.038233:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713119872 00000100:00100000:0.0:1782217151.038246:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713119872 00000100:00100000:0.0:1782217151.038295:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1782217151.038304:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72dfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+18:17926:x1868789713119872:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782217151.038457:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72dfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+18:17926:x1868789713119872:12345-0@lo:502:mount.lustre.0 Request processed in 154us (2746us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217151.038473:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1782217151.039131:0:17926:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17926:1868789713119872:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782217151.039357:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1782217151.039390:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:3.0:1782217151.039417:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:3.0:1782217151.039435:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:3.0:1782217151.039449:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:3.0:1782217151.039462:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:3.0:1782217151.039476:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:3.0:1782217151.039488:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:3.0:1782217151.039499:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:3.0:1782217151.039512:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:3.0:1782217151.039525:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:3.0:1782217151.039544:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:3.0:1782217151.039556:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:3.0:1782217151.039568:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:3.0:1782217151.039598:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:3.0:1782217151.039615:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:3.0:1782217151.039640:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:3.0:1782217151.039653:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:3.0:1782217151.039679:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:3.0:1782217151.039693:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:3.0:1782217151.039705:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:3.0:1782217151.039717:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:3.0:1782217151.039729:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:3.0:1782217151.039743:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:3.0:1782217151.039756:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:3.0:1782217151.039767:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:3.0:1782217151.039778:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:3.0:1782217151.039790:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:3.0:1782217151.039802:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:3.0:1782217151.039813:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:3.0:1782217151.039824:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:3.0:1782217151.039837:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:3.0:1782217151.039849:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:3.0:1782217151.039861:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:3.0:1782217151.039888:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:3.0:1782217151.039903:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:3.0:1782217151.039915:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:3.0:1782217151.039941:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:3.0:1782217151.039957:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:3.0:1782217151.039970:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:3.0:1782217151.039982:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:3.0:1782217151.039993:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:3.0:1782217151.041646:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:3.0:1782217151.041684:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:3.0:1782217151.041695:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:3.0:1782217151.041706:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:3.0:1782217151.041717:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:3.0:1782217151.041727:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:3.0:1782217151.041774:0:17926:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17926:1868789713120000:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782217151.041844:0:17926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217151.041876:0:17926:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43d1c480 going to sleep for 11 seconds 00000100:00100000:0.0:1782217151.041951:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713120000 00000100:00100000:0.0:1782217151.041958:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713120000 00000100:00100000:0.0:1782217151.042012:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1782217151.042021:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72dfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+18:17926:x1868789713120000:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782217151.042123:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72dfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+18:17926:x1868789713120000:12345-0@lo:502:mount.lustre.0 Request processed in 103us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217151.042130:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1782217151.044827:0:17926:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17926:1868789713120000:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782217151.045105:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:3.0:1782217151.045151:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:3.0:1782217151.045187:0:17926:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17926:1868789713120128:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782217151.045254:0:17926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217151.045296:0:17926:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43d1c480 going to sleep for 11 seconds 00000100:00100000:0.0:1782217151.047342:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713120128 00000100:00100000:0.0:1782217151.047356:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713120128 00000100:00100000:0.0:1782217151.047455:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1782217151.047465:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72df8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+18:17926:x1868789713120128:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782217151.049025:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72df8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+18:17926:x1868789713120128:12345-0@lo:502:mount.lustre.0 Request processed in 1556us (3766us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217151.049039:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1782217151.050952:0:17926:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17926:1868789713120128:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782217151.051072:0:17926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:1.0:1782217151.051088:0:17926:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1782217151.054884:0:17945:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1782217151.054902:0:17945:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff952d43340000) 00000020:00000080:3.0:1782217151.054934:0:17945:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1782217151.055238:0:17945:0:(tgt_mount.c:153:server_get_mount()) get mount ffff952e7c65c000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1782217151.055242:0:17945:0:(tgt_mount.c:187:server_put_mount()) put mount ffff952e7c65c000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1782217151.055244:0:17945:0:(obd_mount.c:701:lustre_put_lsi()) put ffff952e7c65c000 3 00010000:00080000:3.0:1782217151.055282:0:17945:0:(ldlm_lib.c:102:import_set_conn()) imp ffff952e7b352000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.130@tcp at head 00010000:00010000:3.0:1782217151.059699:0:17945:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1782217151.059799:0:17945:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1782217151.059844:0:17945:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1782217151.059855:0:17945:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x92b8e04cbf5fa661 00000100:00080000:3.0:1782217151.059866:0:17945:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782217151.059871:0:17945:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff952e7b352000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1782217151.059907:0:17945:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff952e7c6f0e00 x1868789713120256/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782217151.059966:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1868789713120256:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1782217151.063426:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217151.063510:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713120256 00000100:00100000:3.0:1782217151.063519:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713120256 00000100:00100000:3.0:1782217151.063568:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782217151.063576:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1868789713120256:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1782217151.063618:0:17196:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 514 last 0 00000020:00000080:3.0:1782217151.063665:0:17196:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x92b8e04cbf5fa668 00000004:00100000:3.0:1782217151.063680:0:17196:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1782217151.063709:0:17196:0:(import.c:65:import_set_state_nolock()) ffff952e4e094000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782217151.063761:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1868789713120256:12345-0@lo:38:llog_process_th.0 Request processed in 185us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217151.063769:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1782217151.063811:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff952e7c6f0e00 x1868789713120256/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782217161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217151.063822:0:3646:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1782217151.063830:0:3646:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1782217151.063838:0:3646:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1782217151.063843:0:3646:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1782217151.063845:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952e7b352000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1782217151.063851:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1868789713120256:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1782217151.063874:0:17945:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1782217151.064291:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1782217151.064297:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1782217151.064300:0:36:0:(import.c:65:import_set_state_nolock()) ffff952e64e46800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782217151.064308:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff952e64e46800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1782217151.064334:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff952d4441f480 x1868789713120384/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782217151.064354:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782217151.064358:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1782217151.064361:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782217151.064365:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1782217151.064401:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782217151.064405:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1782217151.064407:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782217151.064410:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1782217151.064465:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1868789713120512:0@lo:400:kworker.0 00000100:00100000:1.0:1782217151.064506:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217151.064528:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782217151.064534:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713120640:0@lo:400:kworker.0 00000100:00100000:1.0:1782217151.064564:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217151.064604:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713120512 00000100:00100000:1.0:1782217151.064609:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713120512 00000100:00100000:1.0:1782217151.064647:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782217151.064654:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4441f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1868789713120512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217151.064691:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4441f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1868789713120512:12345-0@lo:400:kworker.0 Request processed in 38us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217151.064699:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782217151.064716:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713120640 00000100:00100000:1.0:1782217151.064719:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713120640 00000100:00100000:1.0:1782217151.064741:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782217151.064745:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4441fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3649:x1868789713120640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217151.064777:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4441fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3649:x1868789713120640:12345-0@lo:400:kworker.0 Request processed in 31us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217151.064784:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782217151.064810:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713120640:0@lo:400:kworker.0 00010000:00080000:1.0:1782217151.064821:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff952d4441ea00 x1868789713120512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782217151.064830:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1868789713120512:0@lo:400:kworker.0 00000100:00100000:1.0:1782217151.064857:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1868789713120384:0@lo:38:kworker.0 00000100:00100000:1.0:1782217151.064887:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217151.064910:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713120384 00000100:00100000:1.0:1782217151.064914:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713120384 00000040:00080000:3.0:1782217151.066598:0:17945:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:2.0:1782217151.066726:0:17926:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1782217151.066755:0:17926:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782217151.066779:0:17926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952d43072000/0x92b8e04cbf5fa64c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa653 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217151.066790:0:17926:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952d43072000/0x92b8e04cbf5fa64c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa653 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1782217151.066835:0:17926:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1782217151.066838:0:17926:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1782217151.066839:0:17926:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782217151.066840:0:17926:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782217151.066841:0:17926:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782217151.066842:0:17926:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782217151.066843:0:17926:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782217151.066845:0:17926:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782217151.066846:0:17926:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782217151.066850:0:17926:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1782217151.066852:0:17926:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782217151.066853:0:17926:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1782217151.066854:0:17926:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782217151.066855:0:17926:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782217151.066856:0:17926:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782217151.066857:0:17926:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782217151.066858:0:17926:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782217151.066859:0:17926:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782217151.066865:0:17926:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782217151.066886:0:17926:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1782217151.066902:0:17926:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43cb1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17926:1868789713120768:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1782217151.066973:0:17926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217151.067071:0:17926:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d426ccb40 going to sleep for 11 seconds 00000100:00100000:2.0:1782217151.067093:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713120768 00000100:00100000:2.0:1782217151.067099:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713120768 00000100:00100000:2.0:1782217151.067136:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1782217151.067143:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72df8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+18:17926:x1868789713120768:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1782217151.067165:0:17187:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1782217151.067177:0:17187:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1782217151.067721:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782217151.067730:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4441ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1868789713120384:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1782217151.067836:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4441ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1868789713120384:12345-0@lo:38:kworker.0 Request processed in 105us (2948us total) trans 0 rc -11/-11 00000100:00100000:1.0:1782217151.067842:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000001:00100000:2.0:1782217151.074813:0:17174:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1782217151.074868:0:17187:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1782217151.074883:0:17187:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1782217151.075201:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72df8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+18:17926:x1868789713120768:12345-0@lo:253:mount.lustre.0 Request processed in 8051us (8222us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217151.075213:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1782217151.075276:0:17926:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43cb1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:17926:1868789713120768:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1782217151.075289:0:17926:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1782217151.075293:0:17926:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782217151.075294:0:17926:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1782217151.075295:0:17926:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782217151.075296:0:17926:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782217151.075297:0:17926:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782217151.075298:0:17926:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782217151.075300:0:17926:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782217151.075301:0:17926:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782217151.075303:0:17926:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1782217151.075315:0:17926:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1782217151.078054:0:17210:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1782217151.078064:0:17210:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1782217151.078088:0:17210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff952e4121c800/0x92b8e04cbf5fa66f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.078105:0:17210:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952e72e2ca00/0x92b8e04cbf5fa573 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa56c expref: 17 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.078113:0:17210:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952d43073e00/0x92b8e04cbf5fa637 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa630 expref: 17 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.078121:0:17210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff952e4121c800/0x92b8e04cbf5fa66f lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.078180:0:17210:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952d43073e00/0x92b8e04cbf5fa637 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5fa630 expref: 17 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.078194:0:17210:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff952d43073e00/0x92b8e04cbf5fa637 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5fa630 expref: 17 pid: 17186 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217151.078209:0:17210:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da6300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17210:1868789713120896:0@lo:104: 00000100:00100000:0.0:1782217151.078286:0:17210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782217151.078333:0:17210:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952e72e2ca00/0x92b8e04cbf5fa573 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5fa56c expref: 17 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.078341:0:17210:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff952e72e2ca00/0x92b8e04cbf5fa573 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5fa56c expref: 17 pid: 17189 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217151.078348:0:17210:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da4a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17210:1868789713121024:0@lo:104: 00000100:00100000:0.0:1782217151.078368:0:17210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217151.078387:0:17210:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e52a050c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782217151.078499:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713120896 00000100:00100000:0.0:1782217151.078507:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713120896 00000100:00100000:0.0:1782217151.078538:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713121024 00000100:00100000:0.0:1782217151.078541:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713121024 00000100:00100000:0.0:1782217151.078555:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782217151.078562:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a1470210-3884-42c5-8d09-248d2ed946c2+4:17210:x1868789713120896:12345-0@lo:104: 00010000:00010000:0.0:1782217151.078573:0:17178:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff952e4121ca00/0x92b8e04cbf5fa630 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5fa637 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.078634:0:17178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782217151.078640:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a1470210-3884-42c5-8d09-248d2ed946c2+4:17210:x1868789713120896:12345-0@lo:104: Request processed in 79us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217151.078652:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782217151.078666:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782217151.078671:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a1470210-3884-42c5-8d09-248d2ed946c2+3:17210:x1868789713121024:12345-0@lo:104: 00010000:00010000:0.0:1782217151.078677:0:17178:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff952e41681a00/0x92b8e04cbf5fa56c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5fa573 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.078702:0:17178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1782217151.078706:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a1470210-3884-42c5-8d09-248d2ed946c2+3:17210:x1868789713121024:12345-0@lo:104: Request processed in 36us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217151.078711:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782217151.078738:0:17210:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da6300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17210:1868789713120896:0@lo:104: 00000100:00100000:0.0:1782217151.078746:0:17210:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da4a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17210:1868789713121024:0@lo:104: 00010000:00010000:0.0:1782217151.078763:0:17210:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff952e4121c800/0x92b8e04cbf5fa66f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.078777:0:17182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782217151.078782:0:17182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e4121ca00/0x92b8e04cbf5fa630 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5fa637 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.078788:0:17182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121ca00 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:0.0:1782217151.078792:0:17182:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e4121ca00/0x92b8e04cbf5fa630 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5fa637 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.078800:0:17182:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e4121ca00/0x92b8e04cbf5fa630 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5fa637 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782217151.078807:0:17182:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e4121ca00/0x92b8e04cbf5fa630 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5fa637 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782217151.078818:0:17182:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1782217151.078843:0:17182:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e4121ca00/0x92b8e04cbf5fa630 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5fa637 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.078849:0:17182:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782217151.078865:0:17182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e4121ca00/0x92b8e04cbf5fa630 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5fa637 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.078871:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e4121ca00/0x92b8e04cbf5fa630 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5fa637 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.078883:0:17182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782217151.078886:0:17182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e41681a00/0x92b8e04cbf5fa56c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5fa573 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.078891:0:17182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e41681a00 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:0.0:1782217151.078894:0:17182:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e41681a00/0x92b8e04cbf5fa56c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5fa573 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.078900:0:17182:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e41681a00/0x92b8e04cbf5fa56c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5fa573 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782217151.078906:0:17182:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e41681a00/0x92b8e04cbf5fa56c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5fa573 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782217151.078910:0:17182:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1782217151.078919:0:17182:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e41681a00/0x92b8e04cbf5fa56c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5fa573 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.078936:0:17182:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782217151.078948:0:17182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e41681a00/0x92b8e04cbf5fa56c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5fa573 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.078955:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e41681a00/0x92b8e04cbf5fa56c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5fa573 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.078968:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217151.078969:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217151.078971:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782217151.078981:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a1470210-3884-42c5-8d09-248d2ed946c2:3647:1868789713121152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782217151.079006:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217151.079027:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782217151.079031:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a1470210-3884-42c5-8d09-248d2ed946c2:3647:1868789713121280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782217151.079046:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217151.079069:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713121152 00000100:00100000:0.0:1782217151.079072:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713121152 00010000:00010000:0.0:1782217151.079087:0:17179:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952d43073e00/0x92b8e04cbf5fa637 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5fa630 expref: 18 pid: 17186 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217151.079102:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713121280 00000100:00100000:0.0:1782217151.079105:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713121280 00010000:00010000:0.0:1782217151.079112:0:17179:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952e72e2ca00/0x92b8e04cbf5fa573 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5fa56c expref: 19 pid: 17189 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217151.079122:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782217151.079127:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1470210-3884-42c5-8d09-248d2ed946c2+19:3647:x1868789713121152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782217151.079135:0:17179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217151.079139:0:17179:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952d43073e00/0x92b8e04cbf5fa637 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5fa630 expref: 19 pid: 17186 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.079157:0:17179:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952d43073e00/0x92b8e04cbf5fa637 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5fa630 expref: 19 pid: 17186 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.079167:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952d43073e00/0x92b8e04cbf5fa637 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5fa630 expref: 19 pid: 17186 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.079178:0:17179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217151.079202:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1470210-3884-42c5-8d09-248d2ed946c2+18:3647:x1868789713121152:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217151.079209:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782217151.079219:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782217151.079224:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1470210-3884-42c5-8d09-248d2ed946c2+17:3647:x1868789713121280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782217151.079231:0:17179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217151.079235:0:17179:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952e72e2ca00/0x92b8e04cbf5fa573 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5fa56c expref: 17 pid: 17189 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.079242:0:17179:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952e72e2ca00/0x92b8e04cbf5fa573 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5fa56c expref: 17 pid: 17189 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.079250:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e72e2ca00/0x92b8e04cbf5fa573 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5fa56c expref: 17 pid: 17189 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.079261:0:17179:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff952e4121c800/0x92b8e04cbf5fa66f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.079267:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e4121c800/0x92b8e04cbf5fa66f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1782217151.079277:0:17179:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001865980s 00010000:00010000:0.0:1782217151.079287:0:17179:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff952e4121c800/0x92b8e04cbf5fa66f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.079293:0:17179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff952e4121c800/0x92b8e04cbf5fa66f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.079299:0:17179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff952e4121c800/0x92b8e04cbf5fa66f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.079305:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff952e4121c800/0x92b8e04cbf5fa66f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.079309:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121c800 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:0.0:1782217151.079313:0:17179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff952e4121c800/0x92b8e04cbf5fa66f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.079320:0:17179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff952e4121c800/0x92b8e04cbf5fa66f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.079332:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff952e4121c800/0x92b8e04cbf5fa66f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.079343:0:17179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217151.079366:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1470210-3884-42c5-8d09-248d2ed946c2+16:3647:x1868789713121280:12345-0@lo:103:ldlm_bl.0 Request processed in 142us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217151.079373:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782217151.079400:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a1470210-3884-42c5-8d09-248d2ed946c2:3647:1868789713121280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782217151.079408:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a1470210-3884-42c5-8d09-248d2ed946c2:3647:1868789713121152:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782217151.079423:0:17210:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff952e4121c800/0x92b8e04cbf5fa66f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.079440:0:17210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff952e4121c800/0x92b8e04cbf5fa66f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217151.079446:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e4121c800/0x92b8e04cbf5fa66f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1782217151.080126:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952e64e46800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782217151.080133:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1782217151.080137:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1868789713120384:0@lo:38:kworker.0 00010000:00010000:1.0:1782217151.080402:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1782217151.090512:0:17926:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:2.0:1782217151.091294:0:17952:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1782217151.091615:0:17926:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:1.0:1782217151.091817:0:17952:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782217151.093882:0:17952:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1782217151.093959:0:17952:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000020:00080000:3.0:1782217151.094310:0:17951:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1782217151.094315:0:17951:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:1.0:1782217151.094508:0:17953:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441ce00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17953:1868789713121408:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1782217151.094578:0:17953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217151.095296:0:17953:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e50194840 going to sleep for 11 seconds 00000040:01000000:2.0:1782217151.095705:0:17926:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1782217151.095744:0:17926:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1782217151.096184:0:17926:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1782217151.096192:0:17926:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1782217151.096228:0:17926:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782217151.097232:0:17926:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1782217151.097781:0:17926:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1782217151.097811:0:17926:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1782217151.097901:0:17926:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1782217151.098478:0:17926:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000100:00100000:3.0:1782217151.099205:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713121408 00000100:00100000:3.0:1782217151.099223:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713121408 00000100:00100000:3.0:1782217151.099274:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782217151.099283:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4441d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17953:x1868789713121408:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1782217151.099396:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4441d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17953:x1868789713121408:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 114us (4818us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217151.099404:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782217151.099578:0:17953:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441ce00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17953:1868789713121408:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1782217151.099642:0:17953:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1782217151.099687:0:17953:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43cb1880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17953:1868789713121536:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1782217151.099731:0:17953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217151.099754:0:17953:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e51edc240 going to sleep for 11 seconds 00000100:00100000:3.0:1782217151.099808:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713121536 00000100:00100000:3.0:1782217151.099812:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713121536 00000100:00100000:3.0:1782217151.099844:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782217151.099850:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17953:x1868789713121536:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1782217151.099954:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17953:x1868789713121536:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 104us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217151.099961:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782217151.100084:0:17953:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43cb1880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17953:1868789713121536:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1782217151.100135:0:17953:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43cb1880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17953:1868789713121664:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1782217151.100162:0:17953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217151.100184:0:17953:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e51edc0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782217151.100276:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713121664 00000100:00100000:3.0:1782217151.100281:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713121664 00000100:00100000:3.0:1782217151.100310:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782217151.100317:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17953:x1868789713121664:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1782217151.100360:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17953:x1868789713121664:12345-0@lo:900:lod0001_rec0000.0 Request processed in 43us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217151.100367:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1782217151.100418:0:17953:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff952d43cb1880 x1868789713121664/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1782217167 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782217151.100429:0:17953:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43cb1880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17953:1868789713121664:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1782217151.100468:0:17953:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43cb1880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17953:1868789713121792:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1782217151.100505:0:17953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217151.100525:0:17953:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e51edc240 going to sleep for 11 seconds 00000100:00100000:3.0:1782217151.100622:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713121792 00000100:00100000:3.0:1782217151.100626:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713121792 00000100:00100000:3.0:1782217151.100649:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782217151.100656:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17953:x1868789713121792:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1782217151.100700:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17953:x1868789713121792:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 44us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217151.100706:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782217151.100823:0:17953:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43cb1880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17953:1868789713121792:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1782217151.100861:0:17953:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00000004:1.0:1782217151.104270:0:17926:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000040:00080000:2.0:1782217151.105187:0:17953:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1782217151.105265:0:17953:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1782217151.105271:0:17953:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:1.0:1782217151.119779:0:17926:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1782217151.119817:0:17926:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa4bf81c4b988 00100000:10000000:1.0:1782217151.119826:0:17926:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1782217151.120541:0:17926:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1782217151.120575:0:17926:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.130@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1782217151.120615:0:17926:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1782217151.120630:0:17926:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1782217151.126468:0:17926:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1782217151.126724:0:17926:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1782217151.352824:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782217151.673019:0:17235:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e52b6ee40 going to sleep for 0 seconds 00000040:00080000:2.0:1782217152.126935:0:17948:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1782217152.376713:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782217152.696697:0:17235:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e52b6ee40 going to sleep for 0 seconds 10000000:01000000:0.0:1782217153.016669:0:17191:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1782217153.016676:0:17191:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff952e7c65c000 from 8 10000000:01000000:0.0:1782217153.016681:0:17191:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1782217153.016743:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e4121da00/0x92b8e04cbf5fa676 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217153.016754:0:17191:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e4121da00/0x92b8e04cbf5fa676 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217153.016765:0:17191:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e4121da00/0x92b8e04cbf5fa676 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217153.016790:0:17191:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713121920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782217153.016856:0:17191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217153.016991:0:17191:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e5062c780 going to sleep for 11 seconds 00000100:00100000:1.0:1782217153.017652:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713121920 00000100:00100000:1.0:1782217153.017660:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713121920 00000100:00100000:1.0:1782217153.018093:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1782217153.018106:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72dfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+16:17191:x1868789713121920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782217153.018120:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217153.018135:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952d43073400/0x92b8e04cbf5fa67d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5fa676 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217153.018157:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952d43073400/0x92b8e04cbf5fa67d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa676 expref: 17 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217153.018168:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952d43073400/0x92b8e04cbf5fa67d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa676 expref: 17 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217153.018177:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43073400, rc 0) 00000100:00100000:1.0:1782217153.018278:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72dfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+17:17191:x1868789713121920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (1421us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217153.018295:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1782217153.021181:0:17191:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713121920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782217153.021209:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e4121da00/0x92b8e04cbf5fa676 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa67d expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217153.021220:0:17191:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e4121da00/0x92b8e04cbf5fa676 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5fa67d expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217153.021383:0:17191:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713122048:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1782217153.021652:0:17191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217153.021733:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713122048 00000100:00100000:2.0:1782217153.021741:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713122048 00000100:00100000:2.0:1782217153.021792:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1782217153.021802:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72dfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+17:17191:x1868789713122048:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1782217153.021898:0:17187:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1782217153.021926:0:17187:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1782217153.021930:0:17187:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1782217153.022117:0:17191:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e47c55d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782217153.022181:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72dfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+17:17191:x1868789713122048:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 378us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217153.022279:0:17191:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713122048:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1782217153.022322:0:17191:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1782217153.022330:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e4121da00/0x92b8e04cbf5fa676 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa67d expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217153.022339:0:17191:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e4121da00/0x92b8e04cbf5fa676 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa67d expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217153.022349:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 10000000:01000000:1.0:1782217153.022349:0:17191:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1782217153.022351:0:17191:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff952d43f05800 from 8 10000000:01000000:1.0:1782217153.022354:0:17191:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782217153.022376:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952d43073800/0x92b8e04cbf5fa684 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217153.022383:0:17191:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952d43073800/0x92b8e04cbf5fa684 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217153.022392:0:17191:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952d43073800/0x92b8e04cbf5fa684 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217153.022406:0:17191:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713122176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782217153.022431:0:17191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217153.022454:0:17191:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e47c55d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782217153.022646:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713122176 00000100:00100000:2.0:1782217153.022650:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713122176 00000100:00100000:2.0:1782217153.022673:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1782217153.022678:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72dfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+17:17191:x1868789713122176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782217153.022686:0:17189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217153.022695:0:17189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e72e2dc00/0x92b8e04cbf5fa68b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5fa684 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217153.022710:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e72e2dc00/0x92b8e04cbf5fa68b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa684 expref: 18 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217153.022778:0:17189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e72e2dc00/0x92b8e04cbf5fa68b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa684 expref: 18 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217153.022784:0:17189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2dc00, rc 0) 00000100:00100000:2.0:1782217153.022815:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72dfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+18:17191:x1868789713122176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217153.022821:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1782217153.022891:0:17191:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713122176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782217153.022903:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952d43073800/0x92b8e04cbf5fa684 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa68b expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217153.022924:0:17191:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952d43073800/0x92b8e04cbf5fa684 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5fa68b expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217153.022963:0:17191:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713122304:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1782217153.023104:0:17191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217153.023131:0:17191:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e47c55d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782217153.023159:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713122304 00000100:00100000:2.0:1782217153.023163:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713122304 00000100:00100000:2.0:1782217153.023248:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1782217153.023257:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72df9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+18:17191:x1868789713122304:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1782217153.023269:0:17187:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1782217153.023283:0:17187:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1782217153.023286:0:17187:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1782217153.023356:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72df9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+18:17191:x1868789713122304:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 100us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217153.023365:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1782217153.023441:0:17191:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713122304:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1782217153.023475:0:17191:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1782217153.023545:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952d43073800/0x92b8e04cbf5fa684 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa68b expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217153.023563:0:17191:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952d43073800/0x92b8e04cbf5fa684 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa68b expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782217153.147191:0:17948:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1782217153.415579:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782217153.725489:0:17235:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e52b6ee40 going to sleep for 0 seconds 00010000:00010000:1.0:1782217154.427472:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782217154.744675:0:17235:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e52b6ee40 going to sleep for 0 seconds 00010000:00010000:2.0:1782217155.449308:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782217155.491490:0:18195:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1782217155.773784:0:17235:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e52b6ee40 going to sleep for 0 seconds 00000100:00100000:1.0:1782217156.158613:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782217156.158633:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713122432:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782217156.158694:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217156.158754:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713122432 00000100:00100000:1.0:1782217156.158760:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713122432 00000100:00100000:1.0:1782217156.158798:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782217156.158817:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4441d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713122432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782217156.158848:0:17200:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1782217156.158896:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4441d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713122432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217156.158903:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782217156.158941:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713122432:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1782217156.162939:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1782217156.162944:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1782217156.162948:0:36:0:(import.c:65:import_set_state_nolock()) ffff952e64e46800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782217156.163490:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff952e64e46800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1782217156.163514:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff952e7c6f2680 x1868789713122688/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782217156.163531:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782217156.163535:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782217156.163538:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782217156.163541:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782217156.163562:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782217156.163565:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782217156.163567:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782217156.163570:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1782217156.163814:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1868789713122816:0@lo:400:kworker.0 00000100:00100000:0.0:1782217156.163860:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1868789713122944:0@lo:400:kworker.0 00000100:00100000:3.0:1782217156.163877:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217156.163902:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217156.164164:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713122816 00000100:00100000:1.0:1782217156.164171:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713122816 00000100:00100000:1.0:1782217156.164210:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713122944 00000100:00100000:1.0:1782217156.164213:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713122944 00000100:00100000:1.0:1782217156.164228:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782217156.164237:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1868789713122816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217156.164474:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1868789713122816:12345-0@lo:400:kworker.0 Request processed in 238us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217156.164482:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782217156.164497:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782217156.164504:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1868789713122944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217156.164532:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1868789713122944:12345-0@lo:400:kworker.0 Request processed in 28us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217156.164538:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1782217156.165612:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff952e7c6f2300 x1868789713122944/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782217156.165628:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1868789713122944:0@lo:400:kworker.0 00000100:00100000:0.0:1782217156.165659:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782217156.165670:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a1470210-3884-42c5-8d09-248d2ed946c2:3649:1868789713122560:0@lo:400:kworker.0 00000100:00100000:0.0:1782217156.165714:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217156.166220:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713122560 00000100:00100000:1.0:1782217156.166227:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713122560 00000100:00100000:1.0:1782217156.166271:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1782217156.166279:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72df9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+18:3649:x1868789713122560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217156.166326:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72df9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+18:3649:x1868789713122560:12345-0@lo:400:kworker.0 Request processed in 48us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217156.166523:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1782217156.166563:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a1470210-3884-42c5-8d09-248d2ed946c2:3649:1868789713122560:0@lo:400:kworker.0 00010000:00080000:3.0:1782217156.167338:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff952e7c6f2a00 x1868789713122816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217156.167353:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1868789713122816:0@lo:400:kworker.0 00000100:00100000:3.0:1782217156.175521:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1868789713122688:0@lo:38:kworker.0 00000100:00100000:3.0:1782217156.175609:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217156.175650:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713122688 00000100:00100000:1.0:1782217156.175658:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713122688 00000100:00100000:1.0:1782217156.175695:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782217156.175702:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1868789713122688:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1782217156.175732:0:17200:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 519 last 0 00000020:00000080:1.0:1782217156.175764:0:17200:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x92b8e04cbf5fa692 00000004:00100000:1.0:1782217156.175779:0:17200:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1782217156.175785:0:17200:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1782217156.189819:0:17200:0:(import.c:65:import_set_state_nolock()) ffff952e42fed800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782217156.189930:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1868789713122688:12345-0@lo:38:kworker.0 Request processed in 14225us (14319us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217156.189941:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1782217156.189994:0:3646:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1782217156.190005:0:3646:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1782217156.190011:0:3646:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1782217156.190014:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952e64e46800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1782217156.190034:0:3646:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000087dd06cc): req@ffff952d4441ed80 x1868789713115264/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782217156.190073:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1868789713122688:0@lo:38:kworker.0 00000100:00100000:0.0:1782217156.190294:0:17235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217156.190333:0:17235:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e52b6ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1782217156.190389:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713115264 00000100:00100000:2.0:1782217156.190396:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713115264 00000100:00100000:2.0:1782217156.190441:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782217156.190450:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17235:x1868789713115264:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1782217156.190521:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17235:x1868789713115264:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 72us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217156.190528:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782217156.190556:0:17235:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441ed80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17235:1868789713115264:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1782217156.190608:0:17235:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1782217156.190645:0:17235:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43cb1880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17235:1868789713123072:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1782217156.190673:0:17235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217156.190691:0:17235:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e516fee40 going to sleep for 11 seconds 00000100:00100000:2.0:1782217156.190700:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713123072 00000100:00100000:2.0:1782217156.190703:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713123072 00000100:00100000:2.0:1782217156.190718:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782217156.190723:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17235:x1868789713123072:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1782217156.190808:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17235:x1868789713123072:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 83us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217156.190811:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713123200:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782217156.190818:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782217156.190843:0:17235:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43cb1880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17235:1868789713123072:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1782217156.190851:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217156.190919:0:17235:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43cb1880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17235:1868789713123328:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1782217156.190938:0:17235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217156.190955:0:17235:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e516fee40 going to sleep for 11 seconds 00000100:00100000:2.0:1782217156.190966:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713123200 00000100:00100000:2.0:1782217156.190969:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713123200 00000100:00100000:2.0:1782217156.190981:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713123328 00000100:00100000:2.0:1782217156.190984:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713123328 00000100:00100000:2.0:1782217156.190994:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782217156.190998:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4441f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3649:x1868789713123200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782217156.191016:0:17199:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1782217156.191056:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4441f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3649:x1868789713123200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217156.191062:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782217156.191073:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1782217156.191078:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17235:x1868789713123328:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1782217156.191115:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17235:x1868789713123328:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 37us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217156.191121:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782217156.191550:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713123200:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782217156.191673:0:17235:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43cb1880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17235:1868789713123328:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1782217156.191711:0:17235:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782217156.197973:0:17235:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1782217156.198052:0:17235:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 18, retries 0 00000004:00080000:2.0:1782217156.198057:0:17235:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:2.0:1782217156.445194:0:18248:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782217156.445981:0:18248:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1782217156.474222:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1782217157.241370:0:18298:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1782217157.241637:0:18298:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1782217157.497255:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782217158.164933:0:18347:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdef078520 20000000:00000080:1.0:1782217158.164953:0:18347:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff952e477a6400 uarg=0000000000000000 20000000:01000000:1.0:1782217158.164995:0:18347:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1782217158.165002:0:18347:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1782217158.165008:0:18347:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1782217158.165539:0:18348:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1782217158.165784:0:18347:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1782217158.174125:0:18347:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1782217158.174157:0:18347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff952d43073000/0x92b8e04cbf5fa699 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217158.174174:0:18347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952d43072c00/0x92b8e04cbf5fa542 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa53b expref: 17 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217158.174182:0:18347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952d43072600/0x92b8e04cbf5fa645 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa63e expref: 17 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217158.174190:0:18347:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff952d43073000/0x92b8e04cbf5fa699 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217158.174233:0:18347:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952d43072600/0x92b8e04cbf5fa645 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5fa63e expref: 17 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217158.174246:0:18347:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff952d43072600/0x92b8e04cbf5fa645 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5fa63e expref: 17 pid: 17186 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217158.174260:0:18347:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18347:1868789713123456:0@lo:104: 00000100:00100000:1.0:1782217158.174321:0:18347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217158.174550:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713123456 00000100:00100000:0.0:1782217158.174558:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713123456 00000100:00100000:0.0:1782217158.174650:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782217158.174660:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4441ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a1470210-3884-42c5-8d09-248d2ed946c2+3:18347:x1868789713123456:12345-0@lo:104: 00010000:00010000:0.0:1782217158.174674:0:17177:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff952e4121d200/0x92b8e04cbf5fa63e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5fa645 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217158.174729:0:17177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782217158.174735:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4441ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a1470210-3884-42c5-8d09-248d2ed946c2+3:18347:x1868789713123456:12345-0@lo:104: Request processed in 78us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217158.174741:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1782217158.175041:0:18347:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952d43072c00/0x92b8e04cbf5fa542 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5fa53b expref: 17 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217158.175052:0:18347:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff952d43072c00/0x92b8e04cbf5fa542 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5fa53b expref: 17 pid: 17187 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217158.175062:0:18347:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18347:1868789713123584:0@lo:104: 00000100:00100000:1.0:1782217158.175089:0:18347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217158.175119:0:18347:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e516fed80 going to sleep for 11 seconds 00000100:00100000:1.0:1782217158.175137:0:18347:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18347:1868789713123456:0@lo:104: 00000100:00100000:0.0:1782217158.175162:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713123584 00000100:00100000:0.0:1782217158.175168:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713123584 00010000:00010000:3.0:1782217158.175184:0:17183:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782217158.175192:0:17183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e4121d200/0x92b8e04cbf5fa63e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5fa645 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217158.175202:0:17183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121d200 already unused, calling callback (ffffffffc1157c20) 00000100:00100000:0.0:1782217158.175203:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 10000000:00010000:3.0:1782217158.175207:0:17183:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e4121d200/0x92b8e04cbf5fa63e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5fa645 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217158.175213:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4441ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a1470210-3884-42c5-8d09-248d2ed946c2+3:18347:x1868789713123584:12345-0@lo:104: 00010000:00010000:3.0:1782217158.175219:0:17183:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e4121d200/0x92b8e04cbf5fa63e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5fa645 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782217158.175231:0:17183:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e4121d200/0x92b8e04cbf5fa63e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5fa645 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217158.175234:0:17177:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff952e4121d600/0x92b8e04cbf5fa53b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5fa542 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782217158.175241:0:17183:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1782217158.175280:0:17183:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e4121d200/0x92b8e04cbf5fa63e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5fa645 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217158.175284:0:17177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1782217158.175289:0:17183:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1782217158.175294:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4441ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a1470210-3884-42c5-8d09-248d2ed946c2+3:18347:x1868789713123584:12345-0@lo:104: Request processed in 82us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217158.175303:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1782217158.175314:0:17183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e4121d200/0x92b8e04cbf5fa63e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5fa645 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217158.175321:0:17182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782217158.175322:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e4121d200/0x92b8e04cbf5fa63e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5fa645 expref: -99 pid: 17926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217158.175337:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217158.175340:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217158.175342:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782217158.175363:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a1470210-3884-42c5-8d09-248d2ed946c2:3650:1868789713123712:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782217158.175398:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217158.175428:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713123712 00000100:00100000:0.0:1782217158.175433:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713123712 00010000:00010000:0.0:1782217158.175450:0:17180:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952d43072600/0x92b8e04cbf5fa645 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5fa63e expref: 18 pid: 17186 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217158.175481:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782217158.175487:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1470210-3884-42c5-8d09-248d2ed946c2+18:3650:x1868789713123712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782217158.175497:0:17180:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217158.175511:0:17180:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952d43072600/0x92b8e04cbf5fa645 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5fa63e expref: 18 pid: 17186 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217158.175522:0:17180:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952d43072600/0x92b8e04cbf5fa645 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5fa63e expref: 18 pid: 17186 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217158.175544:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952d43072600/0x92b8e04cbf5fa645 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5fa63e expref: 18 pid: 17186 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217158.175550:0:18347:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18347:1868789713123584:0@lo:104: 00010000:00010000:0.0:1782217158.175558:0:17180:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782217158.175574:0:18347:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff952d43073000/0x92b8e04cbf5fa699 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217158.175616:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1470210-3884-42c5-8d09-248d2ed946c2+17:3650:x1868789713123712:12345-0@lo:103:ldlm_bl.0 Request processed in 128us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217158.175623:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782217158.175833:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a1470210-3884-42c5-8d09-248d2ed946c2:3650:1868789713123712:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782217158.177530:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217158.177536:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217158.177538:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217158.178577:0:17182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e4121d600/0x92b8e04cbf5fa53b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5fa542 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217158.178615:0:17182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121d600 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:1.0:1782217158.178620:0:17182:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e4121d600/0x92b8e04cbf5fa53b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5fa542 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217158.178632:0:17182:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e4121d600/0x92b8e04cbf5fa53b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5fa542 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782217158.178639:0:17182:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e4121d600/0x92b8e04cbf5fa53b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5fa542 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782217158.178644:0:17182:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1782217158.178703:0:17182:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e4121d600/0x92b8e04cbf5fa53b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5fa542 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217158.178709:0:17182:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782217158.178736:0:17182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e4121d600/0x92b8e04cbf5fa53b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5fa542 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217158.178818:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e4121d600/0x92b8e04cbf5fa53b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5fa542 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217158.178844:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217158.178846:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217158.178860:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782217158.178879:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782217158.178901:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a1470210-3884-42c5-8d09-248d2ed946c2:3648:1868789713123840:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782217158.178963:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217158.179259:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713123840 00000100:00100000:3.0:1782217158.179266:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713123840 00010000:00010000:3.0:1782217158.179296:0:17179:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952d43072c00/0x92b8e04cbf5fa542 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5fa53b expref: 17 pid: 17187 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217158.179331:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782217158.179339:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1470210-3884-42c5-8d09-248d2ed946c2+17:3648:x1868789713123840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782217158.179352:0:17179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217158.179357:0:17179:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952d43072c00/0x92b8e04cbf5fa542 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5fa53b expref: 17 pid: 17187 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217158.179367:0:17179:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952d43072c00/0x92b8e04cbf5fa542 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5fa53b expref: 17 pid: 17187 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217158.179383:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952d43072c00/0x92b8e04cbf5fa542 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5fa53b expref: 17 pid: 17187 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217158.179397:0:17179:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff952d43073000/0x92b8e04cbf5fa699 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217158.179406:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952d43073000/0x92b8e04cbf5fa699 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217158.179422:0:17179:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff952d43073000/0x92b8e04cbf5fa699 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217158.179430:0:17179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff952d43073000/0x92b8e04cbf5fa699 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217158.179443:0:17179:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff952d43073000/0x92b8e04cbf5fa699 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217158.179449:0:17179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff952d43073000/0x92b8e04cbf5fa699 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217158.179454:0:17179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43073000 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:3.0:1782217158.179459:0:17179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff952d43073000/0x92b8e04cbf5fa699 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217158.179467:0:17179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff952d43073000/0x92b8e04cbf5fa699 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217158.179773:0:18347:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff952d43073000/0x92b8e04cbf5fa699 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217158.179801:0:18347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff952d43073000/0x92b8e04cbf5fa699 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217158.185808:0:17179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff952d43073000/0x92b8e04cbf5fa699 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217158.186215:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952d43073000/0x92b8e04cbf5fa699 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217158.186237:0:17179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217158.186323:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1470210-3884-42c5-8d09-248d2ed946c2+16:3648:x1868789713123840:12345-0@lo:103:ldlm_bl.0 Request processed in 6981us (7356us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217158.186332:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782217158.187664:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a1470210-3884-42c5-8d09-248d2ed946c2:3648:1868789713123840:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782217158.527284:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782217159.427002:0:17191:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782217159.427010:0:17191:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff952e7c65c000 from 13 10000000:01000000:1.0:1782217159.427015:0:17191:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782217159.427058:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952d43072a00/0x92b8e04cbf5fa6a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217159.427069:0:17191:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952d43072a00/0x92b8e04cbf5fa6a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217159.427081:0:17191:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952d43072a00/0x92b8e04cbf5fa6a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217159.427103:0:17191:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713123968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782217159.427163:0:17191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217159.427232:0:17191:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e460690c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782217159.429678:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713123968 00000100:00100000:2.0:1782217159.429876:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713123968 00000100:00100000:2.0:1782217159.430145:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1782217159.430160:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72df8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+16:17191:x1868789713123968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782217159.430179:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217159.430200:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e72e2ce00/0x92b8e04cbf5fa6a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5fa6a0 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217159.430228:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e72e2ce00/0x92b8e04cbf5fa6a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa6a0 expref: 17 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217159.430241:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e72e2ce00/0x92b8e04cbf5fa6a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa6a0 expref: 17 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217159.430250:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2ce00, rc 0) 00000100:00100000:2.0:1782217159.430341:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72df8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+17:17191:x1868789713123968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (3177us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217159.430349:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1782217159.433273:0:17191:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713123968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782217159.433303:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952d43072a00/0x92b8e04cbf5fa6a0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa6a7 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217159.433315:0:17191:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952d43072a00/0x92b8e04cbf5fa6a0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5fa6a7 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217159.433423:0:17191:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43cb0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713124096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782217159.433492:0:17191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217159.433536:0:17191:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e51edc180 going to sleep for 11 seconds 00000100:00100000:0.0:1782217159.434727:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713124096 00000100:00100000:0.0:1782217159.434737:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713124096 00000100:00100000:0.0:1782217159.434781:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1782217159.434789:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72dfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+17:17191:x1868789713124096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782217159.434950:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72dfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+17:17191:x1868789713124096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 160us (1457us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217159.434958:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1782217159.435960:0:17191:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43cb0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713124096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782217159.436010:0:17191:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43cb0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713124224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782217159.436063:0:17191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217159.436090:0:17191:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e51edc180 going to sleep for 11 seconds 00000100:00100000:0.0:1782217159.436529:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713124224 00000100:00100000:0.0:1782217159.436536:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713124224 00000100:00100000:0.0:1782217159.436607:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1782217159.436623:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72dffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+17:17191:x1868789713124224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782217159.436988:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72dffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+17:17191:x1868789713124224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 372us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217159.436997:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1782217159.437072:0:17191:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43cb0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713124224:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1782217159.439078:0:18416:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1782217159.439346:0:17191:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1782217159.439382:0:17191:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782217159.439395:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952d43072a00/0x92b8e04cbf5fa6a0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa6a7 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217159.439406:0:17191:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952d43072a00/0x92b8e04cbf5fa6a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa6a7 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782217159.439416:0:17191:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782217159.439419:0:17191:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff952d43f05800 from 13 10000000:01000000:2.0:1782217159.439422:0:17191:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782217159.439608:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e72e2cc00/0x92b8e04cbf5fa6ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217159.439625:0:17191:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e72e2cc00/0x92b8e04cbf5fa6ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217159.439635:0:17191:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e72e2cc00/0x92b8e04cbf5fa6ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217159.439669:0:17191:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43cb0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713124352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782217159.439922:0:17191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217159.439965:0:17191:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e51edc180 going to sleep for 11 seconds 00000100:00100000:0.0:1782217159.440078:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713124352 00000100:00100000:0.0:1782217159.440086:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713124352 00000100:00100000:0.0:1782217159.440133:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1782217159.440142:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72dfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+17:17191:x1868789713124352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782217159.440155:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217159.440166:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e4121ce00/0x92b8e04cbf5fa6b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5fa6ae expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217159.440188:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e4121ce00/0x92b8e04cbf5fa6b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa6ae expref: 18 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217159.440212:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e4121ce00/0x92b8e04cbf5fa6b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa6ae expref: 18 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217159.440220:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e4121ce00, rc 0) 00000100:00100000:0.0:1782217159.440265:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72dfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+18:17191:x1868789713124352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217159.440272:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1782217159.440550:0:17191:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43cb0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713124352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782217159.440566:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e72e2cc00/0x92b8e04cbf5fa6ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa6b5 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217159.440575:0:17191:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e72e2cc00/0x92b8e04cbf5fa6ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5fa6b5 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217159.440856:0:17191:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713124480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782217159.440902:0:17191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217159.440935:0:17191:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e46069a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782217159.441000:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713124480 00000100:00100000:2.0:1782217159.441005:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713124480 00000100:00100000:2.0:1782217159.441038:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1782217159.441045:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72dfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+18:17191:x1868789713124480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782217159.441165:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72dfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+18:17191:x1868789713124480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217159.441172:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1782217159.441276:0:17191:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713124480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782217159.441320:0:17191:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713124608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782217159.441359:0:17191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217159.441516:0:17191:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e46069a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782217159.441559:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713124608 00000100:00100000:2.0:1782217159.441564:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713124608 00000100:00100000:2.0:1782217159.441682:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1782217159.441690:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72dfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+18:17191:x1868789713124608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782217159.441895:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72dfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+18:17191:x1868789713124608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 205us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217159.441901:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1782217159.445709:0:17191:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713124608:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1782217159.448182:0:18417:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1782217159.448332:0:17191:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1782217159.448354:0:17191:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782217159.448375:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e72e2cc00/0x92b8e04cbf5fa6ae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa6b5 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217159.448387:0:17191:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e72e2cc00/0x92b8e04cbf5fa6ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa6b5 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217159.544756:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217160.570751:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782217160.889297:0:17230:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:0.0:1782217161.275490:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782217161.275497:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1782217161.275500:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782217161.275503:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1782217161.275518:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782217161.275521:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1782217161.275523:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782217161.275527:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1782217161.275553:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a1470210-3884-42c5-8d09-248d2ed946c2:3648:1868789713124736:0@lo:400:kworker.0 00000100:00100000:0.0:1782217161.275639:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217161.275674:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1868789713125248:0@lo:400:kworker.0 00000100:00100000:0.0:1782217161.275698:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217161.275719:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782217161.275732:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713125120:0@lo:400:kworker.0 00000100:00100000:0.0:1782217161.275757:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217161.275786:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713124736 00000100:00100000:0.0:1782217161.275792:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713124736 00000100:00100000:0.0:1782217161.275840:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1782217161.275860:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72dfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+18:3648:x1868789713124736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217161.275908:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72dfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+18:3648:x1868789713124736:12345-0@lo:400:kworker.0 Request processed in 59us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217161.275915:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1782217161.276032:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713124864:0@lo:400:kworker.0 00000100:00100000:3.0:1782217161.276062:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217161.276091:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713125376:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782217161.276111:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217161.276121:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782217161.276126:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1868789713124992:0@lo:400:kworker.0 00000100:00100000:3.0:1782217161.276144:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217161.276160:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713125504:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782217161.276176:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217161.276195:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713125248 00000100:00100000:3.0:1782217161.276198:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713125248 00000100:00100000:3.0:1782217161.276219:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713124992 00000100:00100000:3.0:1782217161.276222:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713124992 00000100:00100000:3.0:1782217161.276232:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782217161.276237:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1868789713125248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217161.276267:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1868789713125248:12345-0@lo:400:kworker.0 Request processed in 29us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217161.276273:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782217161.276285:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782217161.276291:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1868789713124992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217161.276315:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1868789713124992:12345-0@lo:400:kworker.0 Request processed in 24us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217161.276320:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1782217161.276348:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff952e46da5880 x1868789713124992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782217161.276445:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713125120 00000100:00100000:0.0:1782217161.276449:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713125120 00000100:00100000:0.0:1782217161.276464:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713124864 00000100:00100000:0.0:1782217161.276466:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713124864 00000100:00100000:0.0:1782217161.276474:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713125376 00000100:00100000:0.0:1782217161.276476:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713125376 00000100:00100000:0.0:1782217161.276482:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713125504 00000100:00100000:0.0:1782217161.276484:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713125504 00000100:00100000:0.0:1782217161.276492:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782217161.276498:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3648:x1868789713125120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217161.276531:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3648:x1868789713125120:12345-0@lo:400:kworker.0 Request processed in 32us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217161.276537:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782217161.276548:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782217161.276554:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3649:x1868789713124864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217161.276578:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3649:x1868789713124864:12345-0@lo:400:kworker.0 Request processed in 24us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217161.276601:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782217161.276611:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782217161.276622:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1868789713125376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782217161.276643:0:17200:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1782217161.276671:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1868789713125376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 49us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217161.276676:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782217161.276686:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782217161.276691:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713125504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782217161.276704:0:17200:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1782217161.276726:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713125504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 35us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217161.276732:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782217161.276758:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713125120:0@lo:400:kworker.0 00000100:00100000:0.0:1782217161.276767:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a1470210-3884-42c5-8d09-248d2ed946c2:3648:1868789713124736:0@lo:400:kworker.0 00010000:00080000:0.0:1782217161.276777:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff952e46da5500 x1868789713125248/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782217161.276786:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1868789713125248:0@lo:400:kworker.0 00000100:00100000:3.0:1782217161.276870:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1868789713124992:0@lo:400:kworker.0 00000100:00100000:3.0:1782217161.276886:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713125504:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782217161.276895:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713124864:0@lo:400:kworker.0 00000100:00100000:3.0:1782217161.276904:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713125376:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782217161.277452:0:3646:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782217151/real 1782217151] req@ffff952e46da5f80 x1868789713118464/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782217161 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217161.277470:0:3646:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff952e46da5f80 x1868789713118464/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782217161 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217161.277479:0:3646:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782217151/real 1782217151] req@ffff952e46da6680 x1868789713118336/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782217161 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217161.277491:0:3646:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff952e46da6680 x1868789713118336/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782217161 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1782217161.277509:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952d42002000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782217161.277532:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1782217161.277536:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1868789713118464:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1782217161.277541:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952d43666800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782217161.277545:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1782217161.277548:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1868789713118336:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1782217161.277652:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782217161.277657:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1782217161.277659:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782217161.277663:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1782217161.277666:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782217161.277669:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1782217161.277675:0:8:0:(import.c:65:import_set_state_nolock()) ffff952d43666800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782217161.277679:0:8:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 513 00000100:00080000:0.0:1782217161.277684:0:8:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1782217161.277689:0:8:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff952d43666800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1782217161.277712:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff952e46da5500 x1868789713125632/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782217161.277728:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782217161.277731:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1782217161.277733:0:8:0:(import.c:65:import_set_state_nolock()) ffff952d42002000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782217161.277736:0:8:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 513 00000100:00080000:0.0:1782217161.277738:0:8:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1782217161.277741:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff952d42002000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1782217161.277750:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff952e46da7100 x1868789713125760/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782217161.277813:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1868789713125632:0@lo:8:kworker.0 00000400:00000100:3.0:1782217161.277841:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868789713125632 offset 0 length 520: 4 00000100:00100000:3.0:1782217161.277882:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1868789713125760:0@lo:8:kworker.0 00000400:00000100:3.0:1782217161.277896:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868789713125760 offset 0 length 520: 4 00010000:00010000:1.0:1782217161.595565:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1782217161.795985:0:17927:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1782217162.616908:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782217163.322604:0:3646:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782217148/real 1782217148] req@ffff952e7c6f1180 x1868789713116416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782217163 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782217163.322635:0:3646:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff952e7c6f1180 x1868789713116416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782217163 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782217163.322656:0:3646:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782217148/real 1782217148] req@ffff952e7c6f1f80 x1868789713116544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782217163 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782217163.322669:0:3646:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff952e7c6f1f80 x1868789713116544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782217163 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1782217163.322694:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952e749ef800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1782217163.322710:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1782217163.322714:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1868789713116416:0@lo:8:kworker.0 00000100:00080000:2.0:1782217163.322719:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952e7b2cd000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1782217163.322724:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1782217163.322727:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1868789713116544:0@lo:8:kworker.0 00000100:00080000:2.0:1782217163.322786:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782217163.322790:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1782217163.322792:0:37:0:(import.c:65:import_set_state_nolock()) ffff952e749ef800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782217163.322796:0:37:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 511 00000100:00080000:2.0:1782217163.322801:0:37:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1782217163.322807:0:37:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff952e749ef800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1782217163.322824:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff952d43cb0e00 x1868789713126144/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782217163.322849:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782217163.322852:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1782217163.322854:0:37:0:(import.c:65:import_set_state_nolock()) ffff952e7b2cd000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782217163.322857:0:37:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 511 00000100:00080000:2.0:1782217163.322860:0:37:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1782217163.322863:0:37:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff952e7b2cd000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1782217163.322873:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff952d43cb2300 x1868789713126272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782217163.322903:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782217163.322918:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782217163.322920:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782217163.322923:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1782217163.322949:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43cb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1868789713126400:0@lo:400:kworker.0 00000100:00100000:2.0:1782217163.323006:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217163.323036:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782217163.323041:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43cb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713126528:0@lo:400:kworker.0 00000100:00100000:2.0:1782217163.323064:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217163.323098:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713126400 00000100:00100000:2.0:1782217163.323104:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713126400 00000100:00100000:2.0:1782217163.323148:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782217163.323156:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1868789713126400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217163.323203:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1868789713126400:12345-0@lo:400:kworker.0 Request processed in 48us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217163.323211:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1782217163.323245:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff952d43cb3800 x1868789713126400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782217163.323256:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43cb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1868789713126400:0@lo:400:kworker.0 00000100:00100000:2.0:1782217163.323272:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43cb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1868789713126144:0@lo:8:kworker.0 00000400:00000100:2.0:1782217163.323293:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868789713126144 offset 0 length 520: 4 00000100:00100000:2.0:1782217163.323311:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43cb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1868789713126272:0@lo:8:kworker.0 00000400:00000100:2.0:1782217163.323326:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1868789713126272 offset 0 length 520: 4 00000100:00100000:0.0:1782217163.324706:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43cb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a1470210-3884-42c5-8d09-248d2ed946c2:3647:1868789713125888:0@lo:400:kworker.0 00000100:00100000:0.0:1782217163.324766:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217163.324849:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43cb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1868789713126656:0@lo:400:kworker.0 00000100:00100000:0.0:1782217163.324877:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217163.324907:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782217163.324914:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43cb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713126016:0@lo:400:kworker.0 00000100:00100000:0.0:1782217163.324948:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217163.324982:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713126528 00000100:00100000:0.0:1782217163.324988:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713126528 00000100:00100000:0.0:1782217163.325020:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713126016 00000100:00100000:0.0:1782217163.325022:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713126016 00000100:00100000:0.0:1782217163.325036:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782217163.325052:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713126528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217163.325109:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713126528:12345-0@lo:400:kworker.0 Request processed in 58us (2043us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217163.325115:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782217163.325131:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782217163.325136:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713126016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217163.325167:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713126016:12345-0@lo:400:kworker.0 Request processed in 31us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217163.325173:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782217163.325205:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43cb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713126016:0@lo:400:kworker.0 00000100:00100000:0.0:1782217163.325233:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43cb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713126528:0@lo:400:kworker.0 00000100:00100000:3.0:1782217163.327212:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713126656 00000100:00100000:3.0:1782217163.327224:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713126656 00000100:00100000:3.0:1782217163.327280:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782217163.327289:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1868789713126656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217163.327377:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1868789713126656:12345-0@lo:400:kworker.0 Request processed in 89us (2498us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217163.327384:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1782217163.327548:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff952d43cb3100 x1868789713126656/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782217163.327562:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43cb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1868789713126656:0@lo:400:kworker.0 00000100:00100000:2.0:1782217163.328743:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713125888 00000100:00100000:2.0:1782217163.328759:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713125888 00000100:00100000:2.0:1782217163.329028:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1782217163.329038:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72dff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+18:3647:x1868789713125888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217163.329112:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72dff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+18:3647:x1868789713125888:12345-0@lo:400:kworker.0 Request processed in 76us (4346us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217163.329119:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1782217163.330292:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43cb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a1470210-3884-42c5-8d09-248d2ed946c2:3647:1868789713125888:0@lo:400:kworker.0 00000040:00080000:3.0:1782217163.386234:0:17948:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1782217163.645127:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1782217164.108888:0:18696:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1782217164.108892:0:18696:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1782217164.108894:0:18696:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1782217164.109001:0:18696:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff952e42fe8000 00000020:01000004:1.0:1782217164.109016:0:18696:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1782217164.109150:0:18696:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1782217164.109163:0:18696:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff952e50218000) 00000020:00000080:1.0:1782217164.109253:0:18696:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1782217164.202957:0:18696:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1782217164.210696:0:18696:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1782217164.211437:0:18696:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1782217164.211700:0:18696:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1782217164.211955:0:18696:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1782217164.212395:0:18696:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1782217164.212678:0:18696:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:3.0:1782217164.215873:0:18696:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1782217164.216121:0:18696:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1782217164.216133:0:18696:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1782217164.216145:0:18696:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x92b8e04cbf5fa6c3 00000020:01000004:3.0:1782217164.216151:0:18696:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1782217164.216171:0:18696:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.130@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1782217164.216175:0:18696:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1782217164.216180:0:18696:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1782217164.216185:0:18696:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1782217164.216196:0:18696:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff952d43343380) 00000020:00000080:3.0:1782217164.216224:0:18696:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1782217164.217329:0:18696:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782217164.217467:0:18696:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1782217164.217472:0:18696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1782217164.219146:0:18696:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1782217164.219156:0:18696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1782217164.219693:0:18696:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1782217164.219771:0:18696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1782217164.221570:0:18696:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782217164.221750:0:18696:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1782217164.221756:0:18696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1782217164.226976:0:18696:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1782217164.226993:0:18696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1782217164.258017:0:18696:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782217164.258253:0:18696:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1782217164.258260:0:18696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1782217164.260539:0:18696:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1782217164.260551:0:18696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1782217164.264550:0:18696:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1782217164.264570:0:18696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1782217164.267685:0:18696:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782217164.267877:0:18696:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1782217164.267884:0:18696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1782217164.268874:0:18696:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1782217164.268881:0:18696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1782217164.319770:0:18696:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782217164.320270:0:18696:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1782217164.320277:0:18696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1782217164.321966:0:18696:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1782217164.321978:0:18696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1782217164.323048:0:18696:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1782217164.323082:0:18696:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1782217164.323088:0:18696:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.130@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1782217164.347320:0:18696:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.130@tcp ctxt 0 is initialized 00000020:01000004:0.0:1782217164.347453:0:18696:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.130@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1782217164.347458:0:18696:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1782217164.347465:0:18696:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1782217164.347466:0:18696:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782217164.347467:0:18696:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782217164.347468:0:18696:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782217164.347469:0:18696:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782217164.347470:0:18696:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782217164.347471:0:18696:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782217164.347472:0:18696:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1782217164.347475:0:18696:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1782217164.347477:0:18696:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1782217164.347478:0:18696:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1782217164.347479:0:18696:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782217164.347480:0:18696:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782217164.347480:0:18696:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782217164.347481:0:18696:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782217164.347482:0:18696:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782217164.347483:0:18696:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782217164.347483:0:18696:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1782217164.347511:0:18696:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1782217164.347532:0:18696:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:18696:1868789713126784:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1782217164.347859:0:18696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217164.347964:0:18696:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e64e76240 going to sleep for 11 seconds 00000100:00100000:2.0:1782217164.348501:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713126784 00000100:00100000:2.0:1782217164.348510:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713126784 00000100:00100000:2.0:1782217164.348703:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1782217164.348714:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42289050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+18:18696:x1868789713126784:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1782217164.348765:0:17186:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1782217164.348768:0:17186:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1782217164.348771:0:17186:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1782217164.349437:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42289050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+18:18696:x1868789713126784:12345-0@lo:253:mount.lustre.0 Request processed in 722us (1575us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217164.349447:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1782217164.350076:0:18696:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:18696:1868789713126784:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1782217164.350093:0:18696:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1782217164.350096:0:18696:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782217164.350098:0:18696:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1782217164.350100:0:18696:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782217164.350101:0:18696:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782217164.350102:0:18696:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782217164.350104:0:18696:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782217164.350105:0:18696:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782217164.350107:0:18696:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782217164.350108:0:18696:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1782217164.350129:0:18696:0:(tgt_mount.c:101:server_register_mount()) register mount ffff952e42fe8000 from lustre-OST0000 10000000:01000000:3.0:1782217164.350640:0:18696:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1782217164.350644:0:18696:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1782217164.350653:0:18696:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff952e7dbdb380 local copy 00010000:00010000:3.0:1782217164.350663:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e41681800/0x92b8e04cbf5fa47e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa485 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217164.351622:0:18696:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:18696:1868789713126912:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782217164.351683:0:18696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217164.351726:0:18696:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e7c793180 going to sleep for 11 seconds 00000100:00100000:1.0:1782217164.351819:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713126912 00000100:00100000:1.0:1782217164.351835:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713126912 00000100:00100000:1.0:1782217164.351885:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1782217164.351902:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4228a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+18:18696:x1868789713126912:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782217164.352011:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4228a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+18:18696:x1868789713126912:12345-0@lo:501:mount.lustre.0 Request processed in 110us (327us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782217164.352019:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1782217164.352299:0:18696:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:18696:1868789713126912:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1782217164.352318:0:18696:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1782217164.352341:0:18696:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1782217164.352348:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e41681800/0x92b8e04cbf5fa47e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa485 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217164.352357:0:18696:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e41681800/0x92b8e04cbf5fa47e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa485 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782217164.352385:0:18696:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff952e42fe8000 10000000:01000000:3.0:1782217164.352390:0:18696:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1782217164.352395:0:18696:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1782217164.352397:0:18696:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782217164.352401:0:18696:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1782217164.352404:0:18696:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1782217164.352428:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e41681c00/0x92b8e04cbf5fa6d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217164.352436:0:18696:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e41681c00/0x92b8e04cbf5fa6d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217164.352444:0:18696:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e41681c00/0x92b8e04cbf5fa6d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217164.352458:0:18696:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:18696:1868789713127040:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782217164.352485:0:18696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217164.352521:0:18696:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e7c793180 going to sleep for 11 seconds 00000100:00100000:2.0:1782217164.352928:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713127040 00000100:00100000:2.0:1782217164.352934:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713127040 00000100:00100000:2.0:1782217164.352974:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1782217164.352981:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42289c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+18:18696:x1868789713127040:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782217164.352992:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217164.353004:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e72e2d200/0x92b8e04cbf5fa6d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5fa6d1 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217164.353024:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e72e2d200/0x92b8e04cbf5fa6d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa6d1 expref: 19 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217164.353046:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e72e2d200/0x92b8e04cbf5fa6d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa6d1 expref: 19 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217164.353055:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2d200, rc 0) 00000100:00100000:2.0:1782217164.353097:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42289c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+19:18696:x1868789713127040:12345-0@lo:101:mount.lustre.0 Request processed in 116us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217164.353103:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1782217164.353331:0:18696:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:18696:1868789713127040:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782217164.353352:0:18696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e41681c00/0x92b8e04cbf5fa6d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa6d8 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217164.353360:0:18696:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e41681c00/0x92b8e04cbf5fa6d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5fa6d8 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782217164.355661:0:18696:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1782217164.356627:0:18696:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782217164.362386:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1782217164.362441:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1782217164.362457:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1782217164.364994:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1782217164.365045:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1782217164.365058:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1782217164.365097:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1782217164.365104:0:18696:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1782217164.365208:0:18696:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:18696:1868789713127168:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782217164.365272:0:18696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217164.365377:0:18696:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e7c793300 going to sleep for 11 seconds 00000100:00100000:0.0:1782217164.366050:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713127168 00000100:00100000:0.0:1782217164.366060:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713127168 00000100:00100000:0.0:1782217164.366233:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1782217164.366243:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42288850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+19:18696:x1868789713127168:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782217164.366623:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42288850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+19:18696:x1868789713127168:12345-0@lo:501:mount.lustre.0 Request processed in 380us (1350us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217164.366632:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1782217164.370567:0:18696:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:18696:1868789713127168:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782217164.370979:0:18696:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43cb3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:18696:1868789713127296:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782217164.371063:0:18696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217164.371243:0:18696:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e45c70540 going to sleep for 11 seconds 00000100:00100000:1.0:1782217164.371293:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713127296 00000100:00100000:1.0:1782217164.371300:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713127296 00000100:00100000:1.0:1782217164.371385:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1782217164.371395:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+19:18696:x1868789713127296:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782217164.374737:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+19:18696:x1868789713127296:12345-0@lo:503:mount.lustre.0 Request processed in 3336us (3666us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217164.374752:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1782217164.375125:0:18696:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43cb3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:18696:1868789713127296:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1782217164.379953:0:18696:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782217164.380086:0:18696:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43cb3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:18696:1868789713127424:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782217164.380162:0:18696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217164.380206:0:18696:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e45c70540 going to sleep for 11 seconds 00000100:00100000:0.0:1782217164.380709:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713127424 00000100:00100000:0.0:1782217164.380717:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713127424 00000100:00100000:0.0:1782217164.380763:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1782217164.380783:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4228b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+19:18696:x1868789713127424:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782217164.381420:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4228b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+19:18696:x1868789713127424:12345-0@lo:502:mount.lustre.0 Request processed in 637us (1255us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217164.381434:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1782217164.381542:0:18696:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43cb3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:18696:1868789713127424:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782217164.381806:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1782217164.381847:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1782217164.381862:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1782217164.381877:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1782217164.381889:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1782217164.381901:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1782217164.381927:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1782217164.381957:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1782217164.381973:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1782217164.381999:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1782217164.382014:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1782217164.382027:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1782217164.382060:0:18696:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:18696:1868789713127552:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782217164.382103:0:18696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217164.382130:0:18696:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e47c55c00 going to sleep for 11 seconds 00000100:00100000:0.0:1782217164.382519:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713127552 00000100:00100000:0.0:1782217164.382526:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713127552 00000100:00100000:0.0:1782217164.382572:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1782217164.382603:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42288050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+19:18696:x1868789713127552:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782217164.382701:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42288050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+19:18696:x1868789713127552:12345-0@lo:502:mount.lustre.0 Request processed in 121us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217164.382708:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1782217164.385098:0:18696:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:18696:1868789713127552:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782217164.385230:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1782217164.385245:0:18696:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1782217164.387348:0:18713:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1782217164.387359:0:18713:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1782217164.387365:0:18713:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782217164.387368:0:18713:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1782217164.387377:0:18713:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782217164.387392:0:18713:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff952e5021cd40) 00000020:00000080:1.0:1782217164.387417:0:18713:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1782217164.387424:0:18713:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1782217164.387517:0:18713:0:(tgt_mount.c:153:server_get_mount()) get mount ffff952e42fe8000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1782217164.387526:0:18713:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1782217164.387534:0:18713:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x92b8e04cbf5fa6e6 00010000:00010000:1.0:1782217164.400046:0:18713:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1782217164.400968:0:18713:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:1.0:1782217164.403014:0:18713:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1782217164.409718:0:18713:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1782217164.409729:0:18713:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782217164.409735:0:18713:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782217164.409737:0:18713:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1782217164.409740:0:18713:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1782217164.409742:0:18713:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1782217164.409744:0:18713:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1782217164.409745:0:18713:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1782217164.409747:0:18713:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1782217164.409749:0:18713:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782217164.409750:0:18713:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1782217164.409752:0:18713:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782217164.409756:0:18713:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782217164.409757:0:18713:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1782217164.409759:0:18713:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1782217164.409761:0:18713:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1782217164.409769:0:18713:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782217164.409772:0:18713:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782217164.409774:0:18713:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1782217164.409776:0:18713:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782217164.409778:0:18713:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782217164.409779:0:18713:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1782217164.409783:0:18713:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1782217164.409815:0:18713:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782217164.409818:0:18713:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782217164.409819:0:18713:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1782217164.409822:0:18713:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1782217164.409921:0:18696:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1782217164.409958:0:18696:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1782217164.409980:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e41681c00/0x92b8e04cbf5fa6d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa6d8 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217164.409991:0:18696:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e41681c00/0x92b8e04cbf5fa6d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa6d8 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782217164.409999:0:18696:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff952e42fe8000 from 1 10000000:01000000:3.0:1782217164.410008:0:18696:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782217164.410045:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e41681600/0x92b8e04cbf5fa6ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217164.410053:0:18696:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e41681600/0x92b8e04cbf5fa6ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217164.410064:0:18696:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e41681600/0x92b8e04cbf5fa6ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217164.410087:0:18696:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:18696:1868789713127680:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782217164.410152:0:18696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217164.410194:0:18696:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e7c793300 going to sleep for 11 seconds 00000100:00100000:1.0:1782217164.411030:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713127680 00000100:00100000:1.0:1782217164.411039:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713127680 00000100:00100000:1.0:1782217164.411094:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1782217164.411103:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4228a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+19:18696:x1868789713127680:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782217164.411119:0:17189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217164.411132:0:17189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952d43072600/0x92b8e04cbf5fa6f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5fa6ed expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217164.411158:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952d43072600/0x92b8e04cbf5fa6f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa6ed expref: 20 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217164.411292:0:17189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952d43072600/0x92b8e04cbf5fa6f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa6ed expref: 20 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217164.411305:0:17189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43072600, rc 0) 00000100:00100000:1.0:1782217164.411377:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4228a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+20:18696:x1868789713127680:12345-0@lo:101:mount.lustre.0 Request processed in 274us (1224us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217164.411384:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1782217164.412633:0:18696:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:18696:1868789713127680:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782217164.412665:0:18696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e41681600/0x92b8e04cbf5fa6ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa6f4 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217164.412678:0:18696:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e41681600/0x92b8e04cbf5fa6ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5fa6f4 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782217164.414814:0:18696:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1782217164.415122:0:18696:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782217164.415453:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1782217164.415559:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1782217164.415811:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1782217164.415819:0:18696:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1782217164.415972:0:18696:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:18696:1868789713127808:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782217164.416035:0:18696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217164.416119:0:18696:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e7c7933c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782217164.418612:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713127808 00000100:00100000:1.0:1782217164.418627:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713127808 00000100:00100000:1.0:1782217164.418710:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1782217164.418721:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4228a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+20:18696:x1868789713127808:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782217164.418901:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4228a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+20:18696:x1868789713127808:12345-0@lo:501:mount.lustre.0 Request processed in 182us (2865us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217164.418918:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1782217164.419257:0:18696:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:18696:1868789713127808:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782217164.419321:0:18696:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:18696:1868789713127936:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782217164.419390:0:18696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217164.419445:0:18696:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e7c7933c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782217164.419658:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713127936 00000100:00100000:1.0:1782217164.419664:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713127936 00000100:00100000:1.0:1782217164.419705:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1782217164.419715:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+20:18696:x1868789713127936:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782217164.419817:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+20:18696:x1868789713127936:12345-0@lo:503:mount.lustre.0 Request processed in 103us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217164.419838:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1782217164.420354:0:18696:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:18696:1868789713127936:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1782217164.421128:0:18696:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782217164.421218:0:18696:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:18696:1868789713128064:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782217164.421280:0:18696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217164.421365:0:18696:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e7c793300 going to sleep for 11 seconds 00000100:00100000:1.0:1782217164.421928:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713128064 00000100:00100000:1.0:1782217164.421936:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713128064 00000100:00100000:1.0:1782217164.421986:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1782217164.421995:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+20:18696:x1868789713128064:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782217164.427058:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+20:18696:x1868789713128064:12345-0@lo:502:mount.lustre.0 Request processed in 5054us (5767us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217164.427076:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1782217164.427334:0:18696:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:18696:1868789713128064:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1782217164.427651:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1782217164.427746:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1782217164.427766:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1782217164.427779:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1782217164.427790:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1782217164.427802:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1782217164.427842:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1782217164.427860:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1782217164.427872:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1782217164.427885:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1782217164.427896:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1782217164.428010:0:18696:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:18696:1868789713128192:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782217164.428074:0:18696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217164.428117:0:18696:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e51edc0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782217164.428390:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713128192 00000100:00100000:3.0:1782217164.428397:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713128192 00000100:00100000:3.0:1782217164.428444:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1782217164.428453:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+20:18696:x1868789713128192:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782217164.428576:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+20:18696:x1868789713128192:12345-0@lo:502:mount.lustre.0 Request processed in 123us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217164.428616:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1782217164.429354:0:18696:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:18696:1868789713128192:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782217164.429429:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1782217164.429441:0:18696:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1782217164.431309:0:18717:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782217164.431322:0:18717:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782217164.431324:0:18717:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1782217164.431331:0:18717:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff952e42fe8000 00000020:00000080:0.0:1782217164.431335:0:18717:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782217164.431350:0:18717:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782217164.431353:0:18717:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782217164.431354:0:18717:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1782217164.431358:0:18717:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782217164.431360:0:18717:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782217164.431362:0:18717:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1782217164.431367:0:18717:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff952e42fe8000 00000020:00000080:0.0:1782217164.431369:0:18717:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782217164.431423:0:18717:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782217164.431426:0:18717:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782217164.431428:0:18717:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1782217164.431430:0:18717:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782217164.431432:0:18717:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782217164.431434:0:18717:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1782217164.431437:0:18717:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff952e42fe8000 00000020:00000080:0.0:1782217164.431439:0:18717:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782217164.431455:0:18717:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782217164.431458:0:18717:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782217164.431460:0:18717:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1782217164.431462:0:18717:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782217164.431465:0:18717:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782217164.431466:0:18717:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1782217164.431469:0:18717:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff952e42fe8000 00000020:00000080:0.0:1782217164.431472:0:18717:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782217164.431491:0:18717:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782217164.431494:0:18717:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782217164.431495:0:18717:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1782217164.431497:0:18717:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1782217164.434037:0:18696:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1782217164.434080:0:18696:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782217164.434099:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e41681600/0x92b8e04cbf5fa6ed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa6f4 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217164.434122:0:18696:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e41681600/0x92b8e04cbf5fa6ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa6f4 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782217164.434205:0:18696:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1782217164.434209:0:18696:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff952e42fe8000 10000000:01000000:1.0:1782217164.434212:0:18696:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff952e42fe8000 10000000:01000000:1.0:1782217164.434216:0:18696:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782217164.434222:0:18696:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff952e42fe8000 from 1 10000000:01000000:1.0:1782217164.434224:0:18696:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782217164.434263:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952d43072c00/0x92b8e04cbf5fa6fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217164.434272:0:18696:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952d43072c00/0x92b8e04cbf5fa6fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217164.434283:0:18696:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952d43072c00/0x92b8e04cbf5fa6fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217164.434306:0:18696:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:18696:1868789713128320:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782217164.434369:0:18696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217164.434406:0:18696:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43c99780 going to sleep for 11 seconds 00000100:00100000:1.0:1782217164.434432:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713128320 00000100:00100000:1.0:1782217164.434438:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713128320 00000100:00100000:1.0:1782217164.434491:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1782217164.434500:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+20:18696:x1868789713128320:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782217164.434515:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217164.434527:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952d43073000/0x92b8e04cbf5fa702 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5fa6fb expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217164.434561:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952d43073000/0x92b8e04cbf5fa702 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa6fb expref: 21 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217164.434572:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952d43073000/0x92b8e04cbf5fa702 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa6fb expref: 21 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217164.434580:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43073000, rc 0) 00000100:00100000:1.0:1782217164.434638:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+21:18696:x1868789713128320:12345-0@lo:101:mount.lustre.0 Request processed in 139us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217164.434646:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1782217164.434927:0:18696:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:18696:1868789713128320:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782217164.434945:0:18696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952d43072c00/0x92b8e04cbf5fa6fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa702 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217164.434954:0:18696:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952d43072c00/0x92b8e04cbf5fa6fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5fa702 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782217164.440399:0:18696:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1782217164.440744:0:18696:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782217164.441123:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1782217164.441150:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1782217164.441165:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1782217164.443104:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1782217164.443134:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1782217164.443151:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1782217164.443164:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1782217164.443249:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1782217164.443265:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1782217164.443279:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1782217164.443294:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1782217164.443309:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1782217164.443324:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1782217164.443339:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1782217164.443354:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1782217164.443369:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1782217164.443384:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1782217164.443398:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1782217164.443434:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1782217164.443466:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1782217164.443483:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1782217164.443497:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1782217164.443518:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1782217164.443536:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1782217164.443550:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1782217164.443563:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1782217164.443575:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1782217164.443607:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1782217164.443622:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1782217164.443637:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1782217164.443650:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1782217164.443664:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1782217164.443678:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1782217164.443691:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1782217164.443705:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1782217164.443733:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1782217164.443749:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1782217164.443774:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1782217164.443780:0:18696:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1782217164.443900:0:18696:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:18696:1868789713128448:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782217164.449039:0:18696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217164.449089:0:18696:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43c99300 going to sleep for 11 seconds 00000100:00100000:2.0:1782217164.450106:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713128448 00000100:00100000:2.0:1782217164.450117:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713128448 00000100:00100000:2.0:1782217164.450182:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1782217164.450193:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+21:18696:x1868789713128448:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782217164.450367:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+21:18696:x1868789713128448:12345-0@lo:501:mount.lustre.0 Request processed in 175us (1330us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217164.450374:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1782217164.454195:0:18696:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:18696:1868789713128448:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782217164.454259:0:18696:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:18696:1868789713128576:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782217164.454336:0:18696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217164.454387:0:18696:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43c99300 going to sleep for 11 seconds 00000100:00100000:0.0:1782217164.454559:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713128576 00000100:00100000:0.0:1782217164.454566:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713128576 00000100:00100000:0.0:1782217164.454640:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1782217164.454649:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+21:18696:x1868789713128576:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782217164.455504:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+21:18696:x1868789713128576:12345-0@lo:503:mount.lustre.0 Request processed in 851us (1163us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217164.455523:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1782217164.455821:0:18696:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:18696:1868789713128576:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1782217164.456638:0:18696:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782217164.456894:0:18696:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:18696:1868789713128704:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782217164.457139:0:18696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217164.457242:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713128704 00000100:00100000:3.0:1782217164.457249:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713128704 00000100:00100000:3.0:1782217164.457294:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1782217164.457303:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+21:18696:x1868789713128704:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782217164.457310:0:18696:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43c99300 going to sleep for 11 seconds 00000100:00100000:3.0:1782217164.457421:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+21:18696:x1868789713128704:12345-0@lo:502:mount.lustre.0 Request processed in 119us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217164.457429:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1782217164.457670:0:18696:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:18696:1868789713128704:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782217164.457890:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1782217164.457933:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1782217164.457949:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1782217164.457963:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1782217164.457975:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1782217164.457987:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1782217164.457999:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1782217164.458013:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1782217164.458026:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1782217164.458039:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1782217164.458070:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1782217164.458085:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1782217164.458098:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1782217164.458110:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1782217164.458122:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1782217164.458135:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1782217164.458146:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1782217164.458158:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1782217164.458374:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1782217164.458397:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1782217164.458414:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1782217164.458433:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1782217164.458448:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1782217164.458463:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1782217164.458477:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1782217164.458505:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1782217164.458533:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1782217164.458550:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1782217164.458565:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1782217164.458578:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1782217164.458625:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1782217164.458638:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1782217164.458650:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1782217164.458663:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1782217164.458674:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1782217164.458729:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1782217164.458747:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1782217164.458761:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1782217164.458774:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1782217164.458788:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1782217164.458801:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1782217164.458813:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1782217164.458850:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1782217164.458867:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1782217164.458882:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1782217164.458898:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1782217164.458974:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1782217164.458991:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1782217164.459039:0:18696:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:18696:1868789713128832:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782217164.459099:0:18696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217164.459133:0:18696:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43c99300 going to sleep for 11 seconds 00000100:00100000:0.0:1782217164.459219:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713128832 00000100:00100000:0.0:1782217164.459226:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713128832 00000100:00100000:0.0:1782217164.459275:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1782217164.459284:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+21:18696:x1868789713128832:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782217164.459392:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+21:18696:x1868789713128832:12345-0@lo:502:mount.lustre.0 Request processed in 109us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217164.459400:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1782217164.459496:0:18696:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:18696:1868789713128832:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782217164.463340:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1782217164.463404:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1782217164.463455:0:18696:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:18696:1868789713128960:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782217164.463538:0:18696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217164.463606:0:18696:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43c99300 going to sleep for 11 seconds 00000100:00100000:3.0:1782217164.463853:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713128960 00000100:00100000:3.0:1782217164.463861:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713128960 00000100:00100000:3.0:1782217164.463918:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1782217164.463927:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+21:18696:x1868789713128960:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782217164.464046:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+21:18696:x1868789713128960:12345-0@lo:502:mount.lustre.0 Request processed in 120us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217164.464054:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1782217164.464198:0:18696:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:18696:1868789713128960:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782217164.464249:0:18696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1782217164.464259:0:18696:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1782217164.464980:0:18721:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1782217164.464995:0:18721:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff952d43344d40) 00000020:00000080:3.0:1782217164.465016:0:18721:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1782217164.466686:0:18721:0:(tgt_mount.c:153:server_get_mount()) get mount ffff952e42fe8000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1782217164.466693:0:18721:0:(tgt_mount.c:187:server_put_mount()) put mount ffff952e42fe8000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1782217164.466696:0:18721:0:(obd_mount.c:701:lustre_put_lsi()) put ffff952e42fe8000 3 00010000:00080000:3.0:1782217164.466730:0:18721:0:(ldlm_lib.c:102:import_set_conn()) imp ffff952e7b2b9000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.130@tcp at head 00010000:00010000:3.0:1782217164.474208:0:18721:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1782217164.474389:0:18721:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1782217164.474434:0:18721:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1782217164.474446:0:18721:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x92b8e04cbf5fa710 00000100:00080000:3.0:1782217164.474456:0:18721:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782217164.474462:0:18721:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff952e7b2b9000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1782217164.474494:0:18721:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff952e7c6f1f80 x1868789713129088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782217164.474658:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1868789713129088:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1782217164.474738:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1782217164.474861:0:18721:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1782217164.474981:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713129088 00000100:00100000:2.0:1782217164.474989:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713129088 00000100:00080000:3.0:1782217164.475037:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782217164.475041:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782217164.475044:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782217164.475047:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782217164.475069:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782217164.475072:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782217164.475079:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782217164.475082:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1782217164.475128:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782217164.475138:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1868789713129088:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1782217164.475151:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713129216:0@lo:400:kworker.0 00010000:00080000:2.0:1782217164.475163:0:17194:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 527 last 0 00000100:00100000:3.0:1782217164.475187:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217164.475208:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782217164.475214:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1868789713129600:0@lo:400:kworker.0 00000100:00100000:3.0:1782217164.475235:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1782217164.475328:0:17194:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x92b8e04cbf5fa717 00000100:00100000:3.0:1782217164.475343:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1868789713129344:0@lo:400:kworker.0 00000004:00100000:2.0:1782217164.475345:0:17194:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1782217164.475378:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1782217164.475382:0:17194:0:(import.c:65:import_set_state_nolock()) ffff952e7b0ce800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782217164.475397:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782217164.475404:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713129472:0@lo:400:kworker.0 00000100:00100000:3.0:1782217164.475436:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217164.475447:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1868789713129088:12345-0@lo:38:llog_process_th.0 Request processed in 308us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217164.475458:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782217164.475476:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713129216 00000100:00100000:2.0:1782217164.475476:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713129600 00000100:00100000:2.0:1782217164.475480:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713129600 00000100:00100000:3.0:1782217164.475483:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713129216 00000100:00100000:2.0:1782217164.475512:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713129344 00000100:00100000:3.0:1782217164.475515:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713129472 00000100:00100000:2.0:1782217164.475517:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713129344 00000100:00100000:2.0:1782217164.475539:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782217164.475545:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1868789713129600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217164.475608:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1868789713129600:12345-0@lo:400:kworker.0 Request processed in 62us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217164.475615:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782217164.475627:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782217164.475643:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1868789713129344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217164.475646:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713129472 00000100:00100000:3.0:1782217164.475674:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782217164.475683:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713129216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217164.475690:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b300000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1868789713129344:12345-0@lo:400:kworker.0 Request processed in 47us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217164.475733:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713129216:12345-0@lo:400:kworker.0 Request processed in 51us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217164.475740:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782217164.475752:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1782217164.475759:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b301500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713129472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217164.475785:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b301500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713129472:12345-0@lo:400:kworker.0 Request processed in 27us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217164.475800:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1782217164.475851:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff952e7c6f2300 x1868789713129600/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217164.475863:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1868789713129600:0@lo:400:kworker.0 00000100:00100000:3.0:1782217164.475873:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713129216:0@lo:400:kworker.0 00000100:00100000:2.0:1782217164.475890:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1782217164.475925:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff952e7c6f1f80 x1868789713129088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782217174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782217164.475933:0:3646:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782217164.475939:0:3646:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1782217164.475945:0:3646:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1782217164.475949:0:3646:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1782217164.475951:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952e7b2b9000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1782217164.475957:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1868789713129088:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1782217164.476096:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713129472:0@lo:400:kworker.0 00010000:00080000:3.0:1782217164.476108:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff952e7c6f2680 x1868789713129344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217164.476116:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1868789713129344:0@lo:400:kworker.0 00000020:01000004:2.0:1782217164.476946:0:18721:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1782217164.476959:0:18721:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff952e7dbd99c0) 00000020:00000080:2.0:1782217164.476979:0:18721:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1782217164.477334:0:18721:0:(tgt_mount.c:153:server_get_mount()) get mount ffff952e42fe8000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1782217164.477339:0:18721:0:(tgt_mount.c:187:server_put_mount()) put mount ffff952e42fe8000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1782217164.477342:0:18721:0:(obd_mount.c:701:lustre_put_lsi()) put ffff952e42fe8000 3 00010000:00080000:2.0:1782217164.477368:0:18721:0:(ldlm_lib.c:102:import_set_conn()) imp ffff952e7b2b9800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.130@tcp at head 00010000:00010000:2.0:1782217164.480813:0:18721:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1782217164.480925:0:18721:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1782217164.480973:0:18721:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1782217164.480985:0:18721:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x92b8e04cbf5fa725 00000100:00080000:2.0:1782217164.480997:0:18721:0:(import.c:512:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782217164.481003:0:18721:0:(import.c:626:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff952e7b2b9800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1782217164.481311:0:18721:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff952d43cb0a80 x1868789713129728/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782217164.481371:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43cb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1868789713129728:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1782217164.481440:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1782217164.481513:0:18721:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1782217164.482565:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713129728 00000100:00100000:3.0:1782217164.482575:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713129728 00000100:00100000:3.0:1782217164.482643:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782217164.482650:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1868789713129728:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1782217164.482678:0:17196:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 527 last 0 00000020:00000080:3.0:1782217164.482765:0:17196:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x92b8e04cbf5fa72c 00000004:00100000:3.0:1782217164.482779:0:17196:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1782217164.482807:0:17196:0:(import.c:65:import_set_state_nolock()) ffff952e7b356000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782217164.482881:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1868789713129728:12345-0@lo:38:llog_process_th.0 Request processed in 230us (1441us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217164.482889:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1782217164.482971:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782217164.482976:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782217164.482979:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782217164.482988:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782217164.482991:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782217164.482994:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782217164.482996:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782217164.482999:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:3.0:1782217164.483046:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff952d43cb0a80 x1868789713129728/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782217174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217164.483057:0:3646:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1782217164.483064:0:3646:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1782217164.483071:0:3646:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1782217164.483075:0:3646:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1782217164.483077:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952e7b2b9800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1782217164.483083:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43cb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1868789713129728:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1782217164.485127:0:18721:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1782217164.486021:0:18696:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1782217164.486057:0:18696:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782217164.486074:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952d43072c00/0x92b8e04cbf5fa6fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa702 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217164.486086:0:18696:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952d43072c00/0x92b8e04cbf5fa6fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa702 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1782217164.486139:0:18696:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1782217164.486141:0:18696:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1782217164.486142:0:18696:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782217164.486143:0:18696:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782217164.486145:0:18696:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782217164.486146:0:18696:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782217164.486147:0:18696:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782217164.486149:0:18696:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782217164.486150:0:18696:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1782217164.486153:0:18696:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1782217164.486156:0:18696:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1782217164.486157:0:18696:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1782217164.486158:0:18696:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782217164.486159:0:18696:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782217164.486160:0:18696:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782217164.486165:0:18696:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782217164.486166:0:18696:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782217164.486167:0:18696:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782217164.486167:0:18696:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1782217164.490050:0:18696:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1782217164.490081:0:18696:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:18696:1868789713129856:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1782217164.490154:0:18696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217164.490198:0:18696:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e51edc240 going to sleep for 11 seconds 00000100:00100000:2.0:1782217164.490238:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713129856 00000100:00100000:2.0:1782217164.490247:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713129856 00000100:00100000:2.0:1782217164.490304:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1782217164.490315:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+21:18696:x1868789713129856:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1782217164.490345:0:17186:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1782217164.490359:0:17186:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1782217164.501964:0:17186:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1782217164.502015:0:17186:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1782217164.502794:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+21:18696:x1868789713129856:12345-0@lo:253:mount.lustre.0 Request processed in 12477us (12636us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217164.502806:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1782217164.502952:0:18696:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:18696:1868789713129856:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1782217164.502966:0:18696:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1782217164.502970:0:18696:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1782217164.502971:0:18696:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1782217164.502973:0:18696:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782217164.502974:0:18696:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782217164.502975:0:18696:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782217164.502976:0:18696:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782217164.502978:0:18696:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782217164.502979:0:18696:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782217164.502981:0:18696:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1782217164.502994:0:18696:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:0.0:1782217164.506999:0:18696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1782217164.509205:0:18696:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1782217164.509213:0:18696:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1782217164.509247:0:18696:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1782217164.509290:0:18696:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.130@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1782217164.509305:0:18696:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1782217164.509321:0:18696:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1782217164.510497:0:18696:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1782217164.510744:0:18696:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 20000000:01000000:2.0:1782217164.511365:0:17210:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1782217164.511370:0:17210:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1782217164.511391:0:17210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff952e72e2ca00/0x92b8e04cbf5fa733 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217164.511411:0:17210:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952d43073400/0x92b8e04cbf5fa67d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa676 expref: 20 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217164.511423:0:17210:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952e72e2dc00/0x92b8e04cbf5fa68b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa684 expref: 20 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217164.511438:0:17210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff952e72e2ca00/0x92b8e04cbf5fa733 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217164.511481:0:17210:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952e72e2dc00/0x92b8e04cbf5fa68b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5fa684 expref: 20 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217164.511511:0:17210:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff952e72e2dc00/0x92b8e04cbf5fa68b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5fa684 expref: 20 pid: 17189 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217164.511549:0:17210:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43cb0700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17210:1868789713129984:0@lo:104: 00000100:00100000:2.0:1782217164.511634:0:17210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782217164.511684:0:17210:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952d43073400/0x92b8e04cbf5fa67d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5fa676 expref: 20 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217164.511837:0:17210:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff952d43073400/0x92b8e04cbf5fa67d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5fa676 expref: 20 pid: 17186 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217164.511848:0:17210:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43cb0380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17210:1868789713130112:0@lo:104: 00000100:00100000:2.0:1782217164.511876:0:17210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217164.511892:0:17210:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e521b8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782217164.511917:0:17178:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1782217164.511932:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713129984 00000100:00100000:2.0:1782217164.511938:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713129984 00000100:00100000:2.0:1782217164.511969:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713130112 00000100:00100000:2.0:1782217164.511971:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713130112 00000100:00100000:2.0:1782217164.511983:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782217164.511991:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a1470210-3884-42c5-8d09-248d2ed946c2+4:17210:x1868789713129984:12345-0@lo:104: 00010000:00010000:2.0:1782217164.512003:0:17178:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff952d43073800/0x92b8e04cbf5fa684 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5fa68b expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217164.512051:0:17178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782217164.512057:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a1470210-3884-42c5-8d09-248d2ed946c2+4:17210:x1868789713129984:12345-0@lo:104: Request processed in 67us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217164.512064:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782217164.512081:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782217164.512086:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e74e85050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a1470210-3884-42c5-8d09-248d2ed946c2+3:17210:x1868789713130112:12345-0@lo:104: 00010000:00010000:2.0:1782217164.512101:0:17178:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff952e4121da00/0x92b8e04cbf5fa676 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5fa67d expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217164.512132:0:17178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1782217164.512138:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e74e85050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a1470210-3884-42c5-8d09-248d2ed946c2+3:17210:x1868789713130112:12345-0@lo:104: Request processed in 51us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217164.512144:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782217164.512206:0:17210:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43cb0700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17210:1868789713129984:0@lo:104: 00000100:00100000:2.0:1782217164.512214:0:17210:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43cb0380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17210:1868789713130112:0@lo:104: 00010000:00010000:2.0:1782217164.512230:0:17210:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff952e72e2ca00/0x92b8e04cbf5fa733 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217164.512804:0:17183:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782217164.512811:0:17183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952d43073800/0x92b8e04cbf5fa684 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5fa68b expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217164.512819:0:17183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43073800 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:2.0:1782217164.512823:0:17183:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952d43073800/0x92b8e04cbf5fa684 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5fa68b expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217164.512843:0:17183:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952d43073800/0x92b8e04cbf5fa684 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5fa68b expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782217164.512851:0:17183:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952d43073800/0x92b8e04cbf5fa684 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5fa68b expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782217164.512857:0:17183:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1782217164.512887:0:17183:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952d43073800/0x92b8e04cbf5fa684 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5fa68b expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217164.512905:0:17183:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782217164.512922:0:17183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952d43073800/0x92b8e04cbf5fa684 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5fa68b expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217164.512929:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952d43073800/0x92b8e04cbf5fa684 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5fa68b expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217164.512941:0:17183:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782217164.512944:0:17183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e4121da00/0x92b8e04cbf5fa676 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5fa67d expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217164.512949:0:17183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121da00 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:2.0:1782217164.512952:0:17183:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e4121da00/0x92b8e04cbf5fa676 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5fa67d expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217164.512959:0:17183:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e4121da00/0x92b8e04cbf5fa676 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5fa67d expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782217164.512965:0:17183:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e4121da00/0x92b8e04cbf5fa676 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5fa67d expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782217164.512971:0:17183:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1782217164.512986:0:17183:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e4121da00/0x92b8e04cbf5fa676 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5fa67d expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217164.512991:0:17183:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782217164.513004:0:17183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e4121da00/0x92b8e04cbf5fa676 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5fa67d expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217164.513010:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e4121da00/0x92b8e04cbf5fa676 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5fa67d expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217164.513031:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217164.513034:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217164.513037:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782217164.517879:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782217164.517906:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43cb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a1470210-3884-42c5-8d09-248d2ed946c2:3647:1868789713130240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782217164.517974:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217164.519108:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713130240 00000100:00100000:0.0:1782217164.519118:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713130240 00010000:00010000:0.0:1782217164.519154:0:17180:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952e72e2dc00/0x92b8e04cbf5fa68b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5fa684 expref: 21 pid: 17189 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217164.519215:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782217164.519225:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1470210-3884-42c5-8d09-248d2ed946c2+21:3647:x1868789713130240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782217164.519239:0:17180:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217164.519245:0:17180:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952e72e2dc00/0x92b8e04cbf5fa68b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5fa684 expref: 21 pid: 17189 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217164.519272:0:17180:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952e72e2dc00/0x92b8e04cbf5fa68b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5fa684 expref: 21 pid: 17189 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217164.519289:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e72e2dc00/0x92b8e04cbf5fa68b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5fa684 expref: 21 pid: 17189 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217164.519302:0:17180:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217164.519358:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1470210-3884-42c5-8d09-248d2ed946c2+20:3647:x1868789713130240:12345-0@lo:103:ldlm_bl.0 Request processed in 134us (1383us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217164.519365:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782217164.519418:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43cb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a1470210-3884-42c5-8d09-248d2ed946c2:3647:1868789713130240:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782217164.520898:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782217164.522616:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43cb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a1470210-3884-42c5-8d09-248d2ed946c2:3649:1868789713130368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782217164.522689:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217164.522756:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713130368 00000100:00100000:3.0:1782217164.522764:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713130368 00010000:00010000:3.0:1782217164.522796:0:17181:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952d43073400/0x92b8e04cbf5fa67d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5fa676 expref: 20 pid: 17186 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217164.522836:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782217164.522845:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72dfe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1470210-3884-42c5-8d09-248d2ed946c2+20:3649:x1868789713130368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782217164.522858:0:17181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217164.522863:0:17181:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952d43073400/0x92b8e04cbf5fa67d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5fa676 expref: 20 pid: 17186 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217164.522887:0:17181:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952d43073400/0x92b8e04cbf5fa67d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5fa676 expref: 20 pid: 17186 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217164.522971:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952d43073400/0x92b8e04cbf5fa67d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5fa676 expref: 20 pid: 17186 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217164.522988:0:17181:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff952e72e2ca00/0x92b8e04cbf5fa733 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217164.522995:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e72e2ca00/0x92b8e04cbf5fa733 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1782217164.523011:0:17181:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011641050s 00010000:00010000:3.0:1782217164.523015:0:17181:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff952e72e2ca00/0x92b8e04cbf5fa733 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217164.523022:0:17181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff952e72e2ca00/0x92b8e04cbf5fa733 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217164.523027:0:17181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff952e72e2ca00/0x92b8e04cbf5fa733 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217164.523033:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff952e72e2ca00/0x92b8e04cbf5fa733 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217164.523040:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2ca00 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:3.0:1782217164.523044:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff952e72e2ca00/0x92b8e04cbf5fa733 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217164.523051:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff952e72e2ca00/0x92b8e04cbf5fa733 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217164.523078:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff952e72e2ca00/0x92b8e04cbf5fa733 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217164.523089:0:17181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217164.523125:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72dfe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1470210-3884-42c5-8d09-248d2ed946c2+19:3649:x1868789713130368:12345-0@lo:103:ldlm_bl.0 Request processed in 281us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217164.523132:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782217164.523198:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43cb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a1470210-3884-42c5-8d09-248d2ed946c2:3649:1868789713130368:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782217164.524146:0:17210:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff952e72e2ca00/0x92b8e04cbf5fa733 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217164.524158:0:17210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff952e72e2ca00/0x92b8e04cbf5fa733 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217164.524165:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e72e2ca00/0x92b8e04cbf5fa733 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217164.670277:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1782217165.229730:0:18775:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1782217165.229936:0:18775:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1782217165.692077:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782217165.949449:0:17191:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1782217165.949456:0:17191:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff952e7c65c000 from 9 10000000:01000000:3.0:1782217165.949460:0:17191:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1782217165.949505:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e41680e00/0x92b8e04cbf5fa73a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217165.949517:0:17191:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e41680e00/0x92b8e04cbf5fa73a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217165.949528:0:17191:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e41680e00/0x92b8e04cbf5fa73a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217165.949562:0:17191:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b303b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713130496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782217165.949656:0:17191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217165.949690:0:17191:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e5a16a540 going to sleep for 11 seconds 00000100:00100000:2.0:1782217165.949787:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713130496 00000100:00100000:2.0:1782217165.949795:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713130496 00000100:00100000:2.0:1782217165.949974:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1782217165.949984:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+19:17191:x1868789713130496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782217165.949997:0:17189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217165.950009:0:17189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e72e2de00/0x92b8e04cbf5fa741 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5fa73a expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217165.950032:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e72e2de00/0x92b8e04cbf5fa741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa73a expref: 20 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217165.950042:0:17189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e72e2de00/0x92b8e04cbf5fa741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa73a expref: 20 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217165.950062:0:17189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2de00, rc 0) 00000100:00100000:2.0:1782217165.950115:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+20:17191:x1868789713130496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217165.950122:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1782217165.950197:0:17191:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b303b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713130496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782217165.950211:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e41680e00/0x92b8e04cbf5fa73a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa741 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217165.950220:0:17191:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e41680e00/0x92b8e04cbf5fa73a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5fa741 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217165.950277:0:17191:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b303b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713130624:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1782217165.950306:0:17191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217165.951237:0:17191:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e5a16a540 going to sleep for 11 seconds 00000100:00100000:0.0:1782217165.951293:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713130624 00000100:00100000:0.0:1782217165.951299:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713130624 00000100:00100000:0.0:1782217165.951332:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1782217165.951339:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+20:17191:x1868789713130624:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1782217165.951357:0:17187:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1782217165.951375:0:17187:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1782217165.951377:0:17187:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1782217165.951562:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+20:17191:x1868789713130624:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 222us (1253us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217165.951569:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1782217165.953350:0:17191:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b303b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713130624:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1782217165.953430:0:17191:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1782217165.953440:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e41680e00/0x92b8e04cbf5fa73a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa741 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217165.953450:0:17191:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e41680e00/0x92b8e04cbf5fa73a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa741 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782217165.953460:0:17191:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1782217165.953462:0:17191:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff952d43f05800 from 9 10000000:01000000:3.0:1782217165.953464:0:17191:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1782217165.953494:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e41681000/0x92b8e04cbf5fa748 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217165.953501:0:17191:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e41681000/0x92b8e04cbf5fa748 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217165.953509:0:17191:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e41681000/0x92b8e04cbf5fa748 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217165.953529:0:17191:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b303b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713130752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782217165.953705:0:17191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217165.953725:0:17191:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e52b6eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1782217165.953781:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713130752 00000100:00100000:0.0:1782217165.953787:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713130752 00000100:00100000:0.0:1782217165.953836:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1782217165.953845:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+20:17191:x1868789713130752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782217165.953875:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217165.953888:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e4121ca00/0x92b8e04cbf5fa74f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5fa748 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217165.954010:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e4121ca00/0x92b8e04cbf5fa74f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa748 expref: 21 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217165.954020:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e4121ca00/0x92b8e04cbf5fa74f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa748 expref: 21 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217165.954028:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e4121ca00, rc 0) 00000100:00100000:0.0:1782217165.954060:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+21:17191:x1868789713130752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 217us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217165.954067:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1782217165.954292:0:17191:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b303b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713130752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782217165.954310:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e41681000/0x92b8e04cbf5fa748 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa74f expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217165.954318:0:17191:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e41681000/0x92b8e04cbf5fa748 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5fa74f expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217165.954356:0:17191:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b303b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713130880:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1782217165.954384:0:17191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217165.954438:0:17191:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e52b6eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1782217165.954467:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713130880 00000100:00100000:0.0:1782217165.954471:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713130880 00000100:00100000:0.0:1782217165.954529:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1782217165.954537:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+21:17191:x1868789713130880:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1782217165.954991:0:17187:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1782217165.955006:0:17187:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1782217165.955009:0:17187:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1782217165.955275:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+21:17191:x1868789713130880:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 737us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217165.955284:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1782217165.955340:0:17191:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b303b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713130880:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1782217165.955393:0:17191:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1782217165.955401:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e41681000/0x92b8e04cbf5fa748 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa74f expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217165.955410:0:17191:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e41681000/0x92b8e04cbf5fa748 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa74f expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217166.394061:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713131008:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782217166.394133:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217166.394300:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713131008 00000100:00100000:3.0:1782217166.394308:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713131008 00000100:00100000:3.0:1782217166.394362:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782217166.394370:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713131008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782217166.394403:0:17200:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1782217166.394453:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713131008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217166.394460:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782217166.394511:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713131008:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782217166.395213:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713131136:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782217166.395252:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217166.395318:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713131136 00000100:00100000:0.0:1782217166.395324:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713131136 00000100:00100000:0.0:1782217166.395366:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782217166.395370:0:17200:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1782217166.395373:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713131136:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782217166.395377:0:17200:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000004:00000024:0.0:1782217166.395395:0:17199:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1782217166.395435:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713131136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 63us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217166.395441:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782217166.395472:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713131136:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1782217166.713184:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217167.738043:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217168.763140:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217169.788694:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1782217169.980984:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782217169.981010:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782217169.981013:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782217169.981016:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782217169.981036:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782217169.981039:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782217169.981042:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782217169.981045:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1782217169.981087:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a1470210-3884-42c5-8d09-248d2ed946c2:3648:1868789713131264:0@lo:400:kworker.0 00000100:00100000:3.0:1782217169.981157:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217169.981238:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b303100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1868789713131776:0@lo:400:kworker.0 00000100:00100000:3.0:1782217169.981263:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217169.981288:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782217169.981294:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b303800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713131648:0@lo:400:kworker.0 00000100:00100000:3.0:1782217169.981317:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217169.981346:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b301180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713131392:0@lo:400:kworker.0 00000100:00100000:3.0:1782217169.981369:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217169.981387:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b300e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1868789713131904:0@lo:400:kworker.0 00000100:00100000:3.0:1782217169.981411:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217169.981426:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782217169.981432:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b301c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1868789713131520:0@lo:400:kworker.0 00000100:00100000:3.0:1782217169.981451:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217169.981464:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1868789713132032:0@lo:400:kworker.0 00000100:00100000:3.0:1782217169.981494:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217169.981522:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713131264 00000100:00100000:3.0:1782217169.981528:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713131264 00000100:00100000:3.0:1782217169.981574:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1782217169.981605:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+21:3648:x1868789713131264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217169.981657:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+21:3648:x1868789713131264:12345-0@lo:400:kworker.0 Request processed in 75us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217169.981665:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1782217169.981701:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713131776 00000100:00100000:3.0:1782217169.981704:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713131776 00000100:00100000:3.0:1782217169.981724:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713131904 00000100:00100000:3.0:1782217169.981727:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713131904 00000100:00100000:3.0:1782217169.981750:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713131520 00000100:00100000:3.0:1782217169.981752:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713131520 00000100:00100000:3.0:1782217169.981764:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713132032 00000100:00100000:3.0:1782217169.981766:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713132032 00000100:00100000:3.0:1782217169.981782:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782217169.981801:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b303480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1868789713131776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217169.981836:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b303480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1868789713131776:12345-0@lo:400:kworker.0 Request processed in 36us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217169.981843:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782217169.981856:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782217169.981862:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b301f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1868789713131904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217169.981894:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b301f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1868789713131904:12345-0@lo:400:kworker.0 Request processed in 33us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217169.981899:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782217169.981910:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782217169.981917:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b302300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1868789713131520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217169.981955:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b302300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1868789713131520:12345-0@lo:400:kworker.0 Request processed in 39us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217169.981961:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782217169.981972:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782217169.981978:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b301880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1868789713132032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217169.982003:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b301880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1868789713132032:12345-0@lo:400:kworker.0 Request processed in 26us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217169.982009:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782217169.982025:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713131648 00000100:00100000:3.0:1782217169.982029:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713131648 00000100:00100000:3.0:1782217169.982048:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713131392 00000100:00100000:3.0:1782217169.982051:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713131392 00000100:00100000:3.0:1782217169.982063:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782217169.982070:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b300380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713131648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217169.982104:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b300380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713131648:12345-0@lo:400:kworker.0 Request processed in 35us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217169.982110:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782217169.982122:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782217169.982128:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b300700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713131392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217169.982159:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b300700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713131392:12345-0@lo:400:kworker.0 Request processed in 31us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217169.982165:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1782217169.982212:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952e7b301c00 x1868789713131520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217169.982225:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b301c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1868789713131520:0@lo:400:kworker.0 00010000:00080000:3.0:1782217169.982247:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952e7b302d80 x1868789713132032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217169.982255:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1868789713132032:0@lo:400:kworker.0 00000100:00100000:3.0:1782217169.982266:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b301180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713131392:0@lo:400:kworker.0 00010000:00080000:3.0:1782217169.982275:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952e7b300e00 x1868789713131904/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217169.982282:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b300e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1868789713131904:0@lo:400:kworker.0 00000100:00100000:3.0:1782217169.982316:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b303800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713131648:0@lo:400:kworker.0 00000100:00100000:3.0:1782217169.982325:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a1470210-3884-42c5-8d09-248d2ed946c2:3648:1868789713131264:0@lo:400:kworker.0 00010000:00080000:3.0:1782217169.982334:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952e7b303100 x1868789713131776/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217169.982343:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b303100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1868789713131776:0@lo:400:kworker.0 00000100:00080000:1.0:1782217169.983059:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782217169.983066:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1782217170.106092:0:17230:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:1.0:1782217170.363196:0:19065:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1782217170.821258:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1782217171.149017:0:19118:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782217171.150470:0:19118:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1782217171.514486:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b303100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713132160:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782217171.514562:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217171.514685:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782217171.514693:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713132288:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782217171.514727:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217171.514758:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713132160 00000100:00100000:0.0:1782217171.514766:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713132160 00000100:00100000:0.0:1782217171.514820:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713132288 00000100:00100000:0.0:1782217171.514824:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713132288 00000100:00100000:0.0:1782217171.514841:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782217171.514849:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713132160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782217171.514898:0:17200:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1782217171.514946:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713132160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217171.514954:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782217171.514971:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782217171.514977:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713132288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782217171.515003:0:17200:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1782217171.515031:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713132288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 55us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217171.515037:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782217171.515082:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713132288:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782217171.515097:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b303100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713132160:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1782217171.833712:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1782217171.976904:0:19168:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782217171.977123:0:19168:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1782217172.857100:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782217173.628342:0:17948:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1782217173.883891:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217174.906087:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1782217175.099680:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782217175.099686:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782217175.099689:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782217175.099693:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782217175.099717:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782217175.099720:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782217175.099732:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782217175.099740:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1782217175.099744:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a1470210-3884-42c5-8d09-248d2ed946c2:3649:1868789713132416:0@lo:400:kworker.0 00000100:00100000:3.0:1782217175.099795:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b303800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713132544:0@lo:400:kworker.0 00000100:00100000:1.0:1782217175.099814:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217175.099822:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217175.100777:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b301180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713132800:0@lo:400:kworker.0 00000100:00100000:3.0:1782217175.103115:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b301c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1868789713133056:0@lo:400:kworker.0 00000100:00100000:2.0:1782217175.103123:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217175.103154:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217175.103161:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1782217175.103168:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b300e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1868789713132672:0@lo:400:kworker.0 00000100:00100000:3.0:1782217175.103171:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782217175.103176:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1868789713132928:0@lo:400:kworker.0 00000100:00100000:2.0:1782217175.103189:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217175.103208:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713132544 00000100:00100000:2.0:1782217175.103213:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b302680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1868789713133184:0@lo:400:kworker.0 00000100:00100000:3.0:1782217175.103214:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713132544 00000100:00100000:2.0:1782217175.103232:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217175.103263:0:18842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713132800 00000100:00100000:2.0:1782217175.103267:0:18842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713132800 00000100:00100000:3.0:1782217175.103268:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782217175.103275:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b300a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713132544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217175.103284:0:18842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1782217175.103289:0:18842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713132800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217175.103324:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b300a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713132544:12345-0@lo:400:kworker.0 Request processed in 48us (3500us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217175.103324:0:18842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713132800:12345-0@lo:400:kworker.0 Request processed in 34us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217175.103331:0:18842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1782217175.103368:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b301180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713132800:0@lo:400:kworker.0 00000100:00100000:1.0:1782217175.103443:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713132416 00000100:00100000:1.0:1782217175.103453:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713132416 00000100:00100000:1.0:1782217175.103523:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1782217175.103530:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c619050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+21:3649:x1868789713132416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217175.103566:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c619050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+21:3649:x1868789713132416:12345-0@lo:400:kworker.0 Request processed in 38us (3752us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217175.103572:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1782217175.103741:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b303b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a1470210-3884-42c5-8d09-248d2ed946c2:3649:1868789713132416:0@lo:400:kworker.0 00000100:00100000:2.0:1782217175.104656:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713133056 00000100:00100000:2.0:1782217175.104672:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713133056 00000100:00100000:2.0:1782217175.104711:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713132672 00000100:00100000:2.0:1782217175.104714:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713132672 00000100:00100000:2.0:1782217175.104725:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713133184 00000100:00100000:2.0:1782217175.104728:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713133184 00000100:00100000:2.0:1782217175.104742:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782217175.104773:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b302a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1868789713133056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217175.104837:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b302a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1868789713133056:12345-0@lo:400:kworker.0 Request processed in 77us (1671us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217175.104844:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782217175.104858:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1782217175.104865:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1868789713132672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217175.104876:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782217175.104896:0:17195:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1782217175.104897:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1868789713132672:12345-0@lo:400:kworker.0 Request processed in 33us (1707us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217175.104903:0:17195:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1782217175.104903:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1782217175.104912:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782217175.104918:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1868789713133184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217175.104945:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1868789713133184:12345-0@lo:400:kworker.0 Request processed in 27us (1711us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217175.104950:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1782217175.104982:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952e7b300e00 x1868789713132672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217175.105011:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217175.105045:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b303800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713132544:0@lo:400:kworker.0 00010000:00080000:3.0:1782217175.105057:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952e7b301c00 x1868789713133056/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217175.105065:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b301c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1868789713133056:0@lo:400:kworker.0 00000100:00100000:3.0:1782217175.105102:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713132928 00000100:00100000:3.0:1782217175.105105:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713132928 00000100:00100000:3.0:1782217175.105129:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782217175.105134:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b303b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1868789713132928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217175.105176:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b303b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1868789713132928:12345-0@lo:400:kworker.0 Request processed in 42us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217175.105182:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1782217175.105207:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952e7b302d80 x1868789713132928/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217175.105216:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1868789713132928:0@lo:400:kworker.0 00000100:00100000:2.0:1782217175.105397:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b300e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1868789713132672:0@lo:400:kworker.0 00010000:00080000:2.0:1782217175.105413:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952e7b302680 x1868789713133184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782217175.105433:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b302680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1868789713133184:0@lo:400:kworker.0 00000100:00080000:1.0:1782217175.105781:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782217175.105786:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782217175.931573:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782217176.633110:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782217176.633134:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713133312:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782217176.633205:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217176.633300:0:18842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713133312 00000100:00100000:1.0:1782217176.633307:0:18842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713133312 00000100:00100000:1.0:1782217176.633363:0:18842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782217176.633372:0:18842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713133312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782217176.633405:0:18842:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1782217176.633466:0:18842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713133312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217176.633479:0:18842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782217176.633528:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713133312:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782217176.633771:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713133440:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782217176.633799:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217176.636468:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713133440 00000100:00100000:3.0:1782217176.636483:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713133440 00000100:00100000:3.0:1782217176.636549:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1782217176.636559:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4441f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713133440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782217176.636630:0:17199:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1782217176.636708:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4441f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713133440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 150us (2908us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217176.636716:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1782217176.636816:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713133440:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782217176.761904:0:3646:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782217161/real 1782217161] req@ffff952e46da5500 x1868789713125632/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782217176 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217176.761934:0:3646:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff952e46da5500 x1868789713125632/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782217176 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217176.761945:0:3646:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782217161/real 1782217161] req@ffff952e46da7100 x1868789713125760/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782217176 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217176.761956:0:3646:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff952e46da7100 x1868789713125760/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782217176 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1782217176.761975:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952d43666800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782217176.761996:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1782217176.762006:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1868789713125632:0@lo:8:kworker.0 00000100:00080000:3.0:1782217176.762012:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952d42002000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782217176.762017:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1782217176.762020:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1868789713125760:0@lo:8:kworker.0 00000100:00080000:1.0:1782217176.762327:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782217176.762332:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1782217176.762334:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782217176.762337:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1782217176.762365:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782217176.762368:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1782217176.762371:0:8:0:(import.c:65:import_set_state_nolock()) ffff952d43666800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782217176.762376:0:8:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 524 00000100:00080000:1.0:1782217176.762381:0:8:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1782217176.762387:0:8:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff952d43666800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1782217176.762405:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff952d4441dc00 x1868789713133824/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782217176.762453:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a1470210-3884-42c5-8d09-248d2ed946c2:3650:1868789713133568:0@lo:400:kworker.0 00000100:00100000:0.0:1782217176.762513:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217176.762565:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713133568 00000100:00100000:0.0:1782217176.762573:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713133568 00000100:00100000:0.0:1782217176.762630:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1782217176.762639:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c619450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+21:3650:x1868789713133568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217176.762686:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c619450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+21:3650:x1868789713133568:12345-0@lo:400:kworker.0 Request processed in 48us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217176.762693:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1782217176.762748:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a1470210-3884-42c5-8d09-248d2ed946c2:3650:1868789713133568:0@lo:400:kworker.0 00000100:00100000:0.0:1782217176.762778:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1868789713133696:0@lo:400:kworker.0 00000100:00100000:0.0:1782217176.762805:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217176.762841:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713133696 00000100:00100000:0.0:1782217176.762846:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713133696 00000100:00100000:0.0:1782217176.762878:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782217176.762884:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1868789713133696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217176.762919:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1868789713133696:12345-0@lo:400:kworker.0 Request processed in 35us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217176.762926:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1782217176.762951:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952d4441ed80 x1868789713133696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782217176.762962:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1868789713133696:0@lo:400:kworker.0 00000100:00080000:1.0:1782217176.763417:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782217176.763422:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1782217176.763424:0:8:0:(import.c:65:import_set_state_nolock()) ffff952d42002000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782217176.763429:0:8:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 524 00000100:00080000:1.0:1782217176.763433:0:8:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1782217176.763436:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff952d42002000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1782217176.763473:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff952e46da4000 x1868789713133952/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782217176.763520:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1868789713134080:0@lo:400:kworker.0 00000100:00100000:0.0:1782217176.763539:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1868789713134208:0@lo:400:kworker.0 00000100:00100000:1.0:1782217176.763556:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217176.763564:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1868789713134336:0@lo:400:kworker.0 00000100:00100000:1.0:1782217176.763610:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713134080 00000100:00100000:1.0:1782217176.763614:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713134080 00000100:00100000:1.0:1782217176.763640:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1782217176.763645:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4441df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1868789713134080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217176.763682:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4441df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1868789713134080:12345-0@lo:400:kworker.0 Request processed in 36us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217176.763688:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1782217176.763715:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952e46da4700 x1868789713134080/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782217176.763746:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1868789713133824:0@lo:8:kworker.0 00000100:00100000:1.0:1782217176.763747:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1868789713134080:0@lo:400:kworker.0 00000100:00100000:1.0:1782217176.763767:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217176.763778:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217176.763792:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713134208 00000100:00100000:1.0:1782217176.763795:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713134208 00000100:00100000:2.0:1782217176.763797:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1868789713133952:0@lo:8:kworker.0 00000100:00100000:1.0:1782217176.763817:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1782217176.763820:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217176.763822:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4441ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1868789713134208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217176.763857:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4441ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1868789713134208:12345-0@lo:400:kworker.0 Request processed in 34us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217176.763863:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1782217176.763865:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952e46da5f80 x1868789713134208/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217176.763940:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713133824 00000100:00100000:3.0:1782217176.763945:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713133824 00000100:00100000:2.0:1782217176.763999:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1868789713134208:0@lo:400:kworker.0 00000100:00100000:3.0:1782217176.764001:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713133952 00000100:00100000:3.0:1782217176.764004:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713133952 00000100:00100000:1.0:1782217176.764039:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782217176.764044:0:18702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3646:x1868789713133824:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1782217176.764066:0:18702:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 539 last 0 00000020:00000080:1.0:1782217176.764088:0:18702:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x92b8e04cbf5fa756 00002000:00100000:1.0:1782217176.764101:0:18702:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff952e5892c800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1782217176.764105:0:18702:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1782217176.764107:0:18702:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1782217176.764257:0:18702:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1782217176.764277:0:18702:0:(import.c:65:import_set_state_nolock()) ffff952e5892b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782217176.764316:0:18702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3646:x1868789713133824:12345-0@lo:8:kworker.0 Request processed in 270us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217176.764323:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782217176.764335:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782217176.764339:0:18702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3646:x1868789713133952:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1782217176.764350:0:18702:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1782217176.764501:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1782217176.766711:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952d4441dc00 x1868789713133824/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782217196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782217176.766727:0:3646:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782217176.766747:0:3646:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1782217176.766755:0:3646:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1782217176.766760:0:3646:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1782217176.766763:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952d43666800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1782217176.766777:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1782217176.766784:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1868789713133824:0@lo:8:kworker.0 00000100:00100000:2.0:1782217176.766864:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713134336 00000100:00100000:2.0:1782217176.766970:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713134336 00000100:00100000:2.0:1782217176.767056:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782217176.767067:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1868789713134336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217176.767152:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1868789713134336:12345-0@lo:400:kworker.0 Request processed in 87us (2650us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217176.767160:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1782217176.767282:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952e46da6680 x1868789713134336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782217176.767294:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1868789713134336:0@lo:400:kworker.0 00000004:00080000:3.0:1782217176.767303:0:17936:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1782217176.767326:0:17936:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b303800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17936:1868789713134592:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1782217176.767360:0:17936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217176.767383:0:17936:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e64ef2600 going to sleep for 11 seconds 00000100:00100000:2.0:1782217176.767397:0:18700:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000004:00080000:3.0:1782217176.767398:0:17935:0:(osp_sync.c:1060:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1782217176.767402:0:18700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000004:00080000:3.0:1782217176.767477:0:17935:0:(osp_sync.c:1862:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 539750893068ns, next at 0ns, rc = 0 00080000:00080000:3.0:1782217176.767483:0:17935:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1782217176.767503:0:18701:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1782217176.767511:0:18701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713134592 00000100:00100000:3.0:1782217176.767514:0:18701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713134592 00000100:00100000:2.0:1782217176.767574:0:19412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782217176.767600:0:19412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b301180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17936:x1868789713134592:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1782217176.771034:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782217176.771068:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b301c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713134464:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782217176.771134:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217176.771260:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713134464 00000100:00100000:2.0:1782217176.771267:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713134464 00000100:00100000:2.0:1782217176.771309:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782217176.771319:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3648:x1868789713134464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782217176.771351:0:18704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1782217176.771394:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3648:x1868789713134464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217176.771401:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1782217176.771451:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952e7b301c00 x1868789713134464/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782217192 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782217176.771471:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b301c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713134464:0@lo:13:osp-pre-0-1.0 00000004:00080000:0.0:1782217176.773823:0:17927:0:(osp_sync.c:1827:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:3.0:1782217176.774465:0:19412:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1782217176.774471:0:19412:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1782217176.774556:0:19412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b301180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17936:x1868789713134592:12345-0@lo:7:osp-pre-0-1.0 Request processed in 6971us (7190us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217176.774566:0:19412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1782217176.774668:0:17936:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952e7b303800 x1868789713134592/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1782217192 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782217176.774682:0:17936:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b303800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17936:1868789713134592:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1782217176.774694:0:17936:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:0.0:1782217176.774730:0:17936:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17936:1868789713134720:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1782217176.774777:0:17936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217176.774839:0:17936:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e6fad8900 going to sleep for 11 seconds 00000100:00100000:3.0:1782217176.775894:0:18701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713134720 00000100:00100000:3.0:1782217176.775904:0:18701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713134720 00000100:00100000:3.0:1782217176.775954:0:18701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782217176.775964:0:18701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17936:x1868789713134720:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1782217176.775991:0:18701:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1782217176.776046:0:18701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17936:x1868789713134720:12345-0@lo:5:osp-pre-0-1.0 Request processed in 82us (1267us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217176.776052:0:18701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1782217176.776124:0:17936:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952e46da4700 x1868789713134720/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782217192 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782217176.776137:0:17936:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17936:1868789713134720:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1782217176.776147:0:17936:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1782217176.776177:0:17936:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17936:1868789713134848:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1782217176.776204:0:17936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217176.776226:0:17936:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e6fad8900 going to sleep for 11 seconds 00000100:00100000:3.0:1782217176.776267:0:19412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713134848 00000100:00100000:3.0:1782217176.776272:0:19412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713134848 00000100:00100000:3.0:1782217176.776331:0:19412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782217176.776338:0:19412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17936:x1868789713134848:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1782217176.776361:0:19412:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00080000:1.0:1782217176.777638:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782217176.777701:0:18702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3646:x1868789713133952:12345-0@lo:8:kworker.0 Request processed in 13357us (13876us total) trans 0 rc -19/-19 00000100:00100000:1.0:1782217176.777710:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1782217176.777763:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952d42002000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782217176.777769:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1782217176.777773:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1868789713133952:0@lo:8:kworker.0 00000001:00080000:0.0:1782217176.801251:0:18697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1782217176.801266:0:18697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1782217176.801499:0:19412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17936:x1868789713134848:12345-0@lo:5:osp-pre-0-1.0 Request processed in 25156us (25288us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1782217176.801510:0:19412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1782217176.804960:0:17936:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952e46da4700 x1868789713134848/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782217192 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782217176.804975:0:17936:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1782217176.804982:0:17936:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17936:1868789713134848:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1782217176.804997:0:17936:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:1.0:1782217176.805112:0:17936:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17936:1868789713134976:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1782217176.805170:0:17936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217176.805208:0:17936:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43d1c480 going to sleep for 11 seconds 00000100:00100000:0.0:1782217176.805355:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713134976 00000100:00100000:0.0:1782217176.805362:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713134976 00000100:00100000:0.0:1782217176.805415:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782217176.805430:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4441d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17936:x1868789713134976:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1782217176.805495:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4441d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17936:x1868789713134976:12345-0@lo:900:osp-pre-0-1.0 Request processed in 66us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217176.805502:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1782217176.805810:0:17936:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952d4441ce00 x1868789713134976/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1782217192 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782217176.805832:0:17936:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17936:1868789713134976:0@lo:900:osp-pre-0-1.0 00010000:00010000:3.0:1782217176.958023:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217177.977720:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1782217178.593910:0:19515:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1782217178.593914:0:19515:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1782217178.593916:0:19515:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1782217178.594054:0:19515:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff952d430ff000 00000020:01000004:1.0:1782217178.594077:0:19515:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1782217178.594092:0:19515:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1782217178.594105:0:19515:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff952e46dbcd40) 00000020:00000080:1.0:1782217178.594122:0:19515:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1782217178.653798:0:19515:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1782217178.654750:0:19515:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1782217178.655127:0:19515:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1782217178.655669:0:19515:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1782217178.656145:0:19515:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1782217178.657541:0:19515:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1782217178.657945:0:19515:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:2.0:1782217178.660533:0:19515:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1782217178.660936:0:19515:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1782217178.660949:0:19515:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1782217178.660960:0:19515:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x92b8e04cbf5fa764 00000020:01000004:2.0:1782217178.660965:0:19515:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1782217178.660985:0:19515:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.130@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1782217178.660988:0:19515:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1782217178.660993:0:19515:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1782217178.661024:0:19515:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1782217178.661028:0:19515:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.130@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1782217178.680656:0:19515:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.130@tcp ctxt 0 is initialized 00000020:01000004:3.0:1782217178.680707:0:19515:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.130@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1782217178.680712:0:19515:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1782217178.680714:0:19515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782217178.680715:0:19515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782217178.680716:0:19515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782217178.680717:0:19515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782217178.680718:0:19515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782217178.680720:0:19515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782217178.680728:0:19515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782217178.680730:0:19515:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782217178.680733:0:19515:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1782217178.680736:0:19515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782217178.680737:0:19515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782217178.680738:0:19515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782217178.680739:0:19515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782217178.680740:0:19515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782217178.680741:0:19515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782217178.680742:0:19515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782217178.680743:0:19515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782217178.680743:0:19515:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782217178.680774:0:19515:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1782217178.680793:0:19515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b303100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:19515:1868789713135104:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1782217178.680868:0:19515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217178.680908:0:19515:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e64ef2e40 going to sleep for 11 seconds 00000100:00100000:1.0:1782217178.681250:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713135104 00000100:00100000:1.0:1782217178.681258:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713135104 00000100:00100000:1.0:1782217178.681313:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1782217178.681322:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c61a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+21:19515:x1868789713135104:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1782217178.681354:0:17187:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1782217178.681364:0:17187:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1782217178.681367:0:17187:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1782217178.682390:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c61a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+21:19515:x1868789713135104:12345-0@lo:253:mount.lustre.0 Request processed in 1064us (1517us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217178.682402:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1782217178.682501:0:19515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b303100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:19515:1868789713135104:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1782217178.682513:0:19515:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1782217178.682516:0:19515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782217178.682518:0:19515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782217178.682519:0:19515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782217178.682520:0:19515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782217178.682521:0:19515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782217178.682522:0:19515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782217178.682524:0:19515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782217178.682525:0:19515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782217178.682526:0:19515:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1782217178.682547:0:19515:0:(tgt_mount.c:101:server_register_mount()) register mount ffff952d430ff000 from lustre-OST0001 10000000:01000000:3.0:1782217178.682576:0:19515:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1782217178.682578:0:19515:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1782217178.682619:0:19515:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff952e7dbdb380 local copy 00010000:00010000:3.0:1782217178.682631:0:19515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e41681800/0x92b8e04cbf5fa47e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa485 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217178.682749:0:19515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b303100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:19515:1868789713135232:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782217178.682785:0:19515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217178.682809:0:19515:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e64ef2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782217178.682865:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713135232 00000100:00100000:0.0:1782217178.682871:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713135232 00000100:00100000:0.0:1782217178.682909:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1782217178.682917:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c61b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+21:19515:x1868789713135232:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782217178.682989:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c61b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+21:19515:x1868789713135232:12345-0@lo:501:mount.lustre.0 Request processed in 73us (203us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782217178.682996:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1782217178.683075:0:19515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b303100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:19515:1868789713135232:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1782217178.683087:0:19515:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1782217178.683105:0:19515:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1782217178.683111:0:19515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e41681800/0x92b8e04cbf5fa47e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa485 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217178.683119:0:19515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e41681800/0x92b8e04cbf5fa47e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa485 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782217178.683143:0:19515:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff952d430ff000 10000000:01000000:1.0:1782217178.683149:0:19515:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1782217178.683154:0:19515:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1782217178.683157:0:19515:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782217178.683161:0:19515:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1782217178.683163:0:19515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1782217178.683185:0:19515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952d43073a00/0x92b8e04cbf5fa76b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217178.683193:0:19515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952d43073a00/0x92b8e04cbf5fa76b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217178.683213:0:19515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952d43073a00/0x92b8e04cbf5fa76b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217178.683225:0:19515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:19515:1868789713135360:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782217178.683258:0:19515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217178.683279:0:19515:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e7c722900 going to sleep for 11 seconds 00000100:00100000:0.0:1782217178.683397:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713135360 00000100:00100000:0.0:1782217178.683401:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713135360 00000100:00100000:0.0:1782217178.683434:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1782217178.683441:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c619c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+21:19515:x1868789713135360:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782217178.683450:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217178.683462:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e4121c600/0x92b8e04cbf5fa772 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5fa76b expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217178.683482:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e4121c600/0x92b8e04cbf5fa772 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa76b expref: 22 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217178.683493:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e4121c600/0x92b8e04cbf5fa772 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa76b expref: 22 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217178.683501:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e4121c600, rc 0) 00000100:00100000:0.0:1782217178.683540:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c619c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+22:19515:x1868789713135360:12345-0@lo:101:mount.lustre.0 Request processed in 99us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217178.683555:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1782217178.683655:0:19515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:19515:1868789713135360:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782217178.683668:0:19515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952d43073a00/0x92b8e04cbf5fa76b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa772 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217178.683676:0:19515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952d43073a00/0x92b8e04cbf5fa76b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5fa772 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782217178.688136:0:19515:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1782217178.688948:0:19515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782217178.693976:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1782217178.694042:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1782217178.694059:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1782217178.694072:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1782217178.694084:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1782217178.694095:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1782217178.694121:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1782217178.694128:0:19515:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1782217178.694695:0:19515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:19515:1868789713135488:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782217178.694771:0:19515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217178.694874:0:19515:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e7c7226c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782217178.698695:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713135488 00000100:00100000:0.0:1782217178.698709:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713135488 00000100:00100000:0.0:1782217178.698914:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1782217178.698924:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c61ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+22:19515:x1868789713135488:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782217178.699122:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c61ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+22:19515:x1868789713135488:12345-0@lo:501:mount.lustre.0 Request processed in 199us (4350us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217178.699130:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1782217178.699223:0:19515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:19515:1868789713135488:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782217178.699272:0:19515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:19515:1868789713135616:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782217178.699328:0:19515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217178.710603:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713135616 00000100:00100000:3.0:1782217178.710617:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713135616 00000100:00100000:3.0:1782217178.710956:0:19515:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e7c7226c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782217178.715856:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1782217178.715871:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c61a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+22:19515:x1868789713135616:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782217178.716719:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c61a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+22:19515:x1868789713135616:12345-0@lo:503:mount.lustre.0 Request processed in 848us (17386us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217178.716738:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1782217178.716865:0:19515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:19515:1868789713135616:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1782217178.717273:0:19515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782217178.717356:0:19515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:19515:1868789713135744:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782217178.717406:0:19515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217178.717442:0:19515:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e7c722900 going to sleep for 11 seconds 00000100:00100000:0.0:1782217178.717786:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713135744 00000100:00100000:0.0:1782217178.717793:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713135744 00000100:00100000:0.0:1782217178.717841:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1782217178.717848:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+22:19515:x1868789713135744:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782217178.718322:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+22:19515:x1868789713135744:12345-0@lo:502:mount.lustre.0 Request processed in 472us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217178.718329:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1782217178.718414:0:19515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:19515:1868789713135744:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782217178.718617:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1782217178.718646:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1782217178.718661:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1782217178.718673:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1782217178.718686:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1782217178.718698:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1782217178.718739:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1782217178.718756:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1782217178.718770:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1782217178.718796:0:19515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:19515:1868789713135872:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782217178.718848:0:19515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217178.718872:0:19515:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e7c722900 going to sleep for 11 seconds 00000100:00100000:0.0:1782217178.719621:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713135872 00000100:00100000:0.0:1782217178.719629:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713135872 00000100:00100000:0.0:1782217178.719674:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1782217178.719683:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c61a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+22:19515:x1868789713135872:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782217178.719946:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c61a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+22:19515:x1868789713135872:12345-0@lo:502:mount.lustre.0 Request processed in 263us (1097us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217178.719960:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1782217178.724777:0:19515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:19515:1868789713135872:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782217178.725109:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1782217178.725122:0:19515:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:0.0:1782217178.728996:0:19519:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1782217178.729010:0:19519:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1782217178.729019:0:19519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782217178.729021:0:19519:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1782217178.729032:0:19519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1782217178.729052:0:19519:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff952e64e18000) 00000020:00000080:0.0:1782217178.729081:0:19519:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:0.0:1782217178.729087:0:19519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1782217178.729181:0:19519:0:(tgt_mount.c:153:server_get_mount()) get mount ffff952d430ff000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1782217178.729189:0:19519:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1782217178.729196:0:19519:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x92b8e04cbf5fa780 00010000:00010000:1.0:1782217178.739235:0:19519:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1782217178.743407:0:19519:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:1.0:1782217178.745025:0:19519:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1782217178.759337:0:19519:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1782217178.759350:0:19519:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782217178.759357:0:19519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782217178.759359:0:19519:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1782217178.759363:0:19519:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782217178.759367:0:19519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782217178.759368:0:19519:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1782217178.759372:0:19519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782217178.759374:0:19519:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1782217178.759376:0:19519:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782217178.759378:0:19519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782217178.759379:0:19519:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:0.0:1782217178.759381:0:19519:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782217178.759384:0:19519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782217178.759385:0:19519:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1782217178.759389:0:19519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1782217178.759416:0:19519:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782217178.759419:0:19519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782217178.759420:0:19519:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1782217178.759423:0:19519:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1782217178.761012:0:19515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1782217178.761058:0:19515:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1782217178.761086:0:19515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952d43073a00/0x92b8e04cbf5fa76b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa772 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217178.761097:0:19515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952d43073a00/0x92b8e04cbf5fa76b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa772 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782217178.761105:0:19515:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff952d430ff000 from 1 10000000:01000000:3.0:1782217178.761108:0:19515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782217178.761150:0:19515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e41680800/0x92b8e04cbf5fa787 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217178.761159:0:19515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e41680800/0x92b8e04cbf5fa787 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217178.761170:0:19515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e41680800/0x92b8e04cbf5fa787 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217178.761194:0:19515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b303100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:19515:1868789713136000:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782217178.761260:0:19515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217178.761304:0:19515:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e64ef2240 going to sleep for 11 seconds 00000100:00100000:1.0:1782217178.761387:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713136000 00000100:00100000:1.0:1782217178.761394:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713136000 00000100:00100000:1.0:1782217178.761450:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1782217178.761460:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c61bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+22:19515:x1868789713136000:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782217178.761473:0:17189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217178.761485:0:17189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952d43073800/0x92b8e04cbf5fa78e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5fa787 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217178.761510:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952d43073800/0x92b8e04cbf5fa78e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa787 expref: 23 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217178.761533:0:17189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952d43073800/0x92b8e04cbf5fa78e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa787 expref: 23 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217178.761542:0:17189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43073800, rc 0) 00000100:00100000:1.0:1782217178.761604:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c61bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+23:19515:x1868789713136000:12345-0@lo:101:mount.lustre.0 Request processed in 123us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217178.761612:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1782217178.761719:0:19515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b303100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:19515:1868789713136000:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782217178.761745:0:19515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e41680800/0x92b8e04cbf5fa787 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa78e expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217178.761755:0:19515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e41680800/0x92b8e04cbf5fa787 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5fa78e expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782217178.763137:0:19515:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1782217178.763457:0:19515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782217178.765109:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1782217178.765164:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1782217178.765187:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1782217178.765192:0:19515:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1782217178.765288:0:19515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b303100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:19515:1868789713136128:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782217178.765348:0:19515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217178.765393:0:19515:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e64ef2180 going to sleep for 11 seconds 00000100:00100000:2.0:1782217178.765618:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713136128 00000100:00100000:2.0:1782217178.765625:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713136128 00000100:00100000:2.0:1782217178.765682:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1782217178.765691:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+23:19515:x1868789713136128:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782217178.766038:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+23:19515:x1868789713136128:12345-0@lo:501:mount.lustre.0 Request processed in 347us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217178.766046:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1782217178.766655:0:19515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b303100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:19515:1868789713136128:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782217178.766703:0:19515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:19515:1868789713136256:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782217178.766767:0:19515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217178.766809:0:19515:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e7c722300 going to sleep for 11 seconds 00000100:00100000:2.0:1782217178.766949:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713136256 00000100:00100000:2.0:1782217178.766955:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713136256 00000100:00100000:2.0:1782217178.766997:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1782217178.767005:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c61b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+23:19515:x1868789713136256:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782217178.767086:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c61b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+23:19515:x1868789713136256:12345-0@lo:503:mount.lustre.0 Request processed in 81us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217178.767094:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1782217178.767979:0:19515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:19515:1868789713136256:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1782217178.768343:0:19515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782217178.768424:0:19515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:19515:1868789713136384:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782217178.768471:0:19515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217178.768505:0:19515:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e7c722300 going to sleep for 11 seconds 00000100:00100000:2.0:1782217178.768685:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713136384 00000100:00100000:2.0:1782217178.768691:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713136384 00000100:00100000:2.0:1782217178.768734:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1782217178.768742:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c618050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+23:19515:x1868789713136384:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782217178.768839:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c618050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+23:19515:x1868789713136384:12345-0@lo:502:mount.lustre.0 Request processed in 96us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217178.768846:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1782217178.768935:0:19515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:19515:1868789713136384:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782217178.769094:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1782217178.769116:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1782217178.769126:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1782217178.769136:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1782217178.769146:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1782217178.769157:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1782217178.769167:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1782217178.769177:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1782217178.769194:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1782217178.769205:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1782217178.769215:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1782217178.769247:0:19515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:19515:1868789713136512:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782217178.769280:0:19515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217178.769297:0:19515:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e7c722300 going to sleep for 11 seconds 00000100:00100000:3.0:1782217178.769350:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713136512 00000100:00100000:3.0:1782217178.769355:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713136512 00000100:00100000:3.0:1782217178.769386:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1782217178.769394:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c61b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+23:19515:x1868789713136512:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782217178.769483:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c61b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+23:19515:x1868789713136512:12345-0@lo:502:mount.lustre.0 Request processed in 90us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217178.769490:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1782217178.771744:0:19515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:19515:1868789713136512:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1782217178.771849:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1782217178.771863:0:19515:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1782217178.773230:0:19523:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782217178.773241:0:19523:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782217178.773244:0:19523:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1782217178.773250:0:19523:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff952d430ff000 00000020:00000080:3.0:1782217178.773253:0:19523:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1782217178.773261:0:19523:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782217178.773264:0:19523:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782217178.773265:0:19523:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1782217178.773268:0:19523:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782217178.773270:0:19523:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782217178.773271:0:19523:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1782217178.773275:0:19523:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff952d430ff000 00000020:00000080:3.0:1782217178.773277:0:19523:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1782217178.773333:0:19523:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782217178.773336:0:19523:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782217178.773338:0:19523:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1782217178.773347:0:19523:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782217178.773350:0:19523:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782217178.773351:0:19523:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1782217178.773354:0:19523:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff952d430ff000 00000020:00000080:3.0:1782217178.773356:0:19523:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1782217178.773374:0:19523:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782217178.773377:0:19523:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782217178.773378:0:19523:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1782217178.773380:0:19523:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782217178.773383:0:19523:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782217178.773384:0:19523:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1782217178.773387:0:19523:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff952d430ff000 00000020:00000080:3.0:1782217178.773388:0:19523:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1782217178.773410:0:19523:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782217178.773413:0:19523:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782217178.773414:0:19523:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1782217178.773418:0:19523:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1782217178.775921:0:19515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1782217178.775967:0:19515:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782217178.775992:0:19515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e41680800/0x92b8e04cbf5fa787 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa78e expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217178.776005:0:19515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e41680800/0x92b8e04cbf5fa787 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa78e expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782217178.776062:0:19515:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1782217178.776065:0:19515:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff952d430ff000 10000000:01000000:0.0:1782217178.776069:0:19515:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff952d430ff000 10000000:01000000:0.0:1782217178.776073:0:19515:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1782217178.776078:0:19515:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff952d430ff000 from 1 10000000:01000000:0.0:1782217178.776081:0:19515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1782217178.776119:0:19515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e4121da00/0x92b8e04cbf5fa795 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217178.776127:0:19515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e4121da00/0x92b8e04cbf5fa795 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217178.776140:0:19515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e4121da00/0x92b8e04cbf5fa795 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217178.776164:0:19515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:19515:1868789713136640:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1782217178.776229:0:19515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217178.776269:0:19515:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d437873c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782217178.781831:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713136640 00000100:00100000:2.0:1782217178.781861:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713136640 00000100:00100000:2.0:1782217178.781930:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1782217178.781940:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c618850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+23:19515:x1868789713136640:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782217178.781955:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217178.781971:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e72e2c400/0x92b8e04cbf5fa79c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5fa795 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217178.781998:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e72e2c400/0x92b8e04cbf5fa79c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa795 expref: 24 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217178.782009:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e72e2c400/0x92b8e04cbf5fa79c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa795 expref: 24 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217178.782017:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2c400, rc 0) 00000100:00100000:2.0:1782217178.782090:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c618850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+24:19515:x1868789713136640:12345-0@lo:101:mount.lustre.0 Request processed in 152us (5860us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217178.782097:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1782217178.782405:0:19515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:19515:1868789713136640:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782217178.782425:0:19515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e4121da00/0x92b8e04cbf5fa795 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa79c expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217178.782446:0:19515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e4121da00/0x92b8e04cbf5fa795 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5fa79c expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782217178.792090:0:19515:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:0.0:1782217178.792384:0:19515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782217178.793387:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1782217178.793431:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1782217178.793450:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1782217178.793466:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1782217178.793481:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1782217178.793495:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1782217178.793506:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1782217178.793519:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1782217178.793534:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1782217178.793550:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1782217178.793569:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1782217178.793858:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1782217178.793882:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1782217178.793897:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1782217178.793909:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1782217178.793923:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1782217178.793936:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1782217178.793950:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1782217178.793963:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1782217178.793978:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1782217178.793991:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1782217178.794002:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1782217178.794013:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1782217178.794024:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1782217178.794034:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1782217178.794044:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1782217178.794063:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1782217178.794074:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1782217178.794084:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1782217178.794094:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1782217178.794104:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1782217178.794114:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1782217178.794124:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1782217178.794134:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1782217178.794156:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1782217178.794167:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1782217178.794177:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1782217178.794187:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1782217178.794197:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:0.0:1782217178.794207:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:0.0:1782217178.794217:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:0.0:1782217178.794227:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:0.0:1782217178.794237:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:0.0:1782217178.794247:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:0.0:1782217178.794257:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:0.0:1782217178.794267:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:0.0:1782217178.794285:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:0.0:1782217178.794289:0:19515:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:0.0:1782217178.794382:0:19515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:19515:1868789713136768:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782217178.794447:0:19515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217178.794533:0:19515:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d426ccf00 going to sleep for 11 seconds 00000100:00100000:2.0:1782217178.801178:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713136768 00000100:00100000:2.0:1782217178.801196:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713136768 00000100:00100000:1.0:1782217178.802630:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1782217178.802644:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e47e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+24:19515:x1868789713136768:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782217178.802898:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e47e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+24:19515:x1868789713136768:12345-0@lo:501:mount.lustre.0 Request processed in 258us (8450us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217178.802906:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1782217178.803028:0:19515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:19515:1868789713136768:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782217178.803076:0:19515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:19515:1868789713136896:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782217178.803120:0:19515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217178.803157:0:19515:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d426ccf00 going to sleep for 11 seconds 00000100:00100000:1.0:1782217178.803220:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713136896 00000100:00100000:1.0:1782217178.803226:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713136896 00000100:00100000:1.0:1782217178.803260:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1782217178.803267:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e47e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+24:19515:x1868789713136896:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782217178.803344:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e47e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+24:19515:x1868789713136896:12345-0@lo:503:mount.lustre.0 Request processed in 77us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217178.803350:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1782217178.803418:0:19515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:19515:1868789713136896:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1782217178.803878:0:19515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782217178.803953:0:19515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:19515:1868789713137024:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782217178.803991:0:19515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217178.804015:0:19515:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d426ccf00 going to sleep for 11 seconds 00000100:00100000:0.0:1782217178.804030:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713137024 00000100:00100000:0.0:1782217178.804034:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713137024 00000100:00100000:0.0:1782217178.804060:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1782217178.804067:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72df9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+24:19515:x1868789713137024:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782217178.804148:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72df9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+24:19515:x1868789713137024:12345-0@lo:502:mount.lustre.0 Request processed in 80us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217178.804155:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1782217178.804199:0:19515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:19515:1868789713137024:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1782217178.804372:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1782217178.804404:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1782217178.804421:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1782217178.804438:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1782217178.804456:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1782217178.804472:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1782217178.804487:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1782217178.804502:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1782217178.804515:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1782217178.804530:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1782217178.804544:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1782217178.804558:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1782217178.804572:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1782217178.804612:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1782217178.804628:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1782217178.804642:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1782217178.804676:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1782217178.804695:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1782217178.804711:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1782217178.804738:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1782217178.804754:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1782217178.804767:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1782217178.804780:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1782217178.804792:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1782217178.804806:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1782217178.804818:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1782217178.804830:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1782217178.804842:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1782217178.804855:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1782217178.804869:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1782217178.804881:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1782217178.804894:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1782217178.804919:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1782217178.804935:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1782217178.804947:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1782217178.804959:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1782217178.804971:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1782217178.804982:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1782217178.804993:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1782217178.805004:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1782217178.805016:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1782217178.805028:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1782217178.805038:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1782217178.805050:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1782217178.805062:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1782217178.805075:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1782217178.805088:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1782217178.805100:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1782217178.805148:0:19515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:19515:1868789713137152:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782217178.805199:0:19515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217178.805229:0:19515:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d426ccf00 going to sleep for 11 seconds 00000100:00100000:0.0:1782217178.805251:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713137152 00000100:00100000:0.0:1782217178.805255:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713137152 00000100:00100000:0.0:1782217178.805288:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1782217178.805296:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72dfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+24:19515:x1868789713137152:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782217178.805379:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72dfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+24:19515:x1868789713137152:12345-0@lo:502:mount.lustre.0 Request processed in 83us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217178.805387:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1782217178.805435:0:19515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:19515:1868789713137152:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1782217178.805617:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1782217178.805639:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1782217178.805662:0:19515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:19515:1868789713137280:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782217178.805698:0:19515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217178.805731:0:19515:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d426ccf00 going to sleep for 11 seconds 00000100:00100000:0.0:1782217178.805745:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713137280 00000100:00100000:0.0:1782217178.805749:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713137280 00000100:00100000:0.0:1782217178.805774:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1782217178.805780:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72df8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+24:19515:x1868789713137280:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782217178.805849:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72df8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+24:19515:x1868789713137280:12345-0@lo:502:mount.lustre.0 Request processed in 68us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217178.805855:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1782217178.805895:0:19515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:19515:1868789713137280:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1782217178.805927:0:19515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1782217178.805934:0:19515:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1782217178.817034:0:19528:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1782217178.817064:0:19528:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff952d421c4d40) 00000020:00000080:3.0:1782217178.817089:0:19528:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1782217178.817328:0:19528:0:(tgt_mount.c:153:server_get_mount()) get mount ffff952d430ff000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1782217178.817333:0:19528:0:(tgt_mount.c:187:server_put_mount()) put mount ffff952d430ff000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1782217178.817335:0:19528:0:(obd_mount.c:701:lustre_put_lsi()) put ffff952d430ff000 3 00010000:00080000:3.0:1782217178.817364:0:19528:0:(ldlm_lib.c:102:import_set_conn()) imp ffff952d421c9000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.130@tcp at head 00010000:00010000:3.0:1782217178.823548:0:19528:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1782217178.823672:0:19528:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1782217178.823720:0:19528:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1782217178.823744:0:19528:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x92b8e04cbf5fa7aa 00000100:00080000:3.0:1782217178.823755:0:19528:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782217178.823762:0:19528:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff952d421c9000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1782217178.823795:0:19528:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff952e7b303800 x1868789713137408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782217178.823828:0:19528:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1782217178.823887:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782217178.823891:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782217178.823894:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782217178.823896:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782217178.823926:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782217178.823929:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1782217178.823931:0:37:0:(import.c:65:import_set_state_nolock()) ffff952d42002000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782217178.823936:0:37:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 539 00000100:00080000:3.0:1782217178.823939:0:37:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1782217178.823943:0:37:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff952d42002000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1782217178.823955:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff952e7b303100 x1868789713138048/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782217178.824008:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b301c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713137536:0@lo:400:kworker.0 00000100:00100000:3.0:1782217178.824068:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217178.824094:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1868789713138176:0@lo:400:kworker.0 00000100:00100000:3.0:1782217178.824116:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217178.824136:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782217178.824142:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b300e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713137920:0@lo:400:kworker.0 00000100:00100000:3.0:1782217178.824175:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217178.824204:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1868789713137664:0@lo:400:kworker.0 00000100:00100000:3.0:1782217178.824227:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217178.824252:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1868789713138304:0@lo:400:kworker.0 00000100:00100000:3.0:1782217178.824274:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217178.824291:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782217178.824296:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b302680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713137792:0@lo:400:kworker.0 00000100:00100000:3.0:1782217178.824314:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217178.824330:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1868789713138432:0@lo:400:kworker.0 00000100:00100000:3.0:1782217178.824348:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217178.824375:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713137536 00000100:00100000:3.0:1782217178.824381:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713137536 00000100:00100000:3.0:1782217178.824416:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713137792 00000100:00100000:3.0:1782217178.824419:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713137792 00000100:00100000:3.0:1782217178.824434:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1782217178.824441:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713137536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217178.824491:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713137536:12345-0@lo:400:kworker.0 Request processed in 50us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217178.824497:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1782217178.824510:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782217178.824515:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713137792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217178.824545:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713137792:12345-0@lo:400:kworker.0 Request processed in 29us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217178.824551:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782217178.824567:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713138176 00000100:00100000:3.0:1782217178.824571:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713138176 00000100:00100000:3.0:1782217178.824621:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713137664 00000100:00100000:3.0:1782217178.824624:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713137664 00000100:00100000:3.0:1782217178.824635:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713138304 00000100:00100000:3.0:1782217178.824637:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713138304 00000100:00100000:3.0:1782217178.824658:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713138432 00000100:00100000:3.0:1782217178.824667:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713138432 00000100:00100000:3.0:1782217178.824685:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782217178.824690:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1868789713138176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217178.824898:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b303800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1868789713137408:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1782217178.824933:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217178.824952:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b303100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1868789713138048:0@lo:8:kworker.0 00000100:00100000:1.0:1782217178.824970:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217178.824998:0:18701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713137920 00000100:00100000:1.0:1782217178.825001:0:18701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713137920 00000100:00100000:1.0:1782217178.825037:0:18701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713138048 00000100:00100000:1.0:1782217178.825041:0:18701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713138048 00000100:00100000:1.0:1782217178.825057:0:18701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782217178.825070:0:18701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713137920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217178.825099:0:18701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713137920:12345-0@lo:400:kworker.0 Request processed in 31us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217178.825106:0:18701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782217178.825119:0:18701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782217178.825123:0:18701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4441c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1868789713138048:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1782217178.825167:0:18701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4441c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1868789713138048:12345-0@lo:8:kworker.0 Request processed in 42us (196us total) trans 0 rc -11/-11 00000100:00100000:1.0:1782217178.825173:0:18701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782217178.825203:0:3646:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1782217178.825209:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952d42002000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782217178.825214:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1782217178.825217:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b303100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1868789713138048:0@lo:8:kworker.0 00000100:00100000:2.0:1782217178.827668:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713137408 00000100:00100000:2.0:1782217178.827684:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713137408 00000100:00100000:2.0:1782217178.827717:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782217178.827736:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4441ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1868789713137408:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1782217178.827761:0:17196:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 541 last 0 00000020:00000080:2.0:1782217178.827795:0:17196:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x92b8e04cbf5fa7b1 00000004:00100000:2.0:1782217178.827875:0:17196:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1782217178.827907:0:17196:0:(import.c:65:import_set_state_nolock()) ffff952e7b0c8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782217178.827980:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4441ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1868789713137408:12345-0@lo:38:llog_process_th.0 Request processed in 244us (3046us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217178.827993:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782217178.828009:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782217178.828015:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1868789713137664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217178.828044:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1868789713137664:12345-0@lo:400:kworker.0 Request processed in 30us (3816us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217178.828049:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782217178.828060:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782217178.828066:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1868789713138304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217178.828086:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1868789713138304:12345-0@lo:400:kworker.0 Request processed in 21us (3811us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217178.828091:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782217178.828100:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782217178.828105:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1868789713138432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217178.828125:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1868789713138432:12345-0@lo:400:kworker.0 Request processed in 20us (3777us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217178.828141:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782217178.828232:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1868789713138176:12345-0@lo:400:kworker.0 Request processed in 29us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217178.828242:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1782217178.828263:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782217178.828267:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782217178.828269:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782217178.828317:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b302680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713137792:0@lo:400:kworker.0 00010000:00080000:3.0:1782217178.828330:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952e7c6f0e00 x1868789713138432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217178.828340:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1868789713138432:0@lo:400:kworker.0 00010000:00080000:3.0:1782217178.828349:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952e7b302d80 x1868789713137664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217178.828357:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b302d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1868789713137664:0@lo:400:kworker.0 00010000:00080000:3.0:1782217178.828365:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952e7c6f2680 x1868789713138304/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217178.828374:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1868789713138304:0@lo:400:kworker.0 00010000:00080000:3.0:1782217178.828408:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952e7b300e00 x1868789713137920/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782217194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217178.828416:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b300e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713137920:0@lo:400:kworker.0 00000100:00100000:3.0:1782217178.828426:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b301c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713137536:0@lo:400:kworker.0 00010000:00080000:3.0:1782217178.828436:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952e7c6f1880 x1868789713138176/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217178.828449:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1868789713138176:0@lo:400:kworker.0 00010000:00080000:1.0:1782217178.828678:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952e7b303800 x1868789713137408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782217188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782217178.828687:0:3646:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1782217178.828693:0:3646:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1782217178.828700:0:3646:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1782217178.828705:0:3646:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1782217178.828707:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952d421c9000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1782217178.828712:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b303800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1868789713137408:0@lo:38:llog_process_th.0 00000020:01000004:2.0:1782217178.834574:0:19528:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1782217178.834609:0:19528:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff952e739799c0) 00000020:00000080:2.0:1782217178.834636:0:19528:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1782217178.834887:0:19528:0:(tgt_mount.c:153:server_get_mount()) get mount ffff952d430ff000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1782217178.834891:0:19528:0:(tgt_mount.c:187:server_put_mount()) put mount ffff952d430ff000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1782217178.834893:0:19528:0:(obd_mount.c:701:lustre_put_lsi()) put ffff952d430ff000 3 00010000:00080000:2.0:1782217178.834921:0:19528:0:(ldlm_lib.c:102:import_set_conn()) imp ffff952e7b2bf000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.130@tcp at head 00010000:00010000:2.0:1782217178.837622:0:19528:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:2.0:1782217178.837716:0:19528:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1782217178.837773:0:19528:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1782217178.837791:0:19528:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x92b8e04cbf5fa7bf 00000100:00080000:2.0:1782217178.838894:0:19528:0:(import.c:512:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782217178.838904:0:19528:0:(import.c:626:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff952e7b2bf000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1782217178.838939:0:19528:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff952d43d90a80 x1868789713138560/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782217178.838965:0:19528:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1782217178.839416:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43d90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1868789713138560:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1782217178.839493:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217178.841793:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713138560 00000100:00100000:1.0:1782217178.841813:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713138560 00000100:00100000:1.0:1782217178.841858:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782217178.841866:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1868789713138560:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1782217178.841907:0:17196:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 541 last 0 00000020:00000080:1.0:1782217178.841944:0:17196:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x92b8e04cbf5fa7c6 00000004:00100000:1.0:1782217178.841959:0:17196:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1782217178.841995:0:17196:0:(import.c:65:import_set_state_nolock()) ffff952d43122000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782217178.842075:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1868789713138560:12345-0@lo:38:llog_process_th.0 Request processed in 208us (2581us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217178.842083:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1782217178.842132:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff952d43d90a80 x1868789713138560/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782217188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782217178.842142:0:3646:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1782217178.842150:0:3646:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1782217178.842157:0:3646:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1782217178.842161:0:3646:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1782217178.842163:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952e7b2bf000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1782217178.842169:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43d90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1868789713138560:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1782217178.842294:0:19528:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1782217178.842557:0:19515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1782217178.842611:0:19515:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782217178.842630:0:19515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e4121da00/0x92b8e04cbf5fa795 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa79c expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217178.842640:0:19515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e4121da00/0x92b8e04cbf5fa795 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa79c expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1782217178.842681:0:19515:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1782217178.842683:0:19515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1782217178.842685:0:19515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782217178.842686:0:19515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782217178.842687:0:19515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782217178.842688:0:19515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782217178.842690:0:19515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782217178.842691:0:19515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782217178.842692:0:19515:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1782217178.842696:0:19515:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1782217178.842698:0:19515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1782217178.842700:0:19515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1782217178.842700:0:19515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782217178.842701:0:19515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782217178.842702:0:19515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782217178.842703:0:19515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782217178.842704:0:19515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782217178.842705:0:19515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782217178.842706:0:19515:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1782217178.842736:0:19515:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1782217178.842752:0:19515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:19515:1868789713138688:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1782217178.842804:0:19515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217178.842834:0:19515:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d426cce40 going to sleep for 11 seconds 00000100:00100000:0.0:1782217178.842853:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713138688 00000100:00100000:0.0:1782217178.842857:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713138688 00000100:00100000:0.0:1782217178.842898:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1782217178.842904:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72dfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+24:19515:x1868789713138688:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1782217178.842928:0:17186:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1782217178.842941:0:17186:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:3.0:1782217178.846047:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782217178.846056:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782217178.846058:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782217178.846061:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 20000000:01000000:0.0:1782217178.846576:0:17186:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1782217178.847106:0:17186:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1782217178.847430:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72dfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+24:19515:x1868789713138688:12345-0@lo:253:mount.lustre.0 Request processed in 4521us (4630us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217178.847442:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1782217178.847538:0:19515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a1470210-3884-42c5-8d09-248d2ed946c2:19515:1868789713138688:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1782217178.847551:0:19515:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1782217178.847553:0:19515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1782217178.847555:0:19515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1782217178.847556:0:19515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782217178.847557:0:19515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782217178.847558:0:19515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782217178.847559:0:19515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782217178.847561:0:19515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782217178.847563:0:19515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782217178.847564:0:19515:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1782217178.847577:0:19515:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1782217178.849739:0:17210:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1782217178.849750:0:17210:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1782217178.849777:0:17210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff952e72e2d600/0x92b8e04cbf5fa7cd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217178.849794:0:17210:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952e72e2de00/0x92b8e04cbf5fa741 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa73a expref: 23 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217178.849839:0:17210:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952e4121ca00/0x92b8e04cbf5fa74f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa748 expref: 23 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217178.849847:0:17210:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff952e72e2d600/0x92b8e04cbf5fa7cd lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217178.849888:0:17210:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952e4121ca00/0x92b8e04cbf5fa74f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5fa748 expref: 23 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217178.849903:0:17210:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff952e4121ca00/0x92b8e04cbf5fa74f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5fa748 expref: 23 pid: 17187 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217178.849919:0:17210:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43d90000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17210:1868789713138816:0@lo:104: 00000100:00100000:2.0:1782217178.849978:0:17210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782217178.850081:0:17210:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952e72e2de00/0x92b8e04cbf5fa741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5fa73a expref: 23 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217178.850106:0:17210:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff952e72e2de00/0x92b8e04cbf5fa741 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5fa73a expref: 23 pid: 17189 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217178.850115:0:17210:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43d91f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17210:1868789713138944:0@lo:104: 00000100:00100000:2.0:1782217178.850139:0:17210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217178.852180:0:17210:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d427ffb40 going to sleep for 11 seconds 00000001:00000004:1.0:1782217178.856539:0:19515:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1782217178.857900:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713138816 00000100:00100000:3.0:1782217178.857912:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713138816 00000100:00100000:3.0:1782217178.857955:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713138944 00000100:00100000:3.0:1782217178.857958:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713138944 00000100:00100000:3.0:1782217178.857976:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782217178.857985:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a1470210-3884-42c5-8d09-248d2ed946c2+4:17210:x1868789713138816:12345-0@lo:104: 00010000:00010000:3.0:1782217178.858003:0:17177:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff952e41681000/0x92b8e04cbf5fa748 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5fa74f expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217178.858092:0:17177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782217178.858098:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a1470210-3884-42c5-8d09-248d2ed946c2+4:17210:x1868789713138816:12345-0@lo:104: Request processed in 115us (8120us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217178.858105:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782217178.858122:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782217178.858128:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a1470210-3884-42c5-8d09-248d2ed946c2+3:17210:x1868789713138944:12345-0@lo:104: 00010000:00010000:3.0:1782217178.858135:0:17177:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff952e41680e00/0x92b8e04cbf5fa73a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5fa741 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217178.858168:0:17177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1782217178.858173:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a1470210-3884-42c5-8d09-248d2ed946c2+3:17210:x1868789713138944:12345-0@lo:104: Request processed in 46us (8034us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217178.858187:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1782217178.858203:0:17182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782217178.858209:0:17182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e41681000/0x92b8e04cbf5fa748 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5fa74f expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217178.858216:0:17182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e41681000 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:3.0:1782217178.858220:0:17182:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e41681000/0x92b8e04cbf5fa748 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5fa74f expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217178.858229:0:17182:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e41681000/0x92b8e04cbf5fa748 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5fa74f expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782217178.858236:0:17182:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e41681000/0x92b8e04cbf5fa748 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5fa74f expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782217178.858241:0:17182:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1782217178.858276:0:17182:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e41681000/0x92b8e04cbf5fa748 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5fa74f expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217178.858282:0:17182:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782217178.858301:0:17182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e41681000/0x92b8e04cbf5fa748 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5fa74f expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217178.858307:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e41681000/0x92b8e04cbf5fa748 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5fa74f expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217178.858320:0:17182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782217178.858323:0:17182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e41680e00/0x92b8e04cbf5fa73a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5fa741 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217178.858339:0:17182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e41680e00 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:3.0:1782217178.858341:0:17182:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e41680e00/0x92b8e04cbf5fa73a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5fa741 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217178.858348:0:17182:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e41680e00/0x92b8e04cbf5fa73a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5fa741 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782217178.858354:0:17182:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e41680e00/0x92b8e04cbf5fa73a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5fa741 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782217178.858358:0:17182:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1782217178.858371:0:17182:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e41680e00/0x92b8e04cbf5fa73a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5fa741 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217178.858377:0:17182:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782217178.858384:0:17182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e41680e00/0x92b8e04cbf5fa73a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5fa741 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217178.858390:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e41680e00/0x92b8e04cbf5fa73a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5fa741 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217178.858405:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217178.858406:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217178.858408:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782217178.858429:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43fef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a1470210-3884-42c5-8d09-248d2ed946c2:3647:1868789713139072:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782217178.858467:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217178.858501:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782217178.858507:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43fee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a1470210-3884-42c5-8d09-248d2ed946c2:3647:1868789713139200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782217178.858538:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217178.858563:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713139072 00000100:00100000:3.0:1782217178.858566:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713139072 00010000:00010000:3.0:1782217178.858618:0:17181:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952e4121ca00/0x92b8e04cbf5fa74f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5fa748 expref: 24 pid: 17187 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217178.858637:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713139200 00000100:00100000:3.0:1782217178.858639:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713139200 00010000:00010000:3.0:1782217178.858649:0:17181:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952e72e2de00/0x92b8e04cbf5fa741 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5fa73a expref: 25 pid: 17189 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217178.858662:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782217178.858668:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43feca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1470210-3884-42c5-8d09-248d2ed946c2+25:3647:x1868789713139072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782217178.858678:0:17181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217178.858683:0:17181:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952e4121ca00/0x92b8e04cbf5fa74f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5fa748 expref: 25 pid: 17187 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217178.858693:0:17181:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952e4121ca00/0x92b8e04cbf5fa74f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5fa748 expref: 25 pid: 17187 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217178.858708:0:17181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217178.858749:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43feca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1470210-3884-42c5-8d09-248d2ed946c2+25:3647:x1868789713139072:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217178.858755:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782217178.858767:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782217178.858773:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1470210-3884-42c5-8d09-248d2ed946c2+24:3647:x1868789713139200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782217178.858780:0:17181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782217178.858784:0:17181:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952e72e2de00/0x92b8e04cbf5fa741 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5fa73a expref: 24 pid: 17189 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217178.858932:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e4121ca00/0x92b8e04cbf5fa74f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5fa748 expref: 24 pid: 17187 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217178.858944:0:17210:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43d90000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17210:1868789713138816:0@lo:104: 00000100:00100000:2.0:1782217178.858954:0:17210:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43d91f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17210:1868789713138944:0@lo:104: 00010000:00010000:2.0:1782217178.858972:0:17210:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff952e72e2d600/0x92b8e04cbf5fa7cd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217178.859617:0:17181:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952e72e2de00/0x92b8e04cbf5fa741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5fa73a expref: 23 pid: 17189 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217178.859631:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e72e2de00/0x92b8e04cbf5fa741 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5fa73a expref: 23 pid: 17189 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217178.859641:0:17181:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff952e72e2d600/0x92b8e04cbf5fa7cd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217178.859649:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e72e2d600/0x92b8e04cbf5fa7cd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1782217178.859662:0:17181:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011641050s 00010000:00010000:3.0:1782217178.859667:0:17181:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff952e72e2d600/0x92b8e04cbf5fa7cd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217178.859674:0:17181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff952e72e2d600/0x92b8e04cbf5fa7cd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217178.859680:0:17181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff952e72e2d600/0x92b8e04cbf5fa7cd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217178.859686:0:17181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff952e72e2d600/0x92b8e04cbf5fa7cd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217178.859691:0:17181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2d600 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:3.0:1782217178.859695:0:17181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff952e72e2d600/0x92b8e04cbf5fa7cd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217178.859703:0:17181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff952e72e2d600/0x92b8e04cbf5fa7cd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217178.859735:0:17181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff952e72e2d600/0x92b8e04cbf5fa7cd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217178.859744:0:17181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782217178.859777:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1470210-3884-42c5-8d09-248d2ed946c2+22:3647:x1868789713139200:12345-0@lo:103:ldlm_bl.0 Request processed in 1004us (1238us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217178.859784:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1782217178.859890:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1782217178.859938:0:19515:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1782217178.859944:0:19515:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1782217178.859977:0:19515:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1782217178.860012:0:19515:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.130@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1782217178.860030:0:19515:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1782217178.860046:0:19515:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00010000:00010000:2.0:1782217178.862933:0:17210:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff952e72e2d600/0x92b8e04cbf5fa7cd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217178.862949:0:17210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff952e72e2d600/0x92b8e04cbf5fa7cd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217178.862957:0:17210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e72e2d600/0x92b8e04cbf5fa7cd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:0.0:1782217178.877322:0:19515:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1782217178.877545:0:19515:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1782217178.885182:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43fee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a1470210-3884-42c5-8d09-248d2ed946c2:3647:1868789713139200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782217178.885198:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43fef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a1470210-3884-42c5-8d09-248d2ed946c2:3647:1868789713139072:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782217179.001035:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1782217179.902105:0:19582:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782217179.902334:0:19582:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1782217180.024782:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782217180.347609:0:17191:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1782217180.347617:0:17191:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff952e7c65c000 from 10 10000000:01000000:3.0:1782217180.347623:0:17191:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1782217180.347673:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e41680e00/0x92b8e04cbf5fa7d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217180.347684:0:17191:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e41680e00/0x92b8e04cbf5fa7d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217180.347696:0:17191:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e41680e00/0x92b8e04cbf5fa7d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217180.347729:0:17191:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43fedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713139328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782217180.347795:0:17191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217180.347832:0:17191:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e64ef2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782217180.349665:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713139328 00000100:00100000:0.0:1782217180.349678:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713139328 00000040:00080000:1.0:1782217180.351219:0:17230:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1782217180.351443:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1782217180.351817:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72dfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+22:17191:x1868789713139328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782217180.351836:0:17189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217180.351855:0:17189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e4121c200/0x92b8e04cbf5fa7db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5fa7d4 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217180.351884:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e4121c200/0x92b8e04cbf5fa7db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa7d4 expref: 23 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217180.351895:0:17189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e4121c200/0x92b8e04cbf5fa7db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa7d4 expref: 23 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217180.351904:0:17189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e4121c200, rc 0) 00000100:00100000:0.0:1782217180.351978:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72dfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+23:17191:x1868789713139328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 526us (4182us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217180.352002:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1782217180.352061:0:17191:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43fedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713139328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782217180.352079:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e41680e00/0x92b8e04cbf5fa7d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa7db expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217180.352088:0:17191:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e41680e00/0x92b8e04cbf5fa7d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5fa7db expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217180.352152:0:17191:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713139456:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1782217180.352190:0:17191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217180.352218:0:17191:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e7c7d1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782217180.352232:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713139456 00000100:00100000:0.0:1782217180.352237:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713139456 00000100:00100000:0.0:1782217180.352264:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1782217180.352270:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72df9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+23:17191:x1868789713139456:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1782217180.352284:0:17186:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1782217180.356364:0:17186:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1782217180.356373:0:17186:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1782217180.357835:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72df9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+23:17191:x1868789713139456:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 5558us (5638us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217180.357849:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1782217180.358045:0:17191:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713139456:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1782217180.358115:0:17191:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1782217180.358126:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e41680e00/0x92b8e04cbf5fa7d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa7db expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217180.358143:0:17191:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e41680e00/0x92b8e04cbf5fa7d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa7db expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782217180.358154:0:17191:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1782217180.358156:0:17191:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff952d43f05800 from 10 10000000:01000000:2.0:1782217180.358159:0:17191:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1782217180.358189:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e72e2d600/0x92b8e04cbf5fa7e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217180.358198:0:17191:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e72e2d600/0x92b8e04cbf5fa7e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217180.358207:0:17191:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e72e2d600/0x92b8e04cbf5fa7e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217180.358226:0:17191:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43d91f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713139584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782217180.358261:0:17191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217180.358287:0:17191:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d427ff300 going to sleep for 11 seconds 00000100:00100000:1.0:1782217180.358483:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713139584 00000100:00100000:1.0:1782217180.358490:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713139584 00000100:00100000:1.0:1782217180.358539:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1782217180.358548:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72dfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+23:17191:x1868789713139584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782217180.358561:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217180.358575:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952d43072200/0x92b8e04cbf5fa7e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5fa7e2 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217180.358635:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952d43072200/0x92b8e04cbf5fa7e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa7e2 expref: 24 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217180.358645:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952d43072200/0x92b8e04cbf5fa7e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa7e2 expref: 24 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217180.358653:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43072200, rc 0) 00000100:00100000:1.0:1782217180.358686:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72dfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+24:17191:x1868789713139584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217180.358692:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1782217180.358895:0:17191:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43d91f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713139584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782217180.358909:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e72e2d600/0x92b8e04cbf5fa7e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa7e9 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217180.358917:0:17191:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e72e2d600/0x92b8e04cbf5fa7e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5fa7e9 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217180.358960:0:17191:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43d91f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713139712:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1782217180.358990:0:17191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217180.359015:0:17191:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d427ff300 going to sleep for 11 seconds 00000100:00100000:0.0:1782217180.359081:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713139712 00000100:00100000:0.0:1782217180.359086:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713139712 00000100:00100000:0.0:1782217180.359120:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1782217180.359128:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72dfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+24:17191:x1868789713139712:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1782217180.359142:0:17189:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1782217180.359161:0:17189:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1782217180.359164:0:17189:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1782217180.359235:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72dfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+24:17191:x1868789713139712:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 106us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217180.359242:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1782217180.359271:0:17191:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43d91f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713139712:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1782217180.359424:0:17191:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1782217180.359430:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e72e2d600/0x92b8e04cbf5fa7e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa7e9 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217180.359439:0:17191:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e72e2d600/0x92b8e04cbf5fa7e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5fa7e9 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217181.048725:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782217181.754346:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782217181.754367:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713139840:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782217181.754431:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217181.754472:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713139840 00000100:00100000:2.0:1782217181.754478:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713139840 00000100:00100000:2.0:1782217181.754522:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1782217181.754530:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713139840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782217181.754567:0:17200:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1782217181.754638:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713139840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217181.754645:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1782217181.754710:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713139840:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782217181.755240:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782217181.755251:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43fed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713139968:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782217181.755285:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217181.755313:0:18842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713139968 00000100:00100000:3.0:1782217181.755318:0:18842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713139968 00000100:00100000:3.0:1782217181.755346:0:18842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1782217181.755364:0:18842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713139968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782217181.755387:0:18842:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1782217181.755422:0:18842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713139968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217181.755429:0:18842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1782217181.755460:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43fed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713139968:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1782217182.072768:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782217182.273640:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782217182.273673:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713140096:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782217182.273787:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217182.273857:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713140096 00000100:00100000:1.0:1782217182.273866:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713140096 00000100:00100000:1.0:1782217182.273945:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782217182.273956:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4441ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713140096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782217182.273997:0:18704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1782217182.274051:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4441ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713140096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217182.274059:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1782217182.274108:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d4441dc00 x1868789713140096/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782217198 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782217182.274128:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713140096:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1782217182.276725:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782217183.100785:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782217183.865570:0:17948:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1782217183.992661:0:3646:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782217163/real 1782217163] req@ffff952d43cb0e00 x1868789713126144/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782217183 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782217183.992715:0:3646:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff952d43cb0e00 x1868789713126144/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782217183 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782217183.992726:0:3646:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782217163/real 1782217163] req@ffff952d43cb2300 x1868789713126272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782217183 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782217183.992739:0:3646:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff952d43cb2300 x1868789713126272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782217183 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1782217183.992760:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952e749ef800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782217183.992787:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1782217183.992791:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43cb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1868789713126144:0@lo:8:kworker.0 00000100:00080000:0.0:1782217183.992796:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952e7b2cd000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782217183.992812:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1782217183.992815:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43cb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1868789713126272:0@lo:8:kworker.0 00000100:00080000:3.0:1782217183.993206:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782217183.993210:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1782217183.993213:0:37:0:(import.c:65:import_set_state_nolock()) ffff952e749ef800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782217183.993218:0:37:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 526 00000100:00080000:3.0:1782217183.993223:0:37:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1782217183.993230:0:37:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff952e749ef800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1782217183.993249:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff952d43fef800 x1868789713140480/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782217183.993262:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782217183.993265:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1782217183.993267:0:37:0:(import.c:65:import_set_state_nolock()) ffff952e7b2cd000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782217183.993270:0:37:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 526 00000100:00080000:3.0:1782217183.993272:0:37:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1782217183.993275:0:37:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff952e7b2cd000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1782217183.993285:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff952d43feea00 x1868789713140608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782217183.993308:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782217183.993316:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1782217183.993318:0:37:0:(import.c:65:import_set_state_nolock()) ffff952d42002000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782217183.993323:0:37:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff952d42002000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1782217183.993334:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff952d43fec380 x1868789713141120/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782217183.993384:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43fed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713140864:0@lo:400:kworker.0 00000100:00100000:3.0:1782217183.993445:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217183.993495:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43fee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1868789713141504:0@lo:400:kworker.0 00000100:00100000:3.0:1782217183.993521:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217183.993546:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1782217183.993552:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43fed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a1470210-3884-42c5-8d09-248d2ed946c2:3647:1868789713140224:0@lo:400:kworker.0 00000100:00100000:3.0:1782217183.993577:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217183.993616:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43fee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713140992:0@lo:400:kworker.0 00000100:00100000:3.0:1782217183.993637:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217183.993652:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1868789713141632:0@lo:400:kworker.0 00000100:00100000:3.0:1782217183.993673:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217183.993714:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43feed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713140352:0@lo:400:kworker.0 00000100:00100000:3.0:1782217183.993735:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217183.993749:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43fedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1868789713141248:0@lo:400:kworker.0 00000100:00100000:3.0:1782217183.993767:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217183.993781:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c6f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1868789713141760:0@lo:400:kworker.0 00000100:00100000:3.0:1782217183.993802:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217183.993817:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782217183.993822:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43fedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1868789713140736:0@lo:400:kworker.0 00000100:00100000:3.0:1782217183.993846:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217183.993855:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43fef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1868789713141376:0@lo:400:kworker.0 00000100:00100000:3.0:1782217183.993870:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217183.993892:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713140864 00000100:00100000:3.0:1782217183.993899:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713140864 00000100:00100000:3.0:1782217183.993936:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713140352 00000100:00100000:3.0:1782217183.993938:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713140352 00000100:00100000:3.0:1782217183.993953:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1782217183.993961:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713140864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217183.994008:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713140864:12345-0@lo:400:kworker.0 Request processed in 48us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217183.994015:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1782217183.994031:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1782217183.994037:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713140352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217183.994065:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713140352:12345-0@lo:400:kworker.0 Request processed in 29us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217183.994071:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1782217183.994086:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713141504 00000100:00100000:3.0:1782217183.994089:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713141504 00000100:00100000:3.0:1782217183.994113:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713141632 00000100:00100000:3.0:1782217183.994115:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713141632 00000100:00100000:3.0:1782217183.994125:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713141248 00000100:00100000:3.0:1782217183.994127:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713141248 00000100:00100000:3.0:1782217183.994135:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713141760 00000100:00100000:3.0:1782217183.994137:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713141760 00000100:00100000:3.0:1782217183.994146:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713140736 00000100:00100000:3.0:1782217183.994148:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713140736 00000100:00100000:3.0:1782217183.994157:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713141376 00000100:00100000:3.0:1782217183.994158:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713141376 00000100:00100000:3.0:1782217183.994178:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782217183.994184:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1868789713141504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217183.994211:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1868789713141504:12345-0@lo:400:kworker.0 Request processed in 27us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217183.994216:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782217183.994226:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782217183.994231:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1868789713141632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217183.994252:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1868789713141632:12345-0@lo:400:kworker.0 Request processed in 21us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217183.994257:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782217183.994267:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1782217183.994273:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1868789713141248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217183.994297:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1868789713141248:12345-0@lo:400:kworker.0 Request processed in 25us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217183.994302:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1782217183.994312:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1782217183.994318:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1868789713141760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217183.994344:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1868789713141760:12345-0@lo:400:kworker.0 Request processed in 26us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217183.994349:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1782217183.994360:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782217183.994365:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1868789713140736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217183.994390:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1868789713140736:12345-0@lo:400:kworker.0 Request processed in 25us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217183.994395:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782217183.994411:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1782217183.994416:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1868789713141376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217183.994442:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1868789713141376:12345-0@lo:400:kworker.0 Request processed in 25us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217183.994447:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1782217183.994465:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713140224 00000100:00100000:3.0:1782217183.994469:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713140224 00000100:00100000:3.0:1782217183.994492:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1782217183.994498:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72df8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+24:3647:x1868789713140224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217183.994523:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72df8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+24:3647:x1868789713140224:12345-0@lo:400:kworker.0 Request processed in 26us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217183.994529:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1782217183.994554:0:18701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713140992 00000100:00100000:3.0:1782217183.994557:0:18701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713140992 00000100:00100000:3.0:1782217183.994579:0:18701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782217183.994606:0:18701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713140992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217183.994633:0:18701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713140992:12345-0@lo:400:kworker.0 Request processed in 30us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217183.994639:0:18701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1782217183.994671:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782217183.994674:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1782217183.994718:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43fedf80 x1868789713140736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217183.994731:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43fedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1868789713140736:0@lo:400:kworker.0 00010000:00080000:3.0:1782217183.994741:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43fef100 x1868789713141376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217183.994762:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43fef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1868789713141376:0@lo:400:kworker.0 00000100:00100000:3.0:1782217183.994773:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43feed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713140352:0@lo:400:kworker.0 00010000:00080000:3.0:1782217183.994782:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43fedc00 x1868789713141248/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217183.994790:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43fedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1868789713141248:0@lo:400:kworker.0 00010000:00080000:3.0:1782217183.994799:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7c6f2680 x1868789713141760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217183.994807:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1868789713141760:0@lo:400:kworker.0 00000100:00100000:3.0:1782217183.994838:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43fef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1868789713140480:0@lo:8:kworker.0 00000100:00100000:3.0:1782217183.994863:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217183.994888:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43feea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1868789713140608:0@lo:8:kworker.0 00000100:00100000:3.0:1782217183.994906:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217183.994920:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43fec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1868789713141120:0@lo:8:kworker.0 00000100:00100000:3.0:1782217183.994939:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217183.994962:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713140480 00000100:00100000:3.0:1782217183.994965:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713140480 00000100:00100000:3.0:1782217183.994980:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713140608 00000100:00100000:3.0:1782217183.994982:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713140608 00000100:00100000:3.0:1782217183.994988:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713141120 00000100:00100000:3.0:1782217183.994990:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713141120 00000100:00100000:3.0:1782217183.994998:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782217183.995002:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1868789713140480:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1782217183.995024:0:18700:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 546 last 0 00000020:00000080:3.0:1782217183.995054:0:18700:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x92b8e04cbf5fa7f0 00002000:00100000:3.0:1782217183.995067:0:18700:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff952d421ce000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1782217183.995071:0:18700:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1782217183.995073:0:18700:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1782217183.995141:0:18700:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1782217183.995162:0:18700:0:(import.c:65:import_set_state_nolock()) ffff952d421cd800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782217183.995196:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1868789713140480:12345-0@lo:8:kworker.0 Request processed in 191us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217183.995203:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782217183.995214:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782217183.995218:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1868789713140608:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1782217183.995233:0:18700:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 546 last 0 00000020:00000080:3.0:1782217183.995247:0:18700:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x92b8e04cbf5fa7f7 00002000:00100000:3.0:1782217183.995252:0:18700:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff952d421cb000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1782217183.995256:0:18700:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1782217183.995258:0:18700:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1782217183.995377:0:18700:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1782217183.995389:0:18700:0:(import.c:65:import_set_state_nolock()) ffff952d421c8800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782217183.995432:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1868789713140608:12345-0@lo:8:kworker.0 Request processed in 213us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217183.995438:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782217183.995450:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782217183.995453:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1868789713141120:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1782217183.995467:0:18700:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 546 last 0 00000020:00000080:3.0:1782217183.995481:0:18700:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x92b8e04cbf5fa7fe 00002000:00100000:3.0:1782217183.995487:0:18700:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff952d421cc800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1782217183.995496:0:18700:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1782217183.995498:0:18700:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1782217183.995516:0:18700:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1782217183.995529:0:18700:0:(import.c:65:import_set_state_nolock()) ffff952d421ca800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782217183.995555:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1868789713141120:12345-0@lo:8:kworker.0 Request processed in 100us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217183.995561:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1782217183.995613:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43fef800 x1868789713140480/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782217208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217183.995621:0:3646:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1782217183.995626:0:3646:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1782217183.995633:0:3646:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1782217183.995637:0:3646:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1782217183.995639:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952e749ef800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1782217183.995657:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1782217183.995662:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43fef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1868789713140480:0@lo:8:kworker.0 00010000:00080000:3.0:1782217183.995673:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43feea00 x1868789713140608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782217208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217183.995680:0:3646:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1782217183.995694:0:3646:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1782217183.995699:0:3646:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1782217183.995701:0:3646:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1782217183.995703:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952e7b2cd000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1782217183.995703:0:17219:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000004:00080000:3.0:1782217183.995711:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1782217183.995714:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43feea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1868789713140608:0@lo:8:kworker.0 00000100:00100000:2.0:1782217183.995720:0:17219:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43d91c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17219:1868789713142016:0@lo:5:osp-pre-0-0.0 00010000:00080000:3.0:1782217183.995725:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43fec380 x1868789713141120/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782217208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1782217183.995739:0:3646:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1782217183.995744:0:3646:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1782217183.995746:0:3646:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00100000:2.0:1782217183.995746:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1782217183.995748:0:3646:0:(import.c:65:import_set_state_nolock()) ffff952d42002000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1782217183.995757:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1782217183.995760:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43fec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1868789713141120:0@lo:8:kworker.0 00000100:00100000:2.0:1782217183.995760:0:17219:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e58b68f00 going to sleep for 11 seconds 00000004:00080000:3.0:1782217183.995780:0:17937:0:(osp_sync.c:1060:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1782217183.995830:0:17937:0:(osp_sync.c:1862:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 546979246474ns, next at 0ns, rc = 0 00080000:00080000:3.0:1782217183.995836:0:17937:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1782217183.995986:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713141888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782217183.996011:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217183.996042:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713141888 00000100:00100000:2.0:1782217183.996042:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43fed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a1470210-3884-42c5-8d09-248d2ed946c2:3647:1868789713140224:0@lo:400:kworker.0 00000100:00100000:3.0:1782217183.996045:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713141888 00010000:00080000:2.0:1782217183.996054:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43fee680 x1868789713140992/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782217199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782217183.996062:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43fee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713140992:0@lo:400:kworker.0 00000100:00100000:3.0:1782217183.996076:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1782217183.996076:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e7c6f1880 x1868789713141632/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217183.996082:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1868789713141888:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782217183.996085:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c6f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1868789713141632:0@lo:400:kworker.0 00002000:00000024:3.0:1782217183.996094:0:18704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1782217183.996095:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43fed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713140864:0@lo:400:kworker.0 00010000:00080000:2.0:1782217183.996112:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43fee300 x1868789713141504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782217183.996120:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43fee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1868789713141504:0@lo:400:kworker.0 00000100:00100000:3.0:1782217183.996124:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1868789713141888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217183.996129:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1782217183.996147:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782217183.996156:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713142016 00000100:00100000:2.0:1782217183.996159:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713142016 00000004:00080000:0.0:1782217183.996317:0:17221:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:0.0:1782217183.996332:0:17221:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17221:1868789713142272:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1782217183.996362:0:17221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1782217183.996544:0:17218:0:(osp_sync.c:1060:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1782217183.996608:0:17218:0:(osp_sync.c:1862:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 546980024862ns, next at 0ns, rc = 0 00080000:00080000:1.0:1782217183.996613:0:17218:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1782217183.996632:0:17220:0:(osp_sync.c:1060:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1782217183.996654:0:17220:0:(osp_sync.c:1862:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 546980070824ns, next at 0ns, rc = 0 00080000:00080000:1.0:1782217183.996657:0:17220:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1782217183.998106:0:17221:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e50194480 going to sleep for 11 seconds 00000004:00080000:0.0:1782217183.998150:0:17938:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1782217183.998172:0:17938:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17938:1868789713142528:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1782217183.998218:0:17938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1782217183.998330:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43d90000 x1868789713141888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782217199 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217183.998349:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713141888:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782217183.998418:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713142272 00000100:00100000:2.0:1782217183.998425:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713142272 00000100:00100000:2.0:1782217183.998481:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782217183.998489:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17219:x1868789713142016:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:2.0:1782217183.998716:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782217183.998732:0:18701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782217183.998740:0:18701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17221:x1868789713142272:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1782217183.999417:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43cb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713142400:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782217183.999470:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217183.999498:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782217183.999525:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713142144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782217183.999547:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217183.999637:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713142400 00000100:00100000:2.0:1782217183.999642:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713142400 00000100:00100000:2.0:1782217183.999670:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713142144 00000100:00100000:2.0:1782217183.999673:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713142144 00000100:00100000:2.0:1782217183.999695:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782217183.999703:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1868789713142400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782217183.999726:0:18704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1782217183.999767:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1868789713142400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217183.999781:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782217183.999796:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782217183.999801:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1868789713142144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782217183.999822:0:18704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1782217183.999846:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1868789713142144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217183.999852:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1782217183.999865:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1782217183.999886:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952e46da6680 x1868789713142144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782217199 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782217183.999900:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713142144:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1782217183.999910:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43cb0e00 x1868789713142400/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782217199 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782217183.999920:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43cb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713142400:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782217184.000200:0:17938:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e501940c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782217184.001077:0:18702:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1782217184.001090:0:18702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000004:00080000:2.0:1782217184.002558:0:17927:0:(osp_sync.c:1827:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:2.0:1782217184.003239:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713142528 00000100:00100000:2.0:1782217184.003248:0:18702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713142528 00002000:00080000:0.0:1782217184.003493:0:18701:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1782217184.003501:0:18701:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1782217184.003507:0:18701:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00002000:00080000:2.0:1782217184.003616:0:18700:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1782217184.003621:0:18700:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1782217184.003625:0:18700:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00000100:00100000:3.0:1782217184.003721:0:19412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782217184.003734:0:19412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17938:x1868789713142528:12345-0@lo:7:osp-pre-1-1.0 00002000:00080000:3.0:1782217184.006953:0:19412:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1782217184.006962:0:19412:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1782217184.007052:0:19412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17938:x1868789713142528:12345-0@lo:7:osp-pre-1-1.0 Request processed in 3317us (8827us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217184.007064:0:19412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1782217184.014775:0:17938:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d41be5180 x1868789713142528/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1782217199 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217184.014795:0:17938:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17938:1868789713142528:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1782217184.014809:0:17938:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1782217184.014971:0:17938:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43e91c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17938:1868789713142656:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1782217184.015027:0:17938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217184.015058:0:17938:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e52a05480 going to sleep for 11 seconds 00000004:00080000:1.0:1782217184.025814:0:17174:0:(osp_sync.c:1827:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1782217184.025833:0:17174:0:(osp_sync.c:1827:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1782217184.028667:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713142656 00000100:00100000:3.0:1782217184.028678:0:18702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713142656 00000100:00100000:3.0:1782217184.028739:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782217184.028749:0:18702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17938:x1868789713142656:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1782217184.028912:0:18702:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1782217184.028991:0:18702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17938:x1868789713142656:12345-0@lo:5:osp-pre-1-1.0 Request processed in 243us (13963us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217184.028999:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1782217184.029042:0:17938:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43e91c00 x1868789713142656/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782217200 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782217184.029058:0:17938:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43e91c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17938:1868789713142656:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1782217184.029072:0:17938:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1782217184.029113:0:17938:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43e91c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17938:1868789713142784:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1782217184.029155:0:17938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217184.029178:0:17938:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e52a05480 going to sleep for 11 seconds 00000100:00100000:3.0:1782217184.029197:0:19412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713142784 00000100:00100000:3.0:1782217184.029201:0:19412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713142784 00000100:00100000:3.0:1782217184.029281:0:19412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782217184.029289:0:19412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17938:x1868789713142784:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1782217184.029314:0:19412:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:0.0:1782217184.029916:0:18701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782217184.029927:0:18701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cded8c73/0x92b8e04cbf5fa805 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.029943:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=547s v=(0 0) 00010000:00010000:0.0:1782217184.029947:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217184.029954:0:18701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cded8c73/0x92b8e04cbf5fa805 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.032780:0:18701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cded8c73/0x92b8e04cbf5fa805 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.032809:0:18701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cded8c73/0x92b8e04cbf5fa805 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.032833:0:18701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cded8c73/0x92b8e04cbf5fa805 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.032861:0:18701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782217184.034470:0:18349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782217184.034480:0:18349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cded8c73/0x92b8e04cbf5fa805 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.034510:0:18349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121ca00 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:1.0:1782217184.034514:0:18349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cded8c73/0x92b8e04cbf5fa805 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.034537:0:18349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cded8c73/0x92b8e04cbf5fa805 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.034561:0:18349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cded8c73/0x92b8e04cbf5fa805 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.034568:0:18349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cded8c73/0x92b8e04cbf5fa805 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.034612:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217184.034614:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217184.034616:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782217184.035057:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782217184.035066:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee7eda8a/0x92b8e04cbf5fa80c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.035089:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=547s v=(0 0) 00010000:00010000:2.0:1782217184.035094:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782217184.035105:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee7eda8a/0x92b8e04cbf5fa80c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.035121:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee7eda8a/0x92b8e04cbf5fa80c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.035129:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee7eda8a/0x92b8e04cbf5fa80c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.035136:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee7eda8a/0x92b8e04cbf5fa80c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.035201:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1782217184.035643:0:18701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782217184.035650:0:18701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa3ca814/0x92b8e04cbf5fa813 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.035669:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=547s v=(0 0) 00010000:00010000:0.0:1782217184.035672:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217184.035676:0:18701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa3ca814/0x92b8e04cbf5fa813 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.035698:0:18701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa3ca814/0x92b8e04cbf5fa813 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.035706:0:18701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa3ca814/0x92b8e04cbf5fa813 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.035713:0:18701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa3ca814/0x92b8e04cbf5fa813 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782217184.038454:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782217184.038467:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078fbfed6/0x92b8e04cbf5fa81a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.038483:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=547s v=(0 0) 00010000:00010000:2.0:1782217184.038488:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782217184.038495:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078fbfed6/0x92b8e04cbf5fa81a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.038510:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078fbfed6/0x92b8e04cbf5fa81a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.038538:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078fbfed6/0x92b8e04cbf5fa81a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.038545:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078fbfed6/0x92b8e04cbf5fa81a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.039440:0:17183:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1782217184.039449:0:17183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee7eda8a/0x92b8e04cbf5fa80c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.039460:0:17183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2de00 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:1.0:1782217184.039465:0:17183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee7eda8a/0x92b8e04cbf5fa80c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.039475:0:17183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee7eda8a/0x92b8e04cbf5fa80c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.039505:0:17183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee7eda8a/0x92b8e04cbf5fa80c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.039515:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee7eda8a/0x92b8e04cbf5fa80c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.039516:0:18701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1782217184.039540:0:17183:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782217184.039545:0:17183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa3ca814/0x92b8e04cbf5fa813 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.039552:0:17183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121cc00 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:1.0:1782217184.039556:0:17183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa3ca814/0x92b8e04cbf5fa813 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.039563:0:17183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa3ca814/0x92b8e04cbf5fa813 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.039576:0:17183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa3ca814/0x92b8e04cbf5fa813 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.039601:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa3ca814/0x92b8e04cbf5fa813 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.039617:0:17183:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782217184.039621:0:17183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078fbfed6/0x92b8e04cbf5fa81a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.039635:0:17183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2c000 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:1.0:1782217184.039638:0:17183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078fbfed6/0x92b8e04cbf5fa81a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.039645:0:17183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078fbfed6/0x92b8e04cbf5fa81a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.039656:0:17183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078fbfed6/0x92b8e04cbf5fa81a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.039665:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217184.039666:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217184.039669:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217184.039698:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217184.039824:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1782217184.039831:0:18700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078fbfed6/0x92b8e04cbf5fa81a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782217184.043779:0:18701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782217184.043799:0:18701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b38f97aa/0x92b8e04cbf5fa821 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.043815:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=547s v=(0 0) 00010000:00010000:0.0:1782217184.043820:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217184.043863:0:18701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b38f97aa/0x92b8e04cbf5fa821 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.043878:0:18701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b38f97aa/0x92b8e04cbf5fa821 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.043888:0:18701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b38f97aa/0x92b8e04cbf5fa821 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.043896:0:18701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b38f97aa/0x92b8e04cbf5fa821 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782217184.044387:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782217184.044395:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca7c19a3/0x92b8e04cbf5fa828 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.044406:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=547s v=(0 0) 00010000:00010000:3.0:1782217184.044410:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217184.044415:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca7c19a3/0x92b8e04cbf5fa828 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.044427:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca7c19a3/0x92b8e04cbf5fa828 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.044435:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca7c19a3/0x92b8e04cbf5fa828 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.044442:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca7c19a3/0x92b8e04cbf5fa828 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.047716:0:18701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1782217184.047910:0:18349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782217184.047921:0:18349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b38f97aa/0x92b8e04cbf5fa821 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.047934:0:18349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121c800 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:1.0:1782217184.047939:0:18349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b38f97aa/0x92b8e04cbf5fa821 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.047949:0:18349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b38f97aa/0x92b8e04cbf5fa821 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.047968:0:18349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b38f97aa/0x92b8e04cbf5fa821 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.047983:0:18349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b38f97aa/0x92b8e04cbf5fa821 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.048002:0:18349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782217184.048007:0:18349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca7c19a3/0x92b8e04cbf5fa828 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.048014:0:18349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e41681000 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:1.0:1782217184.048018:0:18349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca7c19a3/0x92b8e04cbf5fa828 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.048026:0:18349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca7c19a3/0x92b8e04cbf5fa828 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.048036:0:18349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca7c19a3/0x92b8e04cbf5fa828 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.048044:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217184.048046:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217184.048047:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217184.048060:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782217184.048252:0:18701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782217184.048259:0:18701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cded8c73/0x92b8e04cbf5fa82f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.048272:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=547s v=(0 0) 00010000:00010000:0.0:1782217184.048277:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217184.048282:0:18701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cded8c73/0x92b8e04cbf5fa82f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.048296:0:18701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cded8c73/0x92b8e04cbf5fa82f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.048313:0:18701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cded8c73/0x92b8e04cbf5fa82f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.048320:0:18701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cded8c73/0x92b8e04cbf5fa82f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.048566:0:18701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1782217184.048977:0:18701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782217184.048986:0:18701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000765041a1/0x92b8e04cbf5fa836 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.048995:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=547s v=(0 0) 00010000:00010000:0.0:1782217184.048999:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217184.049003:0:18701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000765041a1/0x92b8e04cbf5fa836 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.049013:0:18701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000765041a1/0x92b8e04cbf5fa836 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.049021:0:18701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000765041a1/0x92b8e04cbf5fa836 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.049029:0:18701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000765041a1/0x92b8e04cbf5fa836 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.049059:0:18701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1782217184.049138:0:18349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782217184.049144:0:18349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cded8c73/0x92b8e04cbf5fa82f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.049152:0:18349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121ca00 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:2.0:1782217184.049156:0:18349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cded8c73/0x92b8e04cbf5fa82f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.049165:0:18349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cded8c73/0x92b8e04cbf5fa82f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.049180:0:18349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cded8c73/0x92b8e04cbf5fa82f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.049188:0:18349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cded8c73/0x92b8e04cbf5fa82f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.049212:0:18349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782217184.049215:0:18349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000765041a1/0x92b8e04cbf5fa836 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.049221:0:18349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121d200 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:2.0:1782217184.049224:0:18349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000765041a1/0x92b8e04cbf5fa836 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.049232:0:18349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000765041a1/0x92b8e04cbf5fa836 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.049241:0:18349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000765041a1/0x92b8e04cbf5fa836 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.049248:0:18349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000765041a1/0x92b8e04cbf5fa836 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.049318:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217184.049321:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217184.049323:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217184.049964:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217184.050601:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1782217184.050612:0:18700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca7c19a3/0x92b8e04cbf5fa828 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782217184.052866:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782217184.052879:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e887a6b4/0x92b8e04cbf5fa83d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.052895:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=547s v=(0 0) 00010000:00010000:3.0:1782217184.052900:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217184.052906:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e887a6b4/0x92b8e04cbf5fa83d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.052919:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e887a6b4/0x92b8e04cbf5fa83d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.052929:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e887a6b4/0x92b8e04cbf5fa83d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.052936:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e887a6b4/0x92b8e04cbf5fa83d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782217184.053117:0:18701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782217184.053124:0:18701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000186f4659/0x92b8e04cbf5fa844 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.053133:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=547s v=(0 0) 00010000:00010000:0.0:1782217184.053137:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217184.053141:0:18701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000186f4659/0x92b8e04cbf5fa844 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.053151:0:18701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000186f4659/0x92b8e04cbf5fa844 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.053230:0:18701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000186f4659/0x92b8e04cbf5fa844 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.053239:0:18701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000186f4659/0x92b8e04cbf5fa844 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.054016:0:17183:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782217184.054026:0:17183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e887a6b4/0x92b8e04cbf5fa83d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.054050:0:17183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e41681a00 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:1.0:1782217184.054055:0:17183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e887a6b4/0x92b8e04cbf5fa83d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.054065:0:17183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e887a6b4/0x92b8e04cbf5fa83d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.054083:0:17183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e887a6b4/0x92b8e04cbf5fa83d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.054093:0:17183:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782217184.054097:0:17183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000186f4659/0x92b8e04cbf5fa844 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.054103:0:17183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121d600 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:1.0:1782217184.054107:0:17183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000186f4659/0x92b8e04cbf5fa844 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.054115:0:17183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000186f4659/0x92b8e04cbf5fa844 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.054126:0:17183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000186f4659/0x92b8e04cbf5fa844 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.054134:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217184.054142:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217184.054144:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217184.055284:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1782217184.055294:0:18700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e887a6b4/0x92b8e04cbf5fa83d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.055323:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217184.055766:0:18701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1782217184.055775:0:18701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000186f4659/0x92b8e04cbf5fa844 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.055815:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782217184.058521:0:18701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782217184.058533:0:18701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed27e2e2/0x92b8e04cbf5fa84b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.058558:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=547s v=(0 0) 00010000:00010000:0.0:1782217184.058562:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217184.058568:0:18701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed27e2e2/0x92b8e04cbf5fa84b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.058597:0:18701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed27e2e2/0x92b8e04cbf5fa84b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.058608:0:18701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed27e2e2/0x92b8e04cbf5fa84b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.058615:0:18701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed27e2e2/0x92b8e04cbf5fa84b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.058637:0:18701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782217184.058667:0:17183:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782217184.058676:0:17183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed27e2e2/0x92b8e04cbf5fa84b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.058697:0:17183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121c000 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:1.0:1782217184.058703:0:17183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed27e2e2/0x92b8e04cbf5fa84b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.058713:0:17183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed27e2e2/0x92b8e04cbf5fa84b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.058731:0:17183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed27e2e2/0x92b8e04cbf5fa84b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.058740:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed27e2e2/0x92b8e04cbf5fa84b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782217184.058934:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782217184.058941:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca7c19a3/0x92b8e04cbf5fa852 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.058956:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=547s v=(0 0) 00010000:00010000:3.0:1782217184.058959:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217184.058963:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca7c19a3/0x92b8e04cbf5fa852 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.058974:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca7c19a3/0x92b8e04cbf5fa852 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.058982:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca7c19a3/0x92b8e04cbf5fa852 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.058990:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca7c19a3/0x92b8e04cbf5fa852 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.059019:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782217184.059100:0:17183:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782217184.059105:0:17183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca7c19a3/0x92b8e04cbf5fa852 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.059113:0:17183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e41681000 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:1.0:1782217184.059117:0:17183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca7c19a3/0x92b8e04cbf5fa852 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.059138:0:17183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca7c19a3/0x92b8e04cbf5fa852 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.059151:0:17183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca7c19a3/0x92b8e04cbf5fa852 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.059158:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca7c19a3/0x92b8e04cbf5fa852 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.059171:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217184.059173:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217184.059174:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782217184.059328:0:18701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782217184.059335:0:18701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa3ca814/0x92b8e04cbf5fa859 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.059355:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=547s v=(0 0) 00010000:00010000:0.0:1782217184.059358:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217184.059420:0:18701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa3ca814/0x92b8e04cbf5fa859 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.059430:0:18701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa3ca814/0x92b8e04cbf5fa859 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.059449:0:18701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa3ca814/0x92b8e04cbf5fa859 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.059456:0:18701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa3ca814/0x92b8e04cbf5fa859 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.059478:0:18701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782217184.059609:0:17182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782217184.059615:0:17182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa3ca814/0x92b8e04cbf5fa859 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.059623:0:17182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121cc00 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:1.0:1782217184.059626:0:17182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa3ca814/0x92b8e04cbf5fa859 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.059634:0:17182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa3ca814/0x92b8e04cbf5fa859 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.059646:0:17182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa3ca814/0x92b8e04cbf5fa859 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.059665:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa3ca814/0x92b8e04cbf5fa859 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.059680:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217184.059690:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217184.059693:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782217184.060063:0:18701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782217184.060071:0:18701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1c227ef/0x92b8e04cbf5fa860 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.060080:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=547s v=(0 0) 00010000:00010000:0.0:1782217184.060083:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217184.060088:0:18701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1c227ef/0x92b8e04cbf5fa860 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.060098:0:18701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1c227ef/0x92b8e04cbf5fa860 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.060105:0:18701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1c227ef/0x92b8e04cbf5fa860 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.060112:0:18701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1c227ef/0x92b8e04cbf5fa860 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.060146:0:18701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782217184.060170:0:17183:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782217184.060176:0:17183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1c227ef/0x92b8e04cbf5fa860 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.060185:0:17183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e40031400 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:1.0:1782217184.060188:0:17183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1c227ef/0x92b8e04cbf5fa860 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.060197:0:17183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1c227ef/0x92b8e04cbf5fa860 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.060209:0:17183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1c227ef/0x92b8e04cbf5fa860 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.060216:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1c227ef/0x92b8e04cbf5fa860 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.060234:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217184.060235:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217184.060237:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217184.060366:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782217184.060851:0:18701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782217184.060858:0:18701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0a775c4/0x92b8e04cbf5fa867 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.060868:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=547s v=(0 0) 00010000:00010000:0.0:1782217184.060871:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217184.060875:0:18701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0a775c4/0x92b8e04cbf5fa867 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.060884:0:18701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0a775c4/0x92b8e04cbf5fa867 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.060892:0:18701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0a775c4/0x92b8e04cbf5fa867 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.060899:0:18701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0a775c4/0x92b8e04cbf5fa867 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.060918:0:18701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782217184.061035:0:17182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782217184.061041:0:17182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0a775c4/0x92b8e04cbf5fa867 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.061050:0:17182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e40031c00 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:1.0:1782217184.061054:0:17182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0a775c4/0x92b8e04cbf5fa867 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.061062:0:17182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0a775c4/0x92b8e04cbf5fa867 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.061075:0:17182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0a775c4/0x92b8e04cbf5fa867 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.061083:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0a775c4/0x92b8e04cbf5fa867 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.061098:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217184.061100:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217184.061102:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782217184.061500:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782217184.061507:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079148b0b/0x92b8e04cbf5fa86e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.061515:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=547s v=(0 0) 00010000:00010000:3.0:1782217184.061519:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217184.061523:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079148b0b/0x92b8e04cbf5fa86e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.061533:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079148b0b/0x92b8e04cbf5fa86e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.061549:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079148b0b/0x92b8e04cbf5fa86e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.061556:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079148b0b/0x92b8e04cbf5fa86e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.061577:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782217184.061744:0:17183:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782217184.061750:0:17183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079148b0b/0x92b8e04cbf5fa86e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.061770:0:17183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e41680000 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:1.0:1782217184.061774:0:17183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079148b0b/0x92b8e04cbf5fa86e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.061796:0:17183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079148b0b/0x92b8e04cbf5fa86e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.061811:0:17183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079148b0b/0x92b8e04cbf5fa86e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.061828:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079148b0b/0x92b8e04cbf5fa86e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782217184.061831:0:18701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782217184.061842:0:18701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008e2888b/0x92b8e04cbf5fa875 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.061852:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=547s v=(0 0) 00010000:00010000:1.0:1782217184.061857:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217184.061860:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217184.061863:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217184.061865:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217184.061871:0:18701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008e2888b/0x92b8e04cbf5fa875 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.061882:0:18701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008e2888b/0x92b8e04cbf5fa875 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.061892:0:18701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008e2888b/0x92b8e04cbf5fa875 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.061899:0:18701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008e2888b/0x92b8e04cbf5fa875 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.061968:0:18701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1782217184.062292:0:18701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782217184.062297:0:18701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9e2e10a/0x92b8e04cbf5fa87c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.062305:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=547s v=(0 0) 00010000:00010000:0.0:1782217184.062307:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217184.062323:0:18701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9e2e10a/0x92b8e04cbf5fa87c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.062331:0:18701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9e2e10a/0x92b8e04cbf5fa87c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.062348:0:18701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9e2e10a/0x92b8e04cbf5fa87c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782217184.062363:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782217184.062370:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000493df36f/0x92b8e04cbf5fa883 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.062372:0:18701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9e2e10a/0x92b8e04cbf5fa87c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.062390:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=547s v=(0 0) 00010000:00010000:3.0:1782217184.062395:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217184.062399:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000493df36f/0x92b8e04cbf5fa883 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.062409:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000493df36f/0x92b8e04cbf5fa883 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.062418:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000493df36f/0x92b8e04cbf5fa883 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.062425:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000493df36f/0x92b8e04cbf5fa883 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.062713:0:18349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1782217184.062720:0:18349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008e2888b/0x92b8e04cbf5fa875 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.062727:0:18349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e40030c00 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:1.0:1782217184.062731:0:18349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008e2888b/0x92b8e04cbf5fa875 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.062739:0:18349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008e2888b/0x92b8e04cbf5fa875 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.062752:0:18349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008e2888b/0x92b8e04cbf5fa875 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.062769:0:18349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008e2888b/0x92b8e04cbf5fa875 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.062784:0:18349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782217184.062787:0:18349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9e2e10a/0x92b8e04cbf5fa87c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.062793:0:18349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e40030a00 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:1.0:1782217184.062796:0:18349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9e2e10a/0x92b8e04cbf5fa87c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.062802:0:18349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9e2e10a/0x92b8e04cbf5fa87c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.062811:0:18349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9e2e10a/0x92b8e04cbf5fa87c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.062817:0:18349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782217184.062819:0:18349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000493df36f/0x92b8e04cbf5fa883 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.062825:0:18349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e41680200 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:1.0:1782217184.062827:0:18349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000493df36f/0x92b8e04cbf5fa883 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.062843:0:18349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000493df36f/0x92b8e04cbf5fa883 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.062853:0:18349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000493df36f/0x92b8e04cbf5fa883 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.062860:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217184.062861:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217184.062863:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217184.063595:0:18701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1782217184.063602:0:18701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9e2e10a/0x92b8e04cbf5fa87c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782217184.063937:0:18701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782217184.063944:0:18701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e145038/0x92b8e04cbf5fa88a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.063954:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=547s v=(0 0) 00010000:00010000:0.0:1782217184.063958:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217184.063963:0:18701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e145038/0x92b8e04cbf5fa88a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.063975:0:18701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e145038/0x92b8e04cbf5fa88a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.063984:0:18701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e145038/0x92b8e04cbf5fa88a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.063992:0:18701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e145038/0x92b8e04cbf5fa88a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.064017:0:18701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782217184.064242:0:17182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782217184.064248:0:17182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e145038/0x92b8e04cbf5fa88a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.064256:0:17182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e40030800 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:0.0:1782217184.064260:0:17182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e145038/0x92b8e04cbf5fa88a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.064270:0:17182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e145038/0x92b8e04cbf5fa88a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.064284:0:17182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e145038/0x92b8e04cbf5fa88a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.064291:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e145038/0x92b8e04cbf5fa88a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.064305:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217184.064307:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217184.064493:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782217184.065503:0:18701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782217184.065513:0:18701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ced0a8d/0x92b8e04cbf5fa891 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.065525:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=547s v=(0 0) 00010000:00010000:0.0:1782217184.065533:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217184.065538:0:18701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ced0a8d/0x92b8e04cbf5fa891 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.065550:0:18701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ced0a8d/0x92b8e04cbf5fa891 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.065558:0:18701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ced0a8d/0x92b8e04cbf5fa891 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.065566:0:18701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ced0a8d/0x92b8e04cbf5fa891 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.065596:0:18701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782217184.065629:0:18349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782217184.065635:0:18349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ced0a8d/0x92b8e04cbf5fa891 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.065642:0:18349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d42342600 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:0.0:1782217184.065646:0:18349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ced0a8d/0x92b8e04cbf5fa891 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.065655:0:18349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ced0a8d/0x92b8e04cbf5fa891 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.065670:0:18349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ced0a8d/0x92b8e04cbf5fa891 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.065698:0:18349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ced0a8d/0x92b8e04cbf5fa891 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.065719:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217184.065721:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217184.065723:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217184.065981:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1782217184.065989:0:18700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000493df36f/0x92b8e04cbf5fa883 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.066236:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217184.066491:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782217184.067886:0:18701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782217184.067897:0:18701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f3ae206/0x92b8e04cbf5fa898 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782217184.067902:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782217184.067916:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d15b8f7d/0x92b8e04cbf5fa89f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.067920:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=547s v=(0 0) 00010000:00010000:0.0:1782217184.067930:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217184.067933:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=547s v=(0 0) 00010000:00010000:0.0:1782217184.067937:0:18701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f3ae206/0x92b8e04cbf5fa898 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.067938:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217184.067948:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d15b8f7d/0x92b8e04cbf5fa89f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.067957:0:18701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f3ae206/0x92b8e04cbf5fa898 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.067962:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d15b8f7d/0x92b8e04cbf5fa89f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.067973:0:18701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f3ae206/0x92b8e04cbf5fa898 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.067976:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d15b8f7d/0x92b8e04cbf5fa89f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.067993:0:18701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f3ae206/0x92b8e04cbf5fa898 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.067995:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d15b8f7d/0x92b8e04cbf5fa89f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.068027:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1782217184.068633:0:18701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1782217184.068771:0:17182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782217184.068778:0:17182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d15b8f7d/0x92b8e04cbf5fa89f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.068788:0:17182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e41681e00 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:0.0:1782217184.068794:0:17182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d15b8f7d/0x92b8e04cbf5fa89f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.068804:0:17182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d15b8f7d/0x92b8e04cbf5fa89f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.068821:0:17182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d15b8f7d/0x92b8e04cbf5fa89f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.068829:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d15b8f7d/0x92b8e04cbf5fa89f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.068846:0:17182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782217184.068850:0:17182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f3ae206/0x92b8e04cbf5fa898 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.068856:0:17182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d42342400 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:0.0:1782217184.068859:0:17182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f3ae206/0x92b8e04cbf5fa898 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.068866:0:17182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f3ae206/0x92b8e04cbf5fa898 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.068887:0:17182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f3ae206/0x92b8e04cbf5fa898 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.068895:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f3ae206/0x92b8e04cbf5fa898 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.068914:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217184.068917:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217184.068919:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217184.068926:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782217184.069031:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782217184.069038:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d98d0166/0x92b8e04cbf5fa8a6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.069054:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=547s v=(0 0) 00010000:00010000:3.0:1782217184.069058:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217184.069063:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d98d0166/0x92b8e04cbf5fa8a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.069073:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d98d0166/0x92b8e04cbf5fa8a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.069081:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d98d0166/0x92b8e04cbf5fa8a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.069089:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d98d0166/0x92b8e04cbf5fa8a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.069110:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1782217184.069560:0:18701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782217184.069567:0:18701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002df1a088/0x92b8e04cbf5fa8ad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.069575:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=547s v=(0 0) 00010000:00010000:0.0:1782217184.069578:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217184.069600:0:18701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002df1a088/0x92b8e04cbf5fa8ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.069610:0:18701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002df1a088/0x92b8e04cbf5fa8ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.069619:0:18701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002df1a088/0x92b8e04cbf5fa8ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.069627:0:18701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002df1a088/0x92b8e04cbf5fa8ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.069645:0:18701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1782217184.069733:0:17183:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782217184.069739:0:17183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d98d0166/0x92b8e04cbf5fa8a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.069748:0:17183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b363600 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:1.0:1782217184.069751:0:17183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d98d0166/0x92b8e04cbf5fa8a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782217184.069876:0:18701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782217184.069883:0:18701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b11d77b/0x92b8e04cbf5fa8b4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.069891:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=547s v=(0 0) 00010000:00010000:0.0:1782217184.069896:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217184.069904:0:18701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b11d77b/0x92b8e04cbf5fa8b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.069911:0:17183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d98d0166/0x92b8e04cbf5fa8a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.069916:0:18701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b11d77b/0x92b8e04cbf5fa8b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.069932:0:18701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b11d77b/0x92b8e04cbf5fa8b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.069934:0:17183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d98d0166/0x92b8e04cbf5fa8a6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.069945:0:18701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b11d77b/0x92b8e04cbf5fa8b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.069950:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d98d0166/0x92b8e04cbf5fa8a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.069964:0:18701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1782217184.069986:0:17183:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782217184.069990:0:17183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002df1a088/0x92b8e04cbf5fa8ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.069997:0:17183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d42343000 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:1.0:1782217184.070001:0:17183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002df1a088/0x92b8e04cbf5fa8ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.070009:0:17183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002df1a088/0x92b8e04cbf5fa8ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.070020:0:17183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002df1a088/0x92b8e04cbf5fa8ad lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.070027:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002df1a088/0x92b8e04cbf5fa8ad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.070048:0:17183:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782217184.070052:0:17183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b11d77b/0x92b8e04cbf5fa8b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.070059:0:17183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d42343800 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:1.0:1782217184.070063:0:17183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b11d77b/0x92b8e04cbf5fa8b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.070083:0:17183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b11d77b/0x92b8e04cbf5fa8b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.070094:0:17183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b11d77b/0x92b8e04cbf5fa8b4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.070102:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b11d77b/0x92b8e04cbf5fa8b4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.070117:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217184.070118:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217184.070120:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217184.070291:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217184.070297:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782217184.070948:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782217184.070957:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d61ab3ab/0x92b8e04cbf5fa8bb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.070968:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=547s v=(0 0) 00010000:00010000:3.0:1782217184.070971:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217184.070975:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d61ab3ab/0x92b8e04cbf5fa8bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.070986:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d61ab3ab/0x92b8e04cbf5fa8bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.071008:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d61ab3ab/0x92b8e04cbf5fa8bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.071015:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d61ab3ab/0x92b8e04cbf5fa8bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.071028:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1782217184.071776:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782217184.071784:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a08edc57/0x92b8e04cbf5fa8c2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.071793:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=547s v=(0 0) 00010000:00010000:3.0:1782217184.071797:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217184.071801:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a08edc57/0x92b8e04cbf5fa8c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.071812:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a08edc57/0x92b8e04cbf5fa8c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.071820:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a08edc57/0x92b8e04cbf5fa8c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.071827:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a08edc57/0x92b8e04cbf5fa8c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.071857:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1782217184.072020:0:18349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782217184.072027:0:18349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d61ab3ab/0x92b8e04cbf5fa8bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.072045:0:18349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b363800 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:0.0:1782217184.072050:0:18349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d61ab3ab/0x92b8e04cbf5fa8bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.072059:0:18349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d61ab3ab/0x92b8e04cbf5fa8bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.072073:0:18349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d61ab3ab/0x92b8e04cbf5fa8bb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.072080:0:18349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d61ab3ab/0x92b8e04cbf5fa8bb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.072095:0:18349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782217184.072098:0:18349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a08edc57/0x92b8e04cbf5fa8c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.072103:0:18349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b363400 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:0.0:1782217184.072106:0:18349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a08edc57/0x92b8e04cbf5fa8c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.072112:0:18349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a08edc57/0x92b8e04cbf5fa8c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.072121:0:18349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a08edc57/0x92b8e04cbf5fa8c2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.072134:0:18349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a08edc57/0x92b8e04cbf5fa8c2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.072144:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217184.072146:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217184.072148:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217184.072806:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782217184.072935:0:18701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782217184.072945:0:18701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095d431ac/0x92b8e04cbf5fa8c9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.072957:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=547s v=(0 0) 00010000:00010000:1.0:1782217184.072961:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217184.072966:0:18701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095d431ac/0x92b8e04cbf5fa8c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.072979:0:18701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095d431ac/0x92b8e04cbf5fa8c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.072988:0:18701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095d431ac/0x92b8e04cbf5fa8c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.073004:0:18701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095d431ac/0x92b8e04cbf5fa8c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.073020:0:18701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782217184.073457:0:17182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782217184.073463:0:17182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095d431ac/0x92b8e04cbf5fa8c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.073473:0:17182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43073e00 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:0.0:1782217184.073477:0:17182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095d431ac/0x92b8e04cbf5fa8c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.073484:0:17182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095d431ac/0x92b8e04cbf5fa8c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.073497:0:17182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095d431ac/0x92b8e04cbf5fa8c9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.073505:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095d431ac/0x92b8e04cbf5fa8c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.073523:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217184.073525:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217184.073527:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782217184.076072:0:18701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:1.0:1782217184.076072:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782217184.076091:0:18701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc63a196/0x92b8e04cbf5fa8d7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.076092:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3f31dac/0x92b8e04cbf5fa8d0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.076120:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=547s v=(0 0) 00010000:00010000:1.0:1782217184.076121:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=547s v=(0 0) 00010000:00010000:3.0:1782217184.076130:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217184.076131:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217184.076144:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3f31dac/0x92b8e04cbf5fa8d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.076145:0:18701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc63a196/0x92b8e04cbf5fa8d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.076166:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3f31dac/0x92b8e04cbf5fa8d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.076178:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3f31dac/0x92b8e04cbf5fa8d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.076186:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3f31dac/0x92b8e04cbf5fa8d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.076202:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782217184.076235:0:18701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc63a196/0x92b8e04cbf5fa8d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.076246:0:18701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc63a196/0x92b8e04cbf5fa8d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.076254:0:18701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc63a196/0x92b8e04cbf5fa8d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.076277:0:18701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1782217184.076287:0:17183:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782217184.076295:0:17183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3f31dac/0x92b8e04cbf5fa8d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.076317:0:17183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43072400 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:1.0:1782217184.076321:0:17183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3f31dac/0x92b8e04cbf5fa8d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.076331:0:17183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3f31dac/0x92b8e04cbf5fa8d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.076347:0:17183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3f31dac/0x92b8e04cbf5fa8d0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.076354:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3f31dac/0x92b8e04cbf5fa8d0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.076373:0:17183:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782217184.076377:0:17183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc63a196/0x92b8e04cbf5fa8d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.076382:0:17183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362600 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:1.0:1782217184.076386:0:17183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc63a196/0x92b8e04cbf5fa8d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.076393:0:17183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc63a196/0x92b8e04cbf5fa8d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.076403:0:17183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc63a196/0x92b8e04cbf5fa8d7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.076416:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc63a196/0x92b8e04cbf5fa8d7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.076430:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217184.076432:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217184.076434:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217184.076878:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782217184.077001:0:19516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1782217184.077020:0:19516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1782217184.077025:0:19516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1782217184.077161:0:19412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17938:x1868789713142784:12345-0@lo:5:osp-pre-1-1.0 Request processed in 47868us (48002us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1782217184.077174:0:19412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782217184.077225:0:17938:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1782217184.077234:0:17938:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43e91c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17938:1868789713142784:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1782217184.077250:0:17938:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1782217184.077304:0:17938:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17938:1868789713142912:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1782217184.077339:0:17938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217184.077364:0:17938:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e46069180 going to sleep for 11 seconds 00000100:00100000:0.0:1782217184.077384:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713142912 00000100:00100000:0.0:1782217184.077390:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713142912 00000100:00100000:0.0:1782217184.077424:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782217184.077432:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17938:x1868789713142912:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1782217184.077477:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17938:x1868789713142912:12345-0@lo:900:osp-pre-1-1.0 Request processed in 45us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217184.077484:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1782217184.077515:0:17938:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d41be5880 x1868789713142912/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1782217200 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782217184.077539:0:17938:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17938:1868789713142912:0@lo:900:osp-pre-1-1.0 00002000:00010000:3.0:1782217184.077887:0:18701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782217184.077895:0:18701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000482b05eb/0x92b8e04cbf5fa8de lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.077908:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=547s v=(0 0) 00010000:00010000:3.0:1782217184.077920:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217184.077926:0:18701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000482b05eb/0x92b8e04cbf5fa8de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.077940:0:18701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000482b05eb/0x92b8e04cbf5fa8de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782217184.077940:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782217184.077952:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080baf22b/0x92b8e04cbf5fa8e5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.077956:0:18701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000482b05eb/0x92b8e04cbf5fa8de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.077970:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=547s v=(0 0) 00010000:00010000:3.0:1782217184.077972:0:18701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000482b05eb/0x92b8e04cbf5fa8de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.077976:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217184.077984:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080baf22b/0x92b8e04cbf5fa8e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.077994:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080baf22b/0x92b8e04cbf5fa8e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.078002:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080baf22b/0x92b8e04cbf5fa8e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.078008:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080baf22b/0x92b8e04cbf5fa8e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.078025:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782217184.078198:0:17182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782217184.078205:0:17182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080baf22b/0x92b8e04cbf5fa8e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.078225:0:17182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43073400 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:0.0:1782217184.078229:0:17182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080baf22b/0x92b8e04cbf5fa8e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.078238:0:17182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080baf22b/0x92b8e04cbf5fa8e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.078254:0:17182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080baf22b/0x92b8e04cbf5fa8e5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.078261:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080baf22b/0x92b8e04cbf5fa8e5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.078278:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217184.078280:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217184.078282:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217184.078552:0:18701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1782217184.079709:0:18701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782217184.079721:0:18701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2cc0ea2/0x92b8e04cbf5fa8ec lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.079734:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=547s v=(0 0) 00010000:00010000:3.0:1782217184.079738:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217184.079743:0:18701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2cc0ea2/0x92b8e04cbf5fa8ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.079754:0:18701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2cc0ea2/0x92b8e04cbf5fa8ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.079818:0:18701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2cc0ea2/0x92b8e04cbf5fa8ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.079836:0:18701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2cc0ea2/0x92b8e04cbf5fa8ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.079855:0:18701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1782217184.079958:0:17183:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782217184.079972:0:17183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000482b05eb/0x92b8e04cbf5fa8de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.079982:0:17183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b363000 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:1.0:1782217184.079986:0:17183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000482b05eb/0x92b8e04cbf5fa8de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.079997:0:17183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000482b05eb/0x92b8e04cbf5fa8de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.080013:0:17183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000482b05eb/0x92b8e04cbf5fa8de lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.080021:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000482b05eb/0x92b8e04cbf5fa8de lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.080037:0:17183:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782217184.080041:0:17183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2cc0ea2/0x92b8e04cbf5fa8ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.080047:0:17183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b363200 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:1.0:1782217184.080050:0:17183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2cc0ea2/0x92b8e04cbf5fa8ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.080058:0:17183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2cc0ea2/0x92b8e04cbf5fa8ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.080078:0:17183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2cc0ea2/0x92b8e04cbf5fa8ec lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.080086:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2cc0ea2/0x92b8e04cbf5fa8ec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.080098:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217184.080100:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217184.080101:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782217184.080145:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782217184.080151:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa3ca814/0x92b8e04cbf5fa8f3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.080158:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=547s v=(0 0) 00010000:00010000:1.0:1782217184.080162:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782217184.080167:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa3ca814/0x92b8e04cbf5fa8f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.080176:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa3ca814/0x92b8e04cbf5fa8f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.080185:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa3ca814/0x92b8e04cbf5fa8f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.080193:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa3ca814/0x92b8e04cbf5fa8f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.080215:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1782217184.081336:0:18701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782217184.081354:0:18701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000922e59ac/0x92b8e04cbf5fa8fa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.081434:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=547s v=(0 0) 00010000:00010000:3.0:1782217184.081439:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217184.081444:0:18701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000922e59ac/0x92b8e04cbf5fa8fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.081457:0:18701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000922e59ac/0x92b8e04cbf5fa8fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.081467:0:18701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000922e59ac/0x92b8e04cbf5fa8fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.081475:0:18701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000922e59ac/0x92b8e04cbf5fa8fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.081494:0:18701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1782217184.082518:0:18701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782217184.082528:0:18701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e28f3b8f/0x92b8e04cbf5fa901 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.082548:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=547s v=(0 0) 00010000:00010000:3.0:1782217184.082552:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217184.082557:0:18701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e28f3b8f/0x92b8e04cbf5fa901 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.082569:0:18701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e28f3b8f/0x92b8e04cbf5fa901 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.082578:0:18701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e28f3b8f/0x92b8e04cbf5fa901 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.082604:0:18701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e28f3b8f/0x92b8e04cbf5fa901 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.082615:0:18701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1782217184.084079:0:17183:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1782217184.084090:0:17183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa3ca814/0x92b8e04cbf5fa8f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.084104:0:17183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121cc00 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:1.0:1782217184.084109:0:17183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa3ca814/0x92b8e04cbf5fa8f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.084121:0:17183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa3ca814/0x92b8e04cbf5fa8f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.084142:0:17183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa3ca814/0x92b8e04cbf5fa8f3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.084150:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa3ca814/0x92b8e04cbf5fa8f3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.084168:0:17183:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782217184.084172:0:17183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000922e59ac/0x92b8e04cbf5fa8fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.084179:0:17183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362800 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:1.0:1782217184.084183:0:17183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000922e59ac/0x92b8e04cbf5fa8fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.084207:0:17183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000922e59ac/0x92b8e04cbf5fa8fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.084219:0:17183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000922e59ac/0x92b8e04cbf5fa8fa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.084226:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000922e59ac/0x92b8e04cbf5fa8fa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.084239:0:17183:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782217184.084243:0:17183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e28f3b8f/0x92b8e04cbf5fa901 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.084249:0:17183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b363a00 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:1.0:1782217184.084252:0:17183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e28f3b8f/0x92b8e04cbf5fa901 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782217184.084262:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782217184.084262:0:17183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e28f3b8f/0x92b8e04cbf5fa901 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.084274:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad07254c/0x92b8e04cbf5fa908 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.084279:0:17183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e28f3b8f/0x92b8e04cbf5fa901 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.084290:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=547s v=(0 0) 00010000:00010000:1.0:1782217184.084293:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e28f3b8f/0x92b8e04cbf5fa901 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.084297:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217184.084307:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad07254c/0x92b8e04cbf5fa908 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.084323:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217184.084326:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217184.084329:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217184.084334:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad07254c/0x92b8e04cbf5fa908 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.084650:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad07254c/0x92b8e04cbf5fa908 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.084661:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad07254c/0x92b8e04cbf5fa908 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.084680:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1782217184.084744:0:18701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782217184.084753:0:18701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078fbfed6/0x92b8e04cbf5fa90f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.084763:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=547s v=(0 0) 00010000:00010000:2.0:1782217184.084773:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782217184.084777:0:18701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078fbfed6/0x92b8e04cbf5fa90f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.084787:0:18701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078fbfed6/0x92b8e04cbf5fa90f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.084795:0:18701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078fbfed6/0x92b8e04cbf5fa90f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.084801:0:18701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078fbfed6/0x92b8e04cbf5fa90f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.084824:0:18701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1782217184.085049:0:18349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782217184.085055:0:18349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad07254c/0x92b8e04cbf5fa908 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.085064:0:18349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362200 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:0.0:1782217184.085069:0:18349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad07254c/0x92b8e04cbf5fa908 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.085078:0:18349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad07254c/0x92b8e04cbf5fa908 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.085096:0:18349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad07254c/0x92b8e04cbf5fa908 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.085103:0:18349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad07254c/0x92b8e04cbf5fa908 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.085116:0:18349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782217184.085120:0:18349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078fbfed6/0x92b8e04cbf5fa90f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.085126:0:18349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2c000 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:0.0:1782217184.085129:0:18349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078fbfed6/0x92b8e04cbf5fa90f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.085136:0:18349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078fbfed6/0x92b8e04cbf5fa90f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.085146:0:18349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078fbfed6/0x92b8e04cbf5fa90f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.085153:0:18349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078fbfed6/0x92b8e04cbf5fa90f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.085164:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217184.085166:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217184.085172:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217184.085180:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217184.085645:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782217184.085677:0:18701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782217184.085693:0:18701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f2b26c7/0x92b8e04cbf5fa916 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.085702:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=547s v=(0 0) 00010000:00010000:2.0:1782217184.085706:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782217184.085710:0:18701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f2b26c7/0x92b8e04cbf5fa916 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.085720:0:18701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f2b26c7/0x92b8e04cbf5fa916 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.085728:0:18701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f2b26c7/0x92b8e04cbf5fa916 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.085743:0:18701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f2b26c7/0x92b8e04cbf5fa916 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.085803:0:18701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1782217184.085938:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782217184.085944:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f20b707a/0x92b8e04cbf5fa91d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.085953:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=547s v=(0 0) 00010000:00010000:3.0:1782217184.085956:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217184.085961:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f20b707a/0x92b8e04cbf5fa91d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.085970:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f20b707a/0x92b8e04cbf5fa91d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.085978:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f20b707a/0x92b8e04cbf5fa91d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.085986:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f20b707a/0x92b8e04cbf5fa91d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782217184.087458:0:18701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782217184.087469:0:18701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfa93e61/0x92b8e04cbf5fa924 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.087482:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=547s v=(0 0) 00010000:00010000:2.0:1782217184.087486:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782217184.087492:0:18701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cfa93e61/0x92b8e04cbf5fa924 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.087503:0:18701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cfa93e61/0x92b8e04cbf5fa924 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.087511:0:18701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfa93e61/0x92b8e04cbf5fa924 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.087519:0:18701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cfa93e61/0x92b8e04cbf5fa924 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.087698:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1782217184.087699:0:18349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1782217184.087708:0:18349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f2b26c7/0x92b8e04cbf5fa916 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.087716:0:18349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2dc00 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:0.0:1782217184.087720:0:18349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f2b26c7/0x92b8e04cbf5fa916 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.087729:0:18349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f2b26c7/0x92b8e04cbf5fa916 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.087747:0:18349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f2b26c7/0x92b8e04cbf5fa916 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.087755:0:18349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f2b26c7/0x92b8e04cbf5fa916 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.087771:0:18349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782217184.087775:0:18349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f20b707a/0x92b8e04cbf5fa91d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.087782:0:18349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362400 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:0.0:1782217184.087785:0:18349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f20b707a/0x92b8e04cbf5fa91d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.087807:0:18349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f20b707a/0x92b8e04cbf5fa91d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.087835:0:18349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f20b707a/0x92b8e04cbf5fa91d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.087842:0:18349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f20b707a/0x92b8e04cbf5fa91d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.087857:0:18349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782217184.087861:0:18349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cfa93e61/0x92b8e04cbf5fa924 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.087867:0:18349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2ca00 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:0.0:1782217184.087870:0:18349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfa93e61/0x92b8e04cbf5fa924 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.087877:0:18349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfa93e61/0x92b8e04cbf5fa924 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.087886:0:18349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cfa93e61/0x92b8e04cbf5fa924 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.087894:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217184.087895:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217184.087903:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217184.087911:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782217184.088102:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782217184.088109:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005da6ed1a/0x92b8e04cbf5fa92b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.088119:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=547s v=(0 0) 00010000:00010000:3.0:1782217184.088122:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217184.088127:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005da6ed1a/0x92b8e04cbf5fa92b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.088137:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005da6ed1a/0x92b8e04cbf5fa92b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.088145:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005da6ed1a/0x92b8e04cbf5fa92b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.088153:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005da6ed1a/0x92b8e04cbf5fa92b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.088227:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782217184.088531:0:18701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782217184.088537:0:18701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cfa93e61/0x92b8e04cbf5fa924 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782217184.088771:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782217184.088778:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009662639c/0x92b8e04cbf5fa932 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.088786:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=547s v=(0 0) 00010000:00010000:3.0:1782217184.088794:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217184.088798:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009662639c/0x92b8e04cbf5fa932 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.088807:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009662639c/0x92b8e04cbf5fa932 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.088816:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009662639c/0x92b8e04cbf5fa932 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.088823:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009662639c/0x92b8e04cbf5fa932 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.088837:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1782217184.088914:0:17182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782217184.088920:0:17182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005da6ed1a/0x92b8e04cbf5fa92b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.088929:0:17182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362c00 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:2.0:1782217184.088932:0:17182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005da6ed1a/0x92b8e04cbf5fa92b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.088941:0:17182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005da6ed1a/0x92b8e04cbf5fa92b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.088953:0:17182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005da6ed1a/0x92b8e04cbf5fa92b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.088960:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005da6ed1a/0x92b8e04cbf5fa92b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.088973:0:17182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782217184.088976:0:17182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009662639c/0x92b8e04cbf5fa932 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.088983:0:17182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362e00 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:2.0:1782217184.088986:0:17182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009662639c/0x92b8e04cbf5fa932 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.089006:0:17182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009662639c/0x92b8e04cbf5fa932 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.089016:0:17182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009662639c/0x92b8e04cbf5fa932 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.089023:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009662639c/0x92b8e04cbf5fa932 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.089034:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217184.089036:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782217184.089037:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782217184.089082:0:18701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782217184.089088:0:18701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee7eda8a/0x92b8e04cbf5fa939 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.089096:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=547s v=(0 0) 00010000:00010000:2.0:1782217184.089099:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782217184.089104:0:18701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee7eda8a/0x92b8e04cbf5fa939 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.089113:0:18701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee7eda8a/0x92b8e04cbf5fa939 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.089120:0:18701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee7eda8a/0x92b8e04cbf5fa939 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.089134:0:18701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee7eda8a/0x92b8e04cbf5fa939 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.089156:0:18701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782217184.089236:0:17182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782217184.089242:0:17182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee7eda8a/0x92b8e04cbf5fa939 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.089250:0:17182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2de00 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:3.0:1782217184.089254:0:17182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee7eda8a/0x92b8e04cbf5fa939 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.089263:0:17182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee7eda8a/0x92b8e04cbf5fa939 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.089275:0:17182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee7eda8a/0x92b8e04cbf5fa939 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.089294:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee7eda8a/0x92b8e04cbf5fa939 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.089307:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217184.089533:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217184.090004:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782217184.090098:0:18701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782217184.090106:0:18701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f3ae206/0x92b8e04cbf5fa940 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.090117:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=547s v=(0 0) 00010000:00010000:0.0:1782217184.090121:0:18701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217184.090126:0:18701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f3ae206/0x92b8e04cbf5fa940 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.090137:0:18701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f3ae206/0x92b8e04cbf5fa940 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.090146:0:18701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f3ae206/0x92b8e04cbf5fa940 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.090155:0:18701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f3ae206/0x92b8e04cbf5fa940 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.090176:0:18701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1782217184.090238:0:18701:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00010000:00010000:3.0:1782217184.090251:0:17182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782217184.090258:0:17182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f3ae206/0x92b8e04cbf5fa940 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.090266:0:17182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d42342400 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:3.0:1782217184.090271:0:17182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f3ae206/0x92b8e04cbf5fa940 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.090279:0:17182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f3ae206/0x92b8e04cbf5fa940 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.090293:0:17182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f3ae206/0x92b8e04cbf5fa940 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.090300:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f3ae206/0x92b8e04cbf5fa940 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217184.090323:0:18701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17221:x1868789713142272:12345-0@lo:5:osp-pre-1-0.0 Request processed in 91580us (93955us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217184.090332:0:18701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782217184.090379:0:17221:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17221:1868789713142272:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1782217184.090393:0:17221:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:0.0:1782217184.090449:0:17221:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17221:1868789713143040:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1782217184.090480:0:17221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217184.090502:0:17221:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e46069a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782217184.090518:0:18701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713143040 00000100:00100000:0.0:1782217184.090524:0:18701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713143040 00000100:00100000:0.0:1782217184.090559:0:18701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782217184.090566:0:18701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17221:x1868789713143040:12345-0@lo:5:osp-pre-1-0.0 00010000:00010000:3.0:1782217184.090613:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217184.090616:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217184.090619:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1782217184.090625:0:18701:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00002000:00010000:3.0:1782217184.090673:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782217184.090680:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002483e12d/0x92b8e04cbf5fa947 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.090705:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=547s v=(0 0) 00010000:00010000:3.0:1782217184.090709:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217184.090713:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002483e12d/0x92b8e04cbf5fa947 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.090725:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002483e12d/0x92b8e04cbf5fa947 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.090732:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002483e12d/0x92b8e04cbf5fa947 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.090739:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002483e12d/0x92b8e04cbf5fa947 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.090759:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1782217184.091369:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782217184.091376:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dccba7fd/0x92b8e04cbf5fa94e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.091385:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=547s v=(0 0) 00010000:00010000:3.0:1782217184.091389:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217184.091393:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dccba7fd/0x92b8e04cbf5fa94e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.091403:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dccba7fd/0x92b8e04cbf5fa94e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.091423:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dccba7fd/0x92b8e04cbf5fa94e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.091500:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dccba7fd/0x92b8e04cbf5fa94e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.091517:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1782217184.091526:0:17182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782217184.091531:0:17182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002483e12d/0x92b8e04cbf5fa947 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.091538:0:17182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362a00 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:3.0:1782217184.091542:0:17182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002483e12d/0x92b8e04cbf5fa947 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.091550:0:17182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002483e12d/0x92b8e04cbf5fa947 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.091562:0:17182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002483e12d/0x92b8e04cbf5fa947 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.091570:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002483e12d/0x92b8e04cbf5fa947 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.091605:0:17182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782217184.091614:0:17182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dccba7fd/0x92b8e04cbf5fa94e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.091622:0:17182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b363e00 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:3.0:1782217184.091625:0:17182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dccba7fd/0x92b8e04cbf5fa94e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.091632:0:17182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dccba7fd/0x92b8e04cbf5fa94e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.091642:0:17182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dccba7fd/0x92b8e04cbf5fa94e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.091649:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dccba7fd/0x92b8e04cbf5fa94e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.091659:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217184.091661:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217184.091663:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217184.093122:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217184.093274:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782217184.094730:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782217184.094743:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efe3273f/0x92b8e04cbf5fa955 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.094759:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=547s v=(0 0) 00010000:00010000:3.0:1782217184.094763:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217184.094768:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efe3273f/0x92b8e04cbf5fa955 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.094793:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efe3273f/0x92b8e04cbf5fa955 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.094803:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efe3273f/0x92b8e04cbf5fa955 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.094812:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efe3273f/0x92b8e04cbf5fa955 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.094829:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782217184.094840:0:17182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782217184.094845:0:17182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efe3273f/0x92b8e04cbf5fa955 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.094853:0:17182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b363c00 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:3.0:1782217184.094858:0:17182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efe3273f/0x92b8e04cbf5fa955 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.094867:0:17182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efe3273f/0x92b8e04cbf5fa955 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.094883:0:17182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efe3273f/0x92b8e04cbf5fa955 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.094890:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efe3273f/0x92b8e04cbf5fa955 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.094918:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217184.094920:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217184.094922:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782217184.097219:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782217184.097231:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d7576ff/0x92b8e04cbf5fa95c lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.097245:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=547s v=(0 0) 00010000:00010000:3.0:1782217184.097249:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217184.097254:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d7576ff/0x92b8e04cbf5fa95c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.097278:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d7576ff/0x92b8e04cbf5fa95c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.097289:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d7576ff/0x92b8e04cbf5fa95c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.097296:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d7576ff/0x92b8e04cbf5fa95c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.097317:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1782217184.098490:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782217184.098500:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f20b707a/0x92b8e04cbf5fa963 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.098523:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=547s v=(0 0) 00010000:00010000:3.0:1782217184.098528:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217184.098532:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f20b707a/0x92b8e04cbf5fa963 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.098544:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f20b707a/0x92b8e04cbf5fa963 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.098553:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f20b707a/0x92b8e04cbf5fa963 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.098562:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f20b707a/0x92b8e04cbf5fa963 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.098580:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1782217184.098614:0:18349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782217184.098619:0:18349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d7576ff/0x92b8e04cbf5fa95c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.098627:0:18349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362000 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:3.0:1782217184.098632:0:18349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d7576ff/0x92b8e04cbf5fa95c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.098641:0:18349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d7576ff/0x92b8e04cbf5fa95c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.098669:0:18349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d7576ff/0x92b8e04cbf5fa95c lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.098677:0:18349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d7576ff/0x92b8e04cbf5fa95c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.098705:0:18349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782217184.098708:0:18349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f20b707a/0x92b8e04cbf5fa963 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.098714:0:18349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362400 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:3.0:1782217184.098717:0:18349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f20b707a/0x92b8e04cbf5fa963 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.098725:0:18349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f20b707a/0x92b8e04cbf5fa963 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.098735:0:18349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f20b707a/0x92b8e04cbf5fa963 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.098742:0:18349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f20b707a/0x92b8e04cbf5fa963 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.098754:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217184.098756:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217184.098776:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217184.100054:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782217184.105064:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782217184.105075:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad07254c/0x92b8e04cbf5fa96a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.105093:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=547s v=(0 0) 00010000:00010000:3.0:1782217184.105099:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782217184.105105:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad07254c/0x92b8e04cbf5fa96a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.105119:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad07254c/0x92b8e04cbf5fa96a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.105129:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad07254c/0x92b8e04cbf5fa96a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.105136:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad07254c/0x92b8e04cbf5fa96a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.105150:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782217184.105161:0:17182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782217184.105166:0:17182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad07254c/0x92b8e04cbf5fa96a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.105172:0:17182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362200 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:3.0:1782217184.105176:0:17182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad07254c/0x92b8e04cbf5fa96a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217184.105233:0:18701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17221:x1868789713143040:12345-0@lo:5:osp-pre-1-0.0 Request processed in 14663us (14747us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1782217184.105243:0:18701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1782217184.105272:0:17182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad07254c/0x92b8e04cbf5fa96a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.105344:0:17182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad07254c/0x92b8e04cbf5fa96a lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.105352:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad07254c/0x92b8e04cbf5fa96a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.105374:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217184.105376:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217184.105379:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782217184.105416:0:17221:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17221:1868789713143040:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1782217184.105499:0:17221:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00002000:00010000:2.0:1782217184.107499:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782217184.107515:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfa93e61/0x92b8e04cbf5fa971 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.107530:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=547s v=(0 0) 00010000:00010000:2.0:1782217184.107535:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782217184.107541:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfa93e61/0x92b8e04cbf5fa971 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.107555:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfa93e61/0x92b8e04cbf5fa971 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.107565:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfa93e61/0x92b8e04cbf5fa971 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.107573:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfa93e61/0x92b8e04cbf5fa971 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.107618:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782217184.107907:0:18349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782217184.107915:0:18349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfa93e61/0x92b8e04cbf5fa971 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.107924:0:18349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2ca00 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:3.0:1782217184.107928:0:18349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfa93e61/0x92b8e04cbf5fa971 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.107936:0:18349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfa93e61/0x92b8e04cbf5fa971 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.107954:0:18349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfa93e61/0x92b8e04cbf5fa971 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.107973:0:18349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfa93e61/0x92b8e04cbf5fa971 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217184.107990:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217184.107992:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217184.107993:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782217184.108708:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782217184.108716:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee7eda8a/0x92b8e04cbf5fa978 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.108729:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=547s v=(0 0) 00010000:00010000:2.0:1782217184.108733:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782217184.108738:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee7eda8a/0x92b8e04cbf5fa978 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.108750:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee7eda8a/0x92b8e04cbf5fa978 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.108758:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee7eda8a/0x92b8e04cbf5fa978 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.109349:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee7eda8a/0x92b8e04cbf5fa978 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.109376:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782217184.109497:0:17183:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782217184.109505:0:17183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee7eda8a/0x92b8e04cbf5fa978 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.109513:0:17183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2de00 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:1.0:1782217184.109517:0:17183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee7eda8a/0x92b8e04cbf5fa978 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.109539:0:17183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee7eda8a/0x92b8e04cbf5fa978 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.109555:0:17183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee7eda8a/0x92b8e04cbf5fa978 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.109562:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee7eda8a/0x92b8e04cbf5fa978 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217184.109580:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217184.109616:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217184.109619:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782217184.112741:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782217184.112754:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f2b26c7/0x92b8e04cbf5fa97f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.116392:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=547s v=(0 0) 00010000:00010000:2.0:1782217184.116410:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782217184.116418:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f2b26c7/0x92b8e04cbf5fa97f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.116504:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f2b26c7/0x92b8e04cbf5fa97f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.116519:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f2b26c7/0x92b8e04cbf5fa97f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.116526:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f2b26c7/0x92b8e04cbf5fa97f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217184.116556:0:18700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1782217184.116882:0:18700:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:2.0:1782217184.116982:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17219:x1868789713142016:12345-0@lo:5:osp-pre-0-0.0 Request processed in 118491us (121231us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217184.116992:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782217184.117910:0:17219:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43d91c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17219:1868789713142016:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1782217184.117928:0:17219:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:1.0:1782217184.117974:0:17219:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4441dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17219:1868789713143168:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1782217184.118018:0:17219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217184.118043:0:17219:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e7b1bde40 going to sleep for 11 seconds 00010000:00010000:0.0:1782217184.118185:0:17182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782217184.118194:0:17182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f2b26c7/0x92b8e04cbf5fa97f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.118205:0:17182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2dc00 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:0.0:1782217184.118210:0:17182:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f2b26c7/0x92b8e04cbf5fa97f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.118221:0:17182:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f2b26c7/0x92b8e04cbf5fa97f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.118241:0:17182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f2b26c7/0x92b8e04cbf5fa97f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.118248:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f2b26c7/0x92b8e04cbf5fa97f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217184.118268:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217184.118277:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217184.118278:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782217184.118292:0:19412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713143168 00000100:00100000:0.0:1782217184.118299:0:19412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713143168 00000100:00100000:0.0:1782217184.118340:0:19412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782217184.118348:0:19412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b303800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17219:x1868789713143168:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1782217184.118389:0:19412:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00010000:00010000:0.0:1782217184.122201:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1782217184.146065:0:18697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:1.0:1782217184.146112:0:18697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1782217184.146710:0:19412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b303800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17219:x1868789713143168:12345-0@lo:5:osp-pre-0-0.0 Request processed in 28357us (28686us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1782217184.146722:0:19412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782217184.146771:0:17219:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1782217184.146780:0:17219:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4441dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17219:1868789713143168:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1782217184.146797:0:17219:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:1.0:1782217185.151135:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782217185.588643:0:19873:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1782217186.172084:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1782217186.535515:0:19925:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1782217186.536070:0:19925:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1782217186.875317:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b301c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713143296:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782217186.875388:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217186.875479:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713143296 00000100:00100000:1.0:1782217186.875489:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713143296 00000100:00100000:1.0:1782217186.875541:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1782217186.875549:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713143296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782217186.875604:0:17199:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1782217186.875649:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713143296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217186.875655:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1782217186.875762:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b301c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713143296:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782217186.876142:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7b300e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713143424:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782217186.876249:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217186.876322:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713143424 00000100:00100000:1.0:1782217186.876327:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713143424 00000100:00100000:1.0:1782217186.876359:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1782217186.876367:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713143424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782217186.876387:0:17200:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1782217186.876424:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713143424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217186.876440:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1782217186.876473:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7b300e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713143424:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1782217187.193187:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782217187.390193:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782217187.390216:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43d91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713143552:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782217187.390292:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217187.390335:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713143552 00000100:00100000:2.0:1782217187.390342:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713143552 00000100:00100000:2.0:1782217187.390394:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782217187.390403:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713143552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782217187.390431:0:18704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1782217187.390483:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713143552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217187.390490:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1782217187.390510:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782217187.390543:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43d91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713143552:0@lo:13:osp-pre-0-1.0 00000020:00000004:3.0:1782217187.425510:0:19975:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782217187.427321:0:19975:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1782217187.713870:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217187.713965:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693139584 00000100:00100000:1.0:1782217187.713975:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693139584 00000100:00100000:1.0:1782217187.714019:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 114 00000100:00100000:1.0:1782217187.714026:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72df8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2401:x1868789693139584:12345-192.168.203.30@tcp:250:mount.lustre.0 00010000:00080000:1.0:1782217187.714054:0:17186:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 0f498600-1642-4d0b-95a1-c3911ac9081c@192.168.203.30@tcp t0 exp 0000000000000000 cur 550 last 0 00000020:00000080:1.0:1782217187.714085:0:17186:0:(genops.c:1406:class_connect()) connect: client 0f498600-1642-4d0b-95a1-c3911ac9081c, cookie 0x92b8e04cbf5fa986 00000100:00080000:1.0:1782217187.714213:0:17186:0:(import.c:65:import_set_state_nolock()) ffff952d4328b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782217187.714450:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72df8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f498600-1642-4d0b-95a1-c3911ac9081c+5:2401:x1868789693139584:12345-192.168.203.30@tcp:250:mount.lustre.0 Request processed in 423us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217187.714457:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 114 00000100:00100000:1.0:1782217187.725448:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217187.725699:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693139712 00000100:00100000:3.0:1782217187.725709:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693139712 00000100:00100000:3.0:1782217187.725774:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 115 00000100:00100000:3.0:1782217187.725784:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72dfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f498600-1642-4d0b-95a1-c3911ac9081c+5:14913:x1868789693139712:12345-192.168.203.30@tcp:101:mount.lustre.0 00010000:00010000:3.0:1782217187.725801:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217187.725819:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e7b362400/0x92b8e04cbf5fa98d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc65e7963be973771 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217187.725844:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e7b362400/0x92b8e04cbf5fa98d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973771 expref: 6 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217187.725876:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e7b362400/0x92b8e04cbf5fa98d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973771 expref: 6 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217187.725884:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b362400, rc 0) 00000100:00100000:3.0:1782217187.725944:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72dfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f498600-1642-4d0b-95a1-c3911ac9081c+6:14913:x1868789693139712:12345-192.168.203.30@tcp:101:mount.lustre.0 Request processed in 162us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217187.725952:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 115 00000100:00100000:1.0:1782217187.740874:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217187.740977:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693139840 00000100:00100000:0.0:1782217187.740986:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693139840 00000100:00100000:0.0:1782217187.741044:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 116 00000100:00100000:0.0:1782217187.741054:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72dfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f498600-1642-4d0b-95a1-c3911ac9081c+6:14913:x1868789693139840:12345-192.168.203.30@tcp:501:mount.lustre.0 00000100:00100000:0.0:1782217187.741171:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72dfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f498600-1642-4d0b-95a1-c3911ac9081c+6:14913:x1868789693139840:12345-192.168.203.30@tcp:501:mount.lustre.0 Request processed in 118us (306us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782217187.741181:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 116 00000100:00100000:1.0:1782217187.746284:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217187.746384:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693139968 00000100:00100000:0.0:1782217187.746394:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693139968 00000100:00100000:0.0:1782217187.746450:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 117 00000100:00100000:0.0:1782217187.746461:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72dfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f498600-1642-4d0b-95a1-c3911ac9081c+6:14913:x1868789693139968:12345-192.168.203.30@tcp:101:mount.lustre.0 00010000:00010000:0.0:1782217187.746477:0:17189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217187.746494:0:17189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952d42343a00/0x92b8e04cbf5fa994 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc65e7963be973778 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217187.746539:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952d42343a00/0x92b8e04cbf5fa994 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973778 expref: 7 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217187.746550:0:17189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952d42343a00/0x92b8e04cbf5fa994 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973778 expref: 7 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217187.746558:0:17189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d42343a00, rc 0) 00000100:00100000:0.0:1782217187.746919:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72dfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f498600-1642-4d0b-95a1-c3911ac9081c+7:14913:x1868789693139968:12345-192.168.203.30@tcp:101:mount.lustre.0 Request processed in 195us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217187.746928:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 117 00000100:00100000:1.0:1782217187.752877:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217187.752967:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693140096 00000100:00100000:3.0:1782217187.752979:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693140096 00000100:00100000:3.0:1782217187.753040:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 118 00000100:00100000:3.0:1782217187.753050:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72df9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f498600-1642-4d0b-95a1-c3911ac9081c+7:14913:x1868789693140096:12345-192.168.203.30@tcp:501:mount.lustre.0 00000100:00100000:3.0:1782217187.753225:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72df9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f498600-1642-4d0b-95a1-c3911ac9081c+8:14913:x1868789693140096:12345-192.168.203.30@tcp:501:mount.lustre.0 Request processed in 172us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217187.753233:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 118 00000100:00100000:2.0:1782217187.761298:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217187.761645:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693140224 00000100:00100000:0.0:1782217187.761669:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693140224 00000100:00100000:0.0:1782217187.761735:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 119 00000100:00100000:0.0:1782217187.761746:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72df9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f498600-1642-4d0b-95a1-c3911ac9081c+8:14913:x1868789693140224:12345-192.168.203.30@tcp:503:mount.lustre.0 00000100:00100000:0.0:1782217187.761897:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72df9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f498600-1642-4d0b-95a1-c3911ac9081c+8:14913:x1868789693140224:12345-192.168.203.30@tcp:503:mount.lustre.0 Request processed in 152us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217187.761905:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 119 00000100:00100000:0.0:1782217187.771079:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217187.771163:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693140352 00000100:00100000:1.0:1782217187.771172:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693140352 00000100:00100000:1.0:1782217187.771231:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 120 00000100:00100000:1.0:1782217187.771242:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72df8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f498600-1642-4d0b-95a1-c3911ac9081c+8:14931:x1868789693140352:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782217187.771389:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72df8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f498600-1642-4d0b-95a1-c3911ac9081c+8:14931:x1868789693140352:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 149us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217187.771397:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 120 00000100:00100000:1.0:1782217187.812667:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217187.818093:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693140480 00000100:00100000:3.0:1782217187.818113:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693140480 00000100:00100000:3.0:1782217187.818215:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 121 00000100:00100000:3.0:1782217187.818228:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72dfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f498600-1642-4d0b-95a1-c3911ac9081c+8:14931:x1868789693140480:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782217187.818444:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72dfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f498600-1642-4d0b-95a1-c3911ac9081c+8:14931:x1868789693140480:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 218us (5800us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217187.818453:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 121 00000100:00100000:2.0:1782217187.820907:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217187.822433:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693140608 00000100:00100000:0.0:1782217187.822450:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693140608 00000100:00100000:0.0:1782217187.822520:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 122 00000100:00100000:0.0:1782217187.822531:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72dffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f498600-1642-4d0b-95a1-c3911ac9081c+8:14931:x1868789693140608:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782217187.822731:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72dffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f498600-1642-4d0b-95a1-c3911ac9081c+8:14931:x1868789693140608:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 200us (1837us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217187.822739:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 122 00000100:00100000:0.0:1782217187.832868:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217187.833007:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693140736 00000100:00100000:1.0:1782217187.833040:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693140736 00000100:00100000:1.0:1782217187.833113:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 123 00000100:00100000:1.0:1782217187.833126:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72dfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f498600-1642-4d0b-95a1-c3911ac9081c+8:14913:x1868789693140736:12345-192.168.203.30@tcp:101:mount.lustre.0 00010000:00010000:1.0:1782217187.833153:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217187.833380:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e4121c000/0x92b8e04cbf5fa99b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc65e7963be9737a9 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217187.833419:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e4121c000/0x92b8e04cbf5fa99b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9737a9 expref: 9 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217187.833433:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e4121c000/0x92b8e04cbf5fa99b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9737a9 expref: 9 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217187.833444:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e4121c000, rc 0) 00000100:00100000:1.0:1782217187.833519:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72dfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f498600-1642-4d0b-95a1-c3911ac9081c+9:14913:x1868789693140736:12345-192.168.203.30@tcp:101:mount.lustre.0 Request processed in 394us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217187.834055:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 123 00000100:00100000:1.0:1782217187.841553:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217187.841693:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693140864 00000100:00100000:3.0:1782217187.841706:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693140864 00000100:00100000:3.0:1782217187.841841:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 124 00000100:00100000:3.0:1782217187.841853:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72dfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f498600-1642-4d0b-95a1-c3911ac9081c+9:14913:x1868789693140864:12345-192.168.203.30@tcp:256:mount.lustre.0 20000000:01000000:3.0:1782217187.841908:0:17187:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1782217187.841932:0:17187:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1782217187.841937:0:17187:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1782217187.841940:0:17187:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1782217187.841943:0:17187:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1782217187.841945:0:17187:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1782217187.850962:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72dfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f498600-1642-4d0b-95a1-c3911ac9081c+9:14913:x1868789693140864:12345-192.168.203.30@tcp:256:mount.lustre.0 Request processed in 9092us (9405us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217187.850982:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 124 00000100:00100000:1.0:1782217187.856288:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217187.856481:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693140992 00000100:00100000:0.0:1782217187.856494:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693140992 00000100:00100000:0.0:1782217187.856634:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 125 00000100:00100000:0.0:1782217187.856645:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72dfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f498600-1642-4d0b-95a1-c3911ac9081c+9:14913:x1868789693140992:12345-192.168.203.30@tcp:101:mount.lustre.0 00010000:00010000:0.0:1782217187.856863:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217187.856888:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952d42342a00/0x92b8e04cbf5fa9a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc65e7963be9737b0 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217187.856927:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952d42342a00/0x92b8e04cbf5fa9a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9737b0 expref: 10 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217187.857038:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952d42342a00/0x92b8e04cbf5fa9a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9737b0 expref: 10 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217187.857050:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d42342a00, rc 0) 00000100:00100000:0.0:1782217187.857128:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72dfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f498600-1642-4d0b-95a1-c3911ac9081c+10:14913:x1868789693140992:12345-192.168.203.30@tcp:101:mount.lustre.0 Request processed in 485us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217187.857136:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 125 00000100:00100000:1.0:1782217187.864353:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217187.864458:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693141120 00000100:00100000:2.0:1782217187.864470:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693141120 00000100:00100000:2.0:1782217187.864534:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 126 00000100:00100000:2.0:1782217187.864543:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72dfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f498600-1642-4d0b-95a1-c3911ac9081c+10:14913:x1868789693141120:12345-192.168.203.30@tcp:501:mount.lustre.0 00000100:00100000:2.0:1782217187.864796:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72dfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f498600-1642-4d0b-95a1-c3911ac9081c+10:14913:x1868789693141120:12345-192.168.203.30@tcp:501:mount.lustre.0 Request processed in 253us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217187.864804:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 126 00000100:00100000:2.0:1782217187.878722:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217187.879441:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693141248 00000100:00100000:0.0:1782217187.879457:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693141248 00000100:00100000:0.0:1782217187.879572:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 127 00000100:00100000:0.0:1782217187.879629:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72dff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f498600-1642-4d0b-95a1-c3911ac9081c+10:14913:x1868789693141248:12345-192.168.203.30@tcp:503:mount.lustre.0 00000100:00100000:0.0:1782217187.881906:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72dff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f498600-1642-4d0b-95a1-c3911ac9081c+10:14913:x1868789693141248:12345-192.168.203.30@tcp:503:mount.lustre.0 Request processed in 2307us (3183us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217187.881925:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 127 00000100:00100000:1.0:1782217187.893544:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217187.894710:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693141376 00000100:00100000:3.0:1782217187.894727:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693141376 00000100:00100000:3.0:1782217187.895014:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 128 00000100:00100000:3.0:1782217187.895027:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42289050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f498600-1642-4d0b-95a1-c3911ac9081c+10:14935:x1868789693141376:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782217187.895362:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42289050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f498600-1642-4d0b-95a1-c3911ac9081c+10:14935:x1868789693141376:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 336us (1831us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217187.895371:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 128 00000100:00100000:1.0:1782217187.906641:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217187.906751:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693141504 00000100:00100000:0.0:1782217187.906780:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693141504 00000100:00100000:0.0:1782217187.906857:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 129 00000100:00100000:0.0:1782217187.906870:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4228a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f498600-1642-4d0b-95a1-c3911ac9081c+10:14935:x1868789693141504:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782217187.907073:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4228a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f498600-1642-4d0b-95a1-c3911ac9081c+10:14935:x1868789693141504:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 204us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217187.907082:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 129 00000100:00100000:1.0:1782217187.928121:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217187.928182:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217187.928335:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693141632 00000100:00100000:2.0:1782217187.928347:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693141632 00000100:00100000:2.0:1782217187.928400:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693141888 00000100:00100000:2.0:1782217187.928403:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693141888 00000100:00100000:2.0:1782217187.928437:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:2.0:1782217187.928448:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b300e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1868789693141632:12345-192.168.203.30@tcp:38:mount.lustre.0 00010000:00080000:2.0:1782217187.928487:0:19301:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 909235f0-f9ba-458d-a9aa-26eb22b0f747@192.168.203.30@tcp t0 exp 0000000000000000 cur 550 last 0 00000020:00000080:2.0:1782217187.928562:0:19301:0:(genops.c:1406:class_connect()) connect: client 909235f0-f9ba-458d-a9aa-26eb22b0f747, cookie 0x92b8e04cbf5fa9a9 00000004:00100000:2.0:1782217187.928653:0:19301:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1782217187.928963:0:19301:0:(import.c:65:import_set_state_nolock()) ffff952e4e783000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782217187.929048:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b300e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:909235f0-f9ba-458d-a9aa-26eb22b0f747+6:2401:x1868789693141632:12345-192.168.203.30@tcp:38:mount.lustre.0 Request processed in 600us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217187.929057:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:2.0:1782217187.929079:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 8 00000100:00100000:2.0:1782217187.929085:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b302d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1868789693141888:12345-192.168.203.30@tcp:38:mount.lustre.0 00010000:00080000:2.0:1782217187.929103:0:19301:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 909235f0-f9ba-458d-a9aa-26eb22b0f747@192.168.203.30@tcp t0 exp 0000000000000000 cur 550 last 0 00000020:00000080:2.0:1782217187.929142:0:19301:0:(genops.c:1406:class_connect()) connect: client 909235f0-f9ba-458d-a9aa-26eb22b0f747, cookie 0x92b8e04cbf5fa9b0 00000004:00100000:2.0:1782217187.929167:0:19301:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1782217187.929310:0:19301:0:(import.c:65:import_set_state_nolock()) ffff952e4e781800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782217187.929338:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b302d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:909235f0-f9ba-458d-a9aa-26eb22b0f747+6:2401:x1868789693141888:12345-192.168.203.30@tcp:38:mount.lustre.0 Request processed in 252us (1156us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217187.929345:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 8 00000100:00100000:1.0:1782217187.937084:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217187.937126:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217187.937167:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217187.937267:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693142144 00000100:00100000:3.0:1782217187.937280:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693142144 00000100:00100000:3.0:1782217187.937362:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693142016 00000100:00100000:3.0:1782217187.937365:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693142016 00000100:00100000:3.0:1782217187.937380:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693141760 00000100:00100000:3.0:1782217187.937382:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693141760 00000100:00100000:3.0:1782217187.937400:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:3.0:1782217187.937410:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b302680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:909235f0-f9ba-458d-a9aa-26eb22b0f747+7:14913:x1868789693142144:12345-192.168.203.30@tcp:41:mount.lustre.0 00000004:00000024:3.0:1782217187.937462:0:17195:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1782217187.937567:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b302680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:909235f0-f9ba-458d-a9aa-26eb22b0f747+7:14913:x1868789693142144:12345-192.168.203.30@tcp:41:mount.lustre.0 Request processed in 157us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217187.937575:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:3.0:1782217187.937637:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00100000:3.0:1782217187.937645:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b303100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:909235f0-f9ba-458d-a9aa-26eb22b0f747+6:0:x1868789693142016:12345-192.168.203.30@tcp:41:mount.lustre.0 00000004:00000024:3.0:1782217187.937700:0:17195:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1782217187.937752:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b303100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:909235f0-f9ba-458d-a9aa-26eb22b0f747+6:0:x1868789693142016:12345-192.168.203.30@tcp:41:mount.lustre.0 Request processed in 107us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217187.937758:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00100000:3.0:1782217187.937771:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 11 00000100:00100000:3.0:1782217187.937777:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7b301c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:909235f0-f9ba-458d-a9aa-26eb22b0f747+6:0:x1868789693141760:12345-192.168.203.30@tcp:41:mount.lustre.0 00000004:00000024:3.0:1782217187.937789:0:17195:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1782217187.937810:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7b301c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:909235f0-f9ba-458d-a9aa-26eb22b0f747+6:0:x1868789693141760:12345-192.168.203.30@tcp:41:mount.lustre.0 Request processed in 33us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217187.937816:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 11 00000100:00080000:1.0:1782217187.938056:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782217187.938070:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782217187.948979:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217187.949086:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693142272 00000100:00100000:3.0:1782217187.949100:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693142272 00000100:00100000:3.0:1782217187.949185:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 12 00000100:00100000:3.0:1782217187.949197:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4441dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:909235f0-f9ba-458d-a9aa-26eb22b0f747+6:14913:x1868789693142272:12345-192.168.203.30@tcp:40:mount.lustre.0 00000100:00100000:3.0:1782217187.949334:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4441dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:909235f0-f9ba-458d-a9aa-26eb22b0f747+6:14913:x1868789693142272:12345-192.168.203.30@tcp:40:mount.lustre.0 Request processed in 139us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217187.949344:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 12 00000100:00100000:1.0:1782217187.954196:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217187.954249:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217187.954288:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217187.954388:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693142656 00000100:00100000:0.0:1782217187.954402:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693142656 00000100:00100000:0.0:1782217187.954470:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3 00000100:00100000:0.0:1782217187.954481:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c673800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:909235f0-f9ba-458d-a9aa-26eb22b0f747+6:14913:x1868789693142656:12345-192.168.203.30@tcp:900:mount.lustre.0 00000100:00100000:0.0:1782217187.954623:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c673800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:909235f0-f9ba-458d-a9aa-26eb22b0f747+6:14913:x1868789693142656:12345-192.168.203.30@tcp:900:mount.lustre.0 Request processed in 143us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217187.954632:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3 00000100:00100000:2.0:1782217187.955313:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693142400 00000100:00100000:2.0:1782217187.955322:0:18702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693142400 00000100:00100000:2.0:1782217187.955362:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693142528 00000100:00100000:2.0:1782217187.955365:0:18702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693142528 00000100:00100000:2.0:1782217187.955393:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:2.0:1782217187.955400:0:18702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c672a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2401:x1868789693142400:12345-192.168.203.30@tcp:8:mount.lustre.0 00010000:00080000:2.0:1782217187.955437:0:18702:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 909235f0-f9ba-458d-a9aa-26eb22b0f747@192.168.203.30@tcp t0 exp 0000000000000000 cur 550 last 0 00000020:00000080:2.0:1782217187.955478:0:18702:0:(genops.c:1406:class_connect()) connect: client 909235f0-f9ba-458d-a9aa-26eb22b0f747, cookie 0x92b8e04cbf5fa9b7 00002000:00100000:2.0:1782217187.955494:0:18702:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 909235f0-f9ba-458d-a9aa-26eb22b0f747/ffff952e4e786000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1782217187.955510:0:18702:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1782217187.956062:0:18701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:3.0:1782217187.956071:0:18701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c670e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2401:x1868789693142528:12345-192.168.203.30@tcp:8:mount.lustre.0 00010000:00080000:3.0:1782217187.956095:0:18701:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 909235f0-f9ba-458d-a9aa-26eb22b0f747@192.168.203.30@tcp t0 exp 0000000000000000 cur 550 last 0 00000020:00000080:3.0:1782217187.956118:0:18701:0:(genops.c:1406:class_connect()) connect: client 909235f0-f9ba-458d-a9aa-26eb22b0f747, cookie 0x92b8e04cbf5fa9be 00002000:00100000:3.0:1782217187.956123:0:18701:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 909235f0-f9ba-458d-a9aa-26eb22b0f747/ffff952d421ce800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1782217187.956139:0:18701:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1782217187.956298:0:18701:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1782217187.956337:0:18701:0:(import.c:65:import_set_state_nolock()) ffff952d421c8000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782217187.956409:0:18701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c670e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:909235f0-f9ba-458d-a9aa-26eb22b0f747+6:2401:x1868789693142528:12345-192.168.203.30@tcp:8:mount.lustre.0 Request processed in 336us (2119us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217187.956416:0:18701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 17 00002000:00080000:2.0:1782217187.957573:0:18702:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1782217187.957643:0:18702:0:(import.c:65:import_set_state_nolock()) ffff952e4e782800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782217187.957727:0:18702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c672a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:909235f0-f9ba-458d-a9aa-26eb22b0f747+6:2401:x1868789693142400:12345-192.168.203.30@tcp:8:mount.lustre.0 Request processed in 2321us (3473us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217187.960629:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:0.0:1782217187.962417:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217187.962525:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693142784 00000100:00100000:1.0:1782217187.962537:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693142784 00000100:00100000:1.0:1782217187.962621:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:1.0:1782217187.962633:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:909235f0-f9ba-458d-a9aa-26eb22b0f747+6:14913:x1868789693142784:12345-192.168.203.30@tcp:33:mount.lustre.0 00000004:00080000:3.0:1782217187.966325:0:17197:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3559us 00000004:00200000:1.0:1782217188.007008:0:17197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1782217188.007206:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:909235f0-f9ba-458d-a9aa-26eb22b0f747+6:14913:x1868789693142784:12345-192.168.203.30@tcp:33:mount.lustre.0 Request processed in 44565us (44792us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217188.007220:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:1.0:1782217188.189060:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217188.189301:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693142912 00000100:00100000:0.0:1782217188.189314:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693142912 00000100:00100000:0.0:1782217188.189397:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 13 00000100:00100000:0.0:1782217188.189409:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c671880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:909235f0-f9ba-458d-a9aa-26eb22b0f747+6:14958:x1868789693142912:12345-192.168.203.30@tcp:101:mkdir.0 00010000:00010000:0.0:1782217188.189439:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217188.189473:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d42343400/0x92b8e04cbf5fa9c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9737e1 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217188.189562:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342200/0x92b8e04cbf5fa9cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217188.189579:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342200/0x92b8e04cbf5fa9cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217188.189667:0:17194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342200/0x92b8e04cbf5fa9cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782217188.189918:0:17194:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1782217188.189924:0:17194:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782217188.189969:0:17194:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342200/0x92b8e04cbf5fa9cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217188.190004:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d42343400/0x92b8e04cbf5fa9c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9737e1 expref: 8 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217188.190039:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342200/0x92b8e04cbf5fa9cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9737e1 expref: 7 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217188.190049:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d427f5300) 00010000:00010000:0.0:1782217188.190052:0:17194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782217188.190056:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d42342200, rc 0) 00000100:00100000:0.0:1782217188.190189:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c671880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:909235f0-f9ba-458d-a9aa-26eb22b0f747+7:14958:x1868789693142912:12345-192.168.203.30@tcp:101:mkdir.0 Request processed in 780us (1143us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217188.190199:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 13 00010000:00010000:1.0:1782217188.221477:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217189.240864:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782217189.432995:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43d91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713143680:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782217189.433111:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217189.433420:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713143680 00000100:00100000:2.0:1782217189.433431:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713143680 00000100:00080000:1.0:1782217189.433602:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782217189.433714:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782217189.433726:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c670380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713143680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782217189.433766:0:18704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1782217189.433827:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c670380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713143680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217189.433836:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782217189.433938:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43d91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713143680:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782217189.434108:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713143808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782217189.434144:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217189.434183:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713143808 00000100:00100000:3.0:1782217189.434187:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713143808 00000100:00100000:3.0:1782217189.434217:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782217189.434224:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1868789713143808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782217189.434235:0:18704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1782217189.434264:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1868789713143808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217189.434669:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c673480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713143936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782217189.434704:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217189.434760:0:18705:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1782217189.434770:0:18705:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00080000:1.0:1782217189.434786:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782217189.434828:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713143808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782217189.434909:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782217189.434927:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713143936 00000100:00100000:3.0:1782217189.434932:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713143936 00000100:00100000:3.0:1782217189.434969:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782217189.434976:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c673100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713143936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782217189.434999:0:18704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1782217189.435037:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c673100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713143936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217189.435043:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782217189.435068:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c673480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713143936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782217189.435361:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a1470210-3884-42c5-8d09-248d2ed946c2:3647:1868789713144064:0@lo:400:kworker.0 00000100:00100000:0.0:1782217189.435401:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217189.435428:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713144576:0@lo:400:kworker.0 00000100:00100000:0.0:1782217189.435452:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217189.435623:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1868789713145088:0@lo:400:kworker.0 00000100:00100000:0.0:1782217189.435693:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217189.435720:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1782217189.435725:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713144192:0@lo:400:kworker.0 00000100:00100000:0.0:1782217189.435751:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217189.435771:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1868789713144704:0@lo:400:kworker.0 00000100:00100000:0.0:1782217189.435797:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217189.435816:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1868789713145216:0@lo:400:kworker.0 00000100:00100000:0.0:1782217189.435837:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217189.435866:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713145088 00000100:00100000:0.0:1782217189.435871:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713145088 00000100:00100000:0.0:1782217189.435917:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713144704 00000100:00100000:0.0:1782217189.435920:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713144704 00000100:00100000:0.0:1782217189.435932:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713145216 00000100:00100000:0.0:1782217189.435935:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713145216 00000100:00100000:0.0:1782217189.435949:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1782217189.435957:0:19412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713144576 00000100:00100000:0.0:1782217189.435957:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1868789713145088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217189.435971:0:19412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713144576 00000100:00100000:0.0:1782217189.436012:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1868789713145088:12345-0@lo:400:kworker.0 Request processed in 55us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217189.436018:0:19412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782217189.436023:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1782217189.436029:0:19412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713144576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217189.436045:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1782217189.436053:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1868789713144704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217189.436074:0:19412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713144576:12345-0@lo:400:kworker.0 Request processed in 47us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217189.436081:0:19412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782217189.436103:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1782217189.436111:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1868789713145216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217189.436151:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1868789713145216:12345-0@lo:400:kworker.0 Request processed in 41us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217189.436159:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1782217189.436183:0:18842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713144192 00000100:00100000:3.0:1782217189.436187:0:18842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713144192 00000100:00100000:3.0:1782217189.436215:0:18842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1782217189.436221:0:18842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713144192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217189.436253:0:18842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713144192:12345-0@lo:400:kworker.0 Request processed in 32us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217189.436258:0:18842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1782217189.436305:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713144448:0@lo:400:kworker.0 00000100:00100000:3.0:1782217189.436334:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217189.436355:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1868789713144960:0@lo:400:kworker.0 00000100:00100000:3.0:1782217189.436378:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217189.436395:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1782217189.436402:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1868789713144320:0@lo:400:kworker.0 00000100:00100000:3.0:1782217189.436424:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217189.436436:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1868789713144832:0@lo:400:kworker.0 00000100:00100000:0.0:1782217189.436450:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1868789713144704:12345-0@lo:400:kworker.0 Request processed in 116us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217189.436459:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1782217189.436485:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217189.436516:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713144448 00000100:00100000:3.0:1782217189.436521:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713144448 00000100:00100000:0.0:1782217189.436545:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713144960 00000100:00100000:0.0:1782217189.436550:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713144960 00000100:00100000:3.0:1782217189.436552:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1782217189.436562:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713144448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217189.436574:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713144320 00000100:00100000:0.0:1782217189.436610:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713144320 00000100:00100000:0.0:1782217189.436631:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713144832 00000100:00100000:0.0:1782217189.436635:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713144832 00000100:00100000:3.0:1782217189.436660:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713144448:12345-0@lo:400:kworker.0 Request processed in 100us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217189.436669:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782217189.436670:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1782217189.436680:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1868789713144960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217189.436695:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1782217189.436703:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1868789713144320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217189.436721:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1868789713144960:12345-0@lo:400:kworker.0 Request processed in 42us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217189.436729:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782217189.436743:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1868789713144320:12345-0@lo:400:kworker.0 Request processed in 40us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217189.436747:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1782217189.436757:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1782217189.436761:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1868789713144832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217189.436799:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1868789713144832:12345-0@lo:400:kworker.0 Request processed in 42us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217189.436806:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1782217189.436816:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1868789713144320:0@lo:400:kworker.0 00000100:00100000:3.0:1782217189.436832:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1868789713144832:0@lo:400:kworker.0 00000100:00100000:3.0:1782217189.436843:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713144448:0@lo:400:kworker.0 00010000:00080000:3.0:1782217189.436862:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d41be4000 x1868789713144960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782217189.436863:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713144192:0@lo:400:kworker.0 00000100:00100000:3.0:1782217189.436879:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1868789713144960:0@lo:400:kworker.0 00000100:00100000:0.0:1782217189.436884:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1868789713144704:0@lo:400:kworker.0 00010000:00080000:0.0:1782217189.436902:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d41be5f80 x1868789713145216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782217189.436913:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1868789713145216:0@lo:400:kworker.0 00000100:00100000:3.0:1782217189.436922:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713144064 00000100:00100000:3.0:1782217189.436928:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713144064 00000100:00100000:0.0:1782217189.436930:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713144576:0@lo:400:kworker.0 00000100:00100000:0.0:1782217189.436948:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1868789713145088:0@lo:400:kworker.0 00000100:00100000:3.0:1782217189.436966:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1782217189.436975:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42289c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+24:3647:x1868789713144064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217189.437016:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42289c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+24:3647:x1868789713144064:12345-0@lo:400:kworker.0 Request processed in 42us (1613us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217189.437031:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1782217189.437041:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a1470210-3884-42c5-8d09-248d2ed946c2:3647:1868789713144064:0@lo:400:kworker.0 00000100:00080000:1.0:1782217189.437123:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782217189.437129:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782217189.437140:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1782217189.948656:0:19516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 909235f0-f9ba-458d-a9aa-26eb22b0f747 00000001:00080000:1.0:1782217189.948675:0:19516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000001:00100000:1.0:1782217189.949152:0:18697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 909235f0-f9ba-458d-a9aa-26eb22b0f747 00000100:00100000:0.0:1782217190.233781:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217190.233962:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693143040 00000100:00100000:3.0:1782217190.233971:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693143040 00000100:00100000:3.0:1782217190.234084:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 14 00000100:00100000:3.0:1782217190.234099:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:909235f0-f9ba-458d-a9aa-26eb22b0f747+7:15011:x1868789693143040:12345-192.168.203.30@tcp:41:lfs.0 00000004:00000024:3.0:1782217190.234141:0:17195:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1782217190.234240:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:909235f0-f9ba-458d-a9aa-26eb22b0f747+7:15011:x1868789693143040:12345-192.168.203.30@tcp:41:lfs.0 Request processed in 143us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217190.234248:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 14 00000100:00080000:1.0:1782217190.234567:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782217190.236474:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217190.236650:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693143168 00000100:00100000:0.0:1782217190.236659:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693143168 00000100:00100000:0.0:1782217190.236837:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 15 00000100:00100000:0.0:1782217190.236847:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c672d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:909235f0-f9ba-458d-a9aa-26eb22b0f747+6:15011:x1868789693143168:12345-192.168.203.30@tcp:41:lfs.0 00000004:00000024:0.0:1782217190.236882:0:17194:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1782217190.236969:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c672d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:909235f0-f9ba-458d-a9aa-26eb22b0f747+6:15011:x1868789693143168:12345-192.168.203.30@tcp:41:lfs.0 Request processed in 124us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217190.236977:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 15 00000100:00080000:1.0:1782217190.238528:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782217190.242358:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217190.242607:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693143296 00000100:00100000:3.0:1782217190.242618:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693143296 00000100:00100000:3.0:1782217190.242700:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:3.0:1782217190.242711:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:909235f0-f9ba-458d-a9aa-26eb22b0f747+5:15011:x1868789693143296:12345-192.168.203.30@tcp:13:lfs.0 00002000:00000024:3.0:1782217190.242748:0:18704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1782217190.242828:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:909235f0-f9ba-458d-a9aa-26eb22b0f747+5:15011:x1868789693143296:12345-192.168.203.30@tcp:13:lfs.0 Request processed in 118us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217190.242835:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00080000:1.0:1782217190.243316:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782217190.246413:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217190.247900:0:19988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693143424 00000100:00100000:1.0:1782217190.247913:0:19988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693143424 00000100:00100000:1.0:1782217190.247992:0:19988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00100000:1.0:1782217190.248001:0:19988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:909235f0-f9ba-458d-a9aa-26eb22b0f747+5:15011:x1868789693143424:12345-192.168.203.30@tcp:13:lfs.0 00002000:00000024:1.0:1782217190.248024:0:19988:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1782217190.248110:0:19988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:909235f0-f9ba-458d-a9aa-26eb22b0f747+5:15011:x1868789693143424:12345-192.168.203.30@tcp:13:lfs.0 Request processed in 110us (1706us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217190.248118:0:19988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00080000:2.0:1782217190.248315:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1782217190.265342:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782217190.495829:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217190.495974:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693143552 00000100:00100000:2.0:1782217190.495984:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693143552 00000100:00100000:2.0:1782217190.496038:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 131 00000100:00100000:2.0:1782217190.496048:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42288850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f498600-1642-4d0b-95a1-c3911ac9081c+10:15043:x1868789693143552:12345-192.168.203.30@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782217190.496065:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217190.496083:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e72e2de00/0x92b8e04cbf5fa9d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xc65e7963be9737e8 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217190.496109:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e72e2de00/0x92b8e04cbf5fa9d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9737e8 expref: 11 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217190.496120:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e72e2de00/0x92b8e04cbf5fa9d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9737e8 expref: 11 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217190.496157:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2de00, rc 0) 00000100:00100000:2.0:1782217190.496216:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42288850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f498600-1642-4d0b-95a1-c3911ac9081c+11:15043:x1868789693143552:12345-192.168.203.30@tcp:101:mount.lustre.0 Request processed in 169us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217190.496223:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 131 00000100:00100000:0.0:1782217190.512332:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217190.512829:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693143680 00000100:00100000:3.0:1782217190.512838:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693143680 00000100:00100000:3.0:1782217190.512898:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 132 00000100:00100000:3.0:1782217190.512909:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f498600-1642-4d0b-95a1-c3911ac9081c+11:15043:x1868789693143680:12345-192.168.203.30@tcp:501:mount.lustre.0 00000100:00100000:3.0:1782217190.515896:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f498600-1642-4d0b-95a1-c3911ac9081c+11:15043:x1868789693143680:12345-192.168.203.30@tcp:501:mount.lustre.0 Request processed in 2977us (3562us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217190.515915:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 132 00000100:00100000:3.0:1782217190.547261:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217190.547823:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693143808 00000100:00100000:0.0:1782217190.547832:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693143808 00000100:00100000:0.0:1782217190.547891:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 133 00000100:00100000:0.0:1782217190.547900:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4228b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f498600-1642-4d0b-95a1-c3911ac9081c+11:15043:x1868789693143808:12345-192.168.203.30@tcp:503:mount.lustre.0 00000100:00100000:0.0:1782217190.548051:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4228b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f498600-1642-4d0b-95a1-c3911ac9081c+11:15043:x1868789693143808:12345-192.168.203.30@tcp:503:mount.lustre.0 Request processed in 150us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217190.548060:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 133 00000100:00100000:0.0:1782217190.551775:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217190.551865:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693143936 00000100:00100000:2.0:1782217190.551874:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693143936 00000100:00100000:2.0:1782217190.551927:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 134 00000100:00100000:2.0:1782217190.551935:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d42288050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f498600-1642-4d0b-95a1-c3911ac9081c+11:15050:x1868789693143936:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782217190.552090:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d42288050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f498600-1642-4d0b-95a1-c3911ac9081c+11:15050:x1868789693143936:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 154us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217190.552098:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 134 00000040:00080000:2.0:1782217190.585259:0:17230:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1782217190.585967:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217190.586822:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693144064 00000100:00100000:2.0:1782217190.586832:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693144064 00000100:00100000:2.0:1782217190.586897:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 135 00000100:00100000:2.0:1782217190.586907:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4228a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f498600-1642-4d0b-95a1-c3911ac9081c+11:15050:x1868789693144064:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782217190.587052:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4228a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f498600-1642-4d0b-95a1-c3911ac9081c+11:15050:x1868789693144064:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 145us (1089us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217190.587060:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 135 00000100:00100000:3.0:1782217190.593174:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217190.595687:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693144192 00000100:00100000:0.0:1782217190.595701:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693144192 00000100:00100000:0.0:1782217190.595769:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 136 00000100:00100000:0.0:1782217190.595779:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4228a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f498600-1642-4d0b-95a1-c3911ac9081c+11:15050:x1868789693144192:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782217190.595941:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4228a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f498600-1642-4d0b-95a1-c3911ac9081c+11:15050:x1868789693144192:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 163us (2777us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217190.595949:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 136 00000100:00100000:0.0:1782217190.599847:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217190.599937:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693144320 00000100:00100000:3.0:1782217190.599947:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693144320 00000100:00100000:3.0:1782217190.600003:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 137 00000100:00100000:3.0:1782217190.600012:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f498600-1642-4d0b-95a1-c3911ac9081c+11:15043:x1868789693144320:12345-192.168.203.30@tcp:101:mount.lustre.0 00010000:00010000:3.0:1782217190.600029:0:17189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217190.600045:0:17189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e7b362200/0x92b8e04cbf5fa9da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc65e7963be973819 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217190.600071:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e7b362200/0x92b8e04cbf5fa9da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973819 expref: 12 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217190.600082:0:17189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e7b362200/0x92b8e04cbf5fa9da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973819 expref: 12 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217190.600090:0:17189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b362200, rc 0) 00000100:00100000:3.0:1782217190.600158:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f498600-1642-4d0b-95a1-c3911ac9081c+12:15043:x1868789693144320:12345-192.168.203.30@tcp:101:mount.lustre.0 Request processed in 147us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217190.600166:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 137 00000100:00100000:1.0:1782217190.602713:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217190.602863:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693144448 00000100:00100000:0.0:1782217190.602885:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693144448 00000100:00100000:0.0:1782217190.602939:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 138 00000100:00100000:0.0:1782217190.602949:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f498600-1642-4d0b-95a1-c3911ac9081c+12:15043:x1868789693144448:12345-192.168.203.30@tcp:256:mount.lustre.0 20000000:01000000:0.0:1782217190.602977:0:17186:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1782217190.602996:0:17186:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1782217190.603000:0:17186:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1782217190.603004:0:17186:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1782217190.603007:0:17186:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1782217190.603009:0:17186:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:3.0:1782217190.609041:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f498600-1642-4d0b-95a1-c3911ac9081c+12:15043:x1868789693144448:12345-192.168.203.30@tcp:256:mount.lustre.0 Request processed in 6083us (6327us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217190.609060:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 138 00000100:00100000:1.0:1782217190.613788:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217190.613929:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693144576 00000100:00100000:2.0:1782217190.613940:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693144576 00000100:00100000:2.0:1782217190.613994:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 139 00000100:00100000:2.0:1782217190.614003:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f498600-1642-4d0b-95a1-c3911ac9081c+12:15043:x1868789693144576:12345-192.168.203.30@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782217190.614019:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217190.614047:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e72e2dc00/0x92b8e04cbf5fa9e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc65e7963be973820 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217190.614072:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e72e2dc00/0x92b8e04cbf5fa9e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973820 expref: 13 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217190.614082:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e72e2dc00/0x92b8e04cbf5fa9e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973820 expref: 13 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217190.614090:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2dc00, rc 0) 00000100:00100000:2.0:1782217190.614153:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f498600-1642-4d0b-95a1-c3911ac9081c+13:15043:x1868789693144576:12345-192.168.203.30@tcp:101:mount.lustre.0 Request processed in 151us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217190.614159:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 139 00000100:00100000:0.0:1782217190.622266:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217190.622332:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693144704 00000100:00100000:3.0:1782217190.622342:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693144704 00000100:00100000:3.0:1782217190.622401:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 140 00000100:00100000:3.0:1782217190.622413:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f498600-1642-4d0b-95a1-c3911ac9081c+13:15043:x1868789693144704:12345-192.168.203.30@tcp:501:mount.lustre.0 00000100:00100000:3.0:1782217190.622622:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f498600-1642-4d0b-95a1-c3911ac9081c+13:15043:x1868789693144704:12345-192.168.203.30@tcp:501:mount.lustre.0 Request processed in 210us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217190.622631:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 140 00000100:00100000:0.0:1782217190.627464:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217190.631045:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693144832 00000100:00100000:3.0:1782217190.631060:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693144832 00000100:00100000:2.0:1782217190.631435:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 141 00000100:00100000:2.0:1782217190.631449:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f498600-1642-4d0b-95a1-c3911ac9081c+13:15043:x1868789693144832:12345-192.168.203.30@tcp:503:mount.lustre.0 00000100:00100000:2.0:1782217190.631630:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f498600-1642-4d0b-95a1-c3911ac9081c+13:15043:x1868789693144832:12345-192.168.203.30@tcp:503:mount.lustre.0 Request processed in 185us (4175us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217190.631647:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 141 00000100:00100000:1.0:1782217190.639881:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217190.639974:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693144960 00000100:00100000:3.0:1782217190.639985:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693144960 00000100:00100000:3.0:1782217190.640044:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 142 00000100:00100000:3.0:1782217190.640054:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f498600-1642-4d0b-95a1-c3911ac9081c+13:15054:x1868789693144960:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782217190.640211:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f498600-1642-4d0b-95a1-c3911ac9081c+13:15054:x1868789693144960:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 156us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217190.640220:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 142 00000100:00100000:0.0:1782217190.646699:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217190.647122:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693145088 00000100:00100000:2.0:1782217190.647132:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693145088 00000100:00100000:2.0:1782217190.647189:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 143 00000100:00100000:2.0:1782217190.647199:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f498600-1642-4d0b-95a1-c3911ac9081c+13:15054:x1868789693145088:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782217190.647341:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f498600-1642-4d0b-95a1-c3911ac9081c+13:15054:x1868789693145088:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 142us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217190.647349:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 143 00000100:00100000:0.0:1782217190.654964:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217190.655009:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217190.655086:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693145216 00000100:00100000:3.0:1782217190.655097:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693145216 00000100:00100000:3.0:1782217190.655136:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693145472 00000100:00100000:3.0:1782217190.655140:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693145472 00000100:00100000:3.0:1782217190.655166:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:3.0:1782217190.655174:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1868789693145216:12345-192.168.203.30@tcp:38:mount.lustre.0 00010000:00080000:3.0:1782217190.655203:0:17195:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 5dfa9e82-80a8-4410-97a4-7bd2f5d1677e@192.168.203.30@tcp t0 exp 0000000000000000 cur 553 last 0 00000020:00000080:3.0:1782217190.655254:0:17195:0:(genops.c:1406:class_connect()) connect: client 5dfa9e82-80a8-4410-97a4-7bd2f5d1677e, cookie 0x92b8e04cbf5fa9e8 00000004:00100000:3.0:1782217190.655278:0:17195:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1782217190.655365:0:17195:0:(import.c:65:import_set_state_nolock()) ffff952d421ca000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782217190.655425:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+6:2401:x1868789693145216:12345-192.168.203.30@tcp:38:mount.lustre.0 Request processed in 250us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217190.655433:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:3.0:1782217190.655450:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:3.0:1782217190.655462:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1868789693145472:12345-192.168.203.30@tcp:38:mount.lustre.0 00010000:00080000:3.0:1782217190.655478:0:17195:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 5dfa9e82-80a8-4410-97a4-7bd2f5d1677e@192.168.203.30@tcp t0 exp 0000000000000000 cur 553 last 0 00000020:00000080:3.0:1782217190.655498:0:17195:0:(genops.c:1406:class_connect()) connect: client 5dfa9e82-80a8-4410-97a4-7bd2f5d1677e, cookie 0x92b8e04cbf5fa9ef 00000004:00100000:3.0:1782217190.655511:0:17195:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1782217190.655553:0:17195:0:(import.c:65:import_set_state_nolock()) ffff952e7c55e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782217190.655577:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+6:2401:x1868789693145472:12345-192.168.203.30@tcp:38:mount.lustre.0 Request processed in 115us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217190.655613:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:1.0:1782217190.663192:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217190.663235:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217190.663267:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217190.663304:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217190.663336:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693146240 00000100:00100000:1.0:1782217190.663345:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693146240 00000100:00100000:1.0:1782217190.663386:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693146112 00000100:00100000:1.0:1782217190.663389:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693146112 00000100:00100000:1.0:1782217190.663426:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3 00000100:00100000:1.0:1782217190.663435:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c673b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:909235f0-f9ba-458d-a9aa-26eb22b0f747+5:2402:x1868789693146240:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1782217190.663502:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c673b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:909235f0-f9ba-458d-a9aa-26eb22b0f747+5:2402:x1868789693146240:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 68us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217190.663510:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3 00000100:00100000:1.0:1782217190.663526:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 4 00000100:00100000:1.0:1782217190.663532:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c672300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:909235f0-f9ba-458d-a9aa-26eb22b0f747+5:2402:x1868789693146112:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1782217190.663556:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c672300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:909235f0-f9ba-458d-a9aa-26eb22b0f747+5:2402:x1868789693146112:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 24us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217190.663562:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 4 00000100:00100000:0.0:1782217190.663673:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693145984 00000100:00100000:0.0:1782217190.663678:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693145984 00000100:00100000:0.0:1782217190.663721:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693145856 00000100:00100000:0.0:1782217190.663724:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693145856 00000100:00100000:0.0:1782217190.663746:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 39 00000100:00100000:0.0:1782217190.663753:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c670000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:909235f0-f9ba-458d-a9aa-26eb22b0f747+6:2402:x1868789693145984:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782217190.663782:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c670000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:909235f0-f9ba-458d-a9aa-26eb22b0f747+6:2402:x1868789693145984:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 30us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217190.663789:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 39 00000100:00100000:0.0:1782217190.663802:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 40 00000100:00100000:0.0:1782217190.663808:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c671180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:909235f0-f9ba-458d-a9aa-26eb22b0f747+7:2402:x1868789693145856:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782217190.663846:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c671180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:909235f0-f9ba-458d-a9aa-26eb22b0f747+7:2402:x1868789693145856:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 38us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217190.663862:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 40 00000100:00100000:0.0:1782217190.672369:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217190.672411:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217190.672442:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217190.672517:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693145728 00000100:00100000:2.0:1782217190.672539:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693145728 00000100:00100000:2.0:1782217190.672626:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693145600 00000100:00100000:2.0:1782217190.672629:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693145600 00000100:00100000:2.0:1782217190.672654:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693145344 00000100:00100000:2.0:1782217190.672657:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693145344 00000100:00100000:2.0:1782217190.672671:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 18 00000100:00100000:2.0:1782217190.672680:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+7:15043:x1868789693145728:12345-192.168.203.30@tcp:41:mount.lustre.0 00000004:00000024:2.0:1782217190.672712:0:17194:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1782217190.672787:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+7:15043:x1868789693145728:12345-192.168.203.30@tcp:41:mount.lustre.0 Request processed in 106us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217190.672794:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 18 00000100:00100000:2.0:1782217190.672810:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:2.0:1782217190.672817:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+6:0:x1868789693145600:12345-192.168.203.30@tcp:41:mount.lustre.0 00000004:00000024:2.0:1782217190.672827:0:17194:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1782217190.672853:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+6:0:x1868789693145600:12345-192.168.203.30@tcp:41:mount.lustre.0 Request processed in 36us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217190.672859:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:2.0:1782217190.672871:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00100000:2.0:1782217190.672877:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+6:0:x1868789693145344:12345-192.168.203.30@tcp:41:mount.lustre.0 00000004:00000024:2.0:1782217190.672887:0:17194:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1782217190.672908:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+6:0:x1868789693145344:12345-192.168.203.30@tcp:41:mount.lustre.0 Request processed in 31us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217190.672914:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00080000:0.0:1782217190.673075:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782217190.673080:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782217190.685770:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217190.685904:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693146368 00000100:00100000:2.0:1782217190.685914:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693146368 00000100:00100000:2.0:1782217190.685971:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:2.0:1782217190.685997:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+6:15043:x1868789693146368:12345-192.168.203.30@tcp:40:mount.lustre.0 00000100:00100000:2.0:1782217190.686096:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+6:15043:x1868789693146368:12345-192.168.203.30@tcp:40:mount.lustre.0 Request processed in 101us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217190.686104:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:1.0:1782217190.692734:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217190.692988:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693146752 00000100:00100000:0.0:1782217190.692997:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693146752 00000100:00100000:0.0:1782217190.693055:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 4 00000100:00100000:0.0:1782217190.693065:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c671c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+6:15043:x1868789693146752:12345-192.168.203.30@tcp:900:mount.lustre.0 00000100:00100000:0.0:1782217190.693158:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c671c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+6:15043:x1868789693146752:12345-192.168.203.30@tcp:900:mount.lustre.0 Request processed in 94us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217190.693167:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 4 00000100:00100000:0.0:1782217190.695022:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217190.695057:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217190.695125:0:18701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693146496 00000100:00100000:3.0:1782217190.695134:0:18701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693146496 00000100:00100000:3.0:1782217190.695181:0:18701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693146624 00000100:00100000:3.0:1782217190.695184:0:18701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693146624 00000100:00100000:3.0:1782217190.695210:0:18701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 18 00000100:00100000:3.0:1782217190.695217:0:18701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2401:x1868789693146496:12345-192.168.203.30@tcp:8:mount.lustre.0 00010000:00080000:3.0:1782217190.695248:0:18701:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 5dfa9e82-80a8-4410-97a4-7bd2f5d1677e@192.168.203.30@tcp t0 exp 0000000000000000 cur 553 last 0 00000020:00000080:3.0:1782217190.695295:0:18701:0:(genops.c:1406:class_connect()) connect: client 5dfa9e82-80a8-4410-97a4-7bd2f5d1677e, cookie 0x92b8e04cbf5fa9f6 00002000:00100000:3.0:1782217190.695307:0:18701:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5dfa9e82-80a8-4410-97a4-7bd2f5d1677e/ffff952e7c55b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1782217190.695318:0:18701:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1782217190.695395:0:18701:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1782217190.695422:0:18701:0:(import.c:65:import_set_state_nolock()) ffff952e7c55d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782217190.695473:0:18701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+6:2401:x1868789693146496:12345-192.168.203.30@tcp:8:mount.lustre.0 Request processed in 254us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217190.695481:0:18701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 18 00000100:00100000:3.0:1782217190.695497:0:18701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:3.0:1782217190.695502:0:18701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2401:x1868789693146624:12345-192.168.203.30@tcp:8:mount.lustre.0 00010000:00080000:3.0:1782217190.695524:0:18701:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 5dfa9e82-80a8-4410-97a4-7bd2f5d1677e@192.168.203.30@tcp t0 exp 0000000000000000 cur 553 last 0 00000020:00000080:3.0:1782217190.695540:0:18701:0:(genops.c:1406:class_connect()) connect: client 5dfa9e82-80a8-4410-97a4-7bd2f5d1677e, cookie 0x92b8e04cbf5fa9fd 00002000:00100000:3.0:1782217190.695545:0:18701:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5dfa9e82-80a8-4410-97a4-7bd2f5d1677e/ffff952e7c55f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1782217190.695551:0:18701:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1782217190.695618:0:18701:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1782217190.695815:0:18701:0:(import.c:65:import_set_state_nolock()) ffff952e7c55a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782217190.695842:0:18701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+6:2401:x1868789693146624:12345-192.168.203.30@tcp:8:mount.lustre.0 Request processed in 338us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217190.695849:0:18701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:2.0:1782217190.698002:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217190.701023:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693146880 00000100:00100000:3.0:1782217190.701036:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693146880 00000100:00100000:3.0:1782217190.701096:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1 00000100:00100000:3.0:1782217190.701105:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+6:15043:x1868789693146880:12345-192.168.203.30@tcp:33:mount.lustre.0 00000004:00200000:3.0:1782217190.701198:0:17198:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1782217190.701294:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+6:15043:x1868789693146880:12345-192.168.203.30@tcp:33:mount.lustre.0 Request processed in 188us (3297us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217190.701301:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1 00000100:00100000:1.0:1782217190.875252:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217190.875696:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693147008 00000100:00100000:2.0:1782217190.875715:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693147008 00000100:00100000:2.0:1782217190.875778:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 22 00000100:00100000:2.0:1782217190.875789:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c672680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+6:15077:x1868789693147008:12345-192.168.203.30@tcp:101:mkdir.0 00010000:00010000:2.0:1782217190.875809:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217190.875832:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5faa04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973851 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217190.875892:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5faa0b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217190.875905:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5faa0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217190.875916:0:17196:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5faa0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17196 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217190.875973:0:17196:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1782217190.875977:0:17196:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782217190.875997:0:17196:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5faa0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17196 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217190.876021:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2c000/0x92b8e04cbf5faa04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973851 expref: 8 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217190.876059:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5faa0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973851 expref: 7 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217190.876068:0:17196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d427f5300) 00010000:00010000:2.0:1782217190.876071:0:17196:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782217190.876074:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e72e2ca00, rc 0) 00000100:00100000:2.0:1782217190.876415:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c672680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+7:15077:x1868789693147008:12345-192.168.203.30@tcp:101:mkdir.0 Request processed in 627us (1174us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217190.876423:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 22 00010000:00010000:1.0:1782217191.289802:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782217191.993743:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782217191.993770:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43fee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713145344:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782217191.993844:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217191.993893:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713145344 00000100:00100000:3.0:1782217191.993901:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713145344 00000100:00100000:3.0:1782217191.993953:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1782217191.993963:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713145344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782217191.994000:0:17200:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1782217191.994070:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713145344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217191.994078:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1782217191.994197:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43fee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713145344:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782217192.003790:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782217192.003821:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d4273fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713145472:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782217192.003905:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217192.003980:0:18842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713145472 00000100:00100000:0.0:1782217192.003988:0:18842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713145472 00000100:00100000:0.0:1782217192.004050:0:18842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1782217192.004060:0:18842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713145472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782217192.004108:0:18842:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1782217192.004170:0:18842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713145472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217192.004178:0:18842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1782217192.004234:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d4273fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713145472:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1782217192.320744:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782217192.507128:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713145600:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782217192.507224:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217192.510363:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713145600 00000100:00100000:2.0:1782217192.510384:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713145600 00000100:00100000:2.0:1782217192.510482:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782217192.510496:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713145600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782217192.510542:0:18705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1782217192.510683:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713145600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 190us (3459us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217192.510691:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1782217192.510816:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782217192.510910:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713145600:0@lo:13:osp-pre-0-1.0 00000040:00080000:1.0:1782217193.081818:0:17948:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1782217193.341961:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782217194.029253:0:20074:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:1.0:1782217194.064241:0:17174:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5dfa9e82-80a8-4410-97a4-7bd2f5d1677e 00000001:00100000:1.0:1782217194.064252:0:17174:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 909235f0-f9ba-458d-a9aa-26eb22b0f747 00000001:00100000:3.0:1782217194.065822:0:17927:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 5dfa9e82-80a8-4410-97a4-7bd2f5d1677e 00000001:00100000:3.0:1782217194.065831:0:17927:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 909235f0-f9ba-458d-a9aa-26eb22b0f747 00010000:00010000:1.0:1782217194.361123:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782217194.553004:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c670700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713146112:0@lo:400:kworker.0 00000100:00100000:2.0:1782217194.553077:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217194.553135:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43696680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713146624:0@lo:400:kworker.0 00000100:00100000:2.0:1782217194.553157:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217194.553187:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43695500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1868789713147136:0@lo:400:kworker.0 00000100:00100000:2.0:1782217194.553212:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217194.553237:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1782217194.553243:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c670a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a1470210-3884-42c5-8d09-248d2ed946c2:3647:1868789713145728:0@lo:400:kworker.0 00000100:00100000:2.0:1782217194.553282:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217194.553303:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c673480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1868789713146240:0@lo:400:kworker.0 00000100:00100000:2.0:1782217194.553323:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217194.553348:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43696a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1868789713146752:0@lo:400:kworker.0 00000100:00100000:2.0:1782217194.553374:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217194.553392:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43695c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1868789713147264:0@lo:400:kworker.0 00000100:00100000:2.0:1782217194.553417:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217194.553444:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713147136 00000100:00100000:2.0:1782217194.553451:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713147136 00000100:00100000:2.0:1782217194.553493:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713146240 00000100:00100000:2.0:1782217194.553496:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713146240 00000100:00100000:2.0:1782217194.553508:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713146752 00000100:00100000:2.0:1782217194.553511:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713146752 00000100:00100000:2.0:1782217194.553521:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713147264 00000100:00100000:2.0:1782217194.553524:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713147264 00000100:00100000:2.0:1782217194.553540:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1782217194.553549:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1868789713147136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217194.553638:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1868789713147136:12345-0@lo:400:kworker.0 Request processed in 91us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217194.553645:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1782217194.553662:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1782217194.553667:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1868789713146240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217194.553693:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1868789713146240:12345-0@lo:400:kworker.0 Request processed in 25us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217194.553706:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1782217194.553716:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1782217194.553721:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1868789713146752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217194.553749:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1868789713146752:12345-0@lo:400:kworker.0 Request processed in 28us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217194.553756:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1782217194.553766:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1782217194.553772:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43cb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1868789713147264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217194.553797:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43cb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1868789713147264:12345-0@lo:400:kworker.0 Request processed in 25us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217194.553803:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1782217194.553821:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713145728 00000100:00100000:2.0:1782217194.553824:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713145728 00000100:00100000:2.0:1782217194.553847:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1782217194.553852:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+24:3647:x1868789713145728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217194.553879:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+24:3647:x1868789713145728:12345-0@lo:400:kworker.0 Request processed in 27us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217194.553885:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1782217194.553930:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c670a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a1470210-3884-42c5-8d09-248d2ed946c2:3647:1868789713145728:0@lo:400:kworker.0 00000100:00100000:2.0:1782217194.553942:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c673480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1868789713146240:0@lo:400:kworker.0 00000100:00100000:2.0:1782217194.553950:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43696a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1868789713146752:0@lo:400:kworker.0 00010000:00080000:2.0:1782217194.553960:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43695c00 x1868789713147264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782217194.553981:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43695c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1868789713147264:0@lo:400:kworker.0 00000100:00100000:2.0:1782217194.553991:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43695500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1868789713147136:0@lo:400:kworker.0 00000100:00100000:0.0:1782217194.554159:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c671f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713145856:0@lo:400:kworker.0 00000100:00100000:0.0:1782217194.554189:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217194.554219:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713146368:0@lo:400:kworker.0 00000100:00100000:0.0:1782217194.554240:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217194.554256:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43695f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1868789713146880:0@lo:400:kworker.0 00000100:00100000:0.0:1782217194.554274:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217194.554287:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713147392:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782217194.554306:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217194.554338:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1782217194.554343:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c671500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713145984:0@lo:400:kworker.0 00000100:00100000:0.0:1782217194.554365:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217194.554378:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43697100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713146496:0@lo:400:kworker.0 00000100:00100000:0.0:1782217194.554402:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217194.554419:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43695880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1868789713147008:0@lo:400:kworker.0 00000100:00100000:0.0:1782217194.554441:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217194.554465:0:18842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713145856 00000100:00100000:0.0:1782217194.554469:0:18842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713145856 00000100:00100000:0.0:1782217194.554494:0:18842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713146368 00000100:00100000:0.0:1782217194.554496:0:18842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713146368 00000100:00100000:0.0:1782217194.554514:0:18842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1782217194.554527:0:18842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713145856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217194.554562:0:18842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713145856:12345-0@lo:400:kworker.0 Request processed in 35us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217194.554567:0:18842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1782217194.554600:0:18842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1782217194.554617:0:18842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713146368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217194.554642:0:18842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713146368:12345-0@lo:400:kworker.0 Request processed in 37us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217194.554647:0:18842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1782217194.554673:0:19988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713147392 00000100:00100000:0.0:1782217194.554676:0:19988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713147392 00000100:00100000:0.0:1782217194.554698:0:19988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782217194.554703:0:19988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713147392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782217194.554724:0:19988:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1782217194.554752:0:19988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713147392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217194.554757:0:19988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782217194.554776:0:19778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713146112 00000100:00100000:0.0:1782217194.554779:0:19778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713146112 00000100:00100000:0.0:1782217194.554804:0:19778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713146624 00000100:00100000:0.0:1782217194.554807:0:19778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713146624 00000100:00100000:0.0:1782217194.554816:0:19778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713145984 00000100:00100000:0.0:1782217194.554817:0:19778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713145984 00000100:00100000:0.0:1782217194.554828:0:19778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713146496 00000100:00100000:0.0:1782217194.554830:0:19778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713146496 00000100:00100000:0.0:1782217194.554841:0:19778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782217194.554846:0:19778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713146112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217194.554883:0:19778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713146112:12345-0@lo:400:kworker.0 Request processed in 35us (1806us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217194.554894:0:19778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782217194.554905:0:19778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782217194.554910:0:19778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713146624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217194.554935:0:19778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713146624:12345-0@lo:400:kworker.0 Request processed in 25us (1777us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217194.554940:0:19778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782217194.554950:0:19778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782217194.554955:0:19778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713145984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217194.554985:0:19778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3649:x1868789713145984:12345-0@lo:400:kworker.0 Request processed in 30us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217194.554990:0:19778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782217194.554999:0:19778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782217194.555004:0:19778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713146496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217194.555026:0:19778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713146496:12345-0@lo:400:kworker.0 Request processed in 22us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217194.555031:0:19778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782217194.555052:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713146880 00000100:00100000:0.0:1782217194.555056:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713146880 00000100:00100000:0.0:1782217194.555077:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713147008 00000100:00100000:0.0:1782217194.555149:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713147008 00000100:00100000:0.0:1782217194.555169:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1782217194.555175:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4273ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1868789713146880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217194.555203:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4273ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1868789713146880:12345-0@lo:400:kworker.0 Request processed in 28us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217194.555209:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1782217194.555393:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1782217194.555399:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1868789713147008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782217194.555428:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1868789713147008:12345-0@lo:400:kworker.0 Request processed in 30us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217194.555434:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1782217194.555470:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c671500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713145984:0@lo:400:kworker.0 00000100:00100000:0.0:1782217194.555484:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43697100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713146496:0@lo:400:kworker.0 00010000:00080000:0.0:1782217194.555496:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43695880 x1868789713147008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782217194.555507:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43695880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1868789713147008:0@lo:400:kworker.0 00000100:00100000:0.0:1782217194.555517:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c671f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1868789713145856:0@lo:400:kworker.0 00000100:00100000:0.0:1782217194.555526:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713146368:0@lo:400:kworker.0 00000100:00100000:0.0:1782217194.555535:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43695f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1868789713146880:0@lo:400:kworker.0 00000100:00100000:0.0:1782217194.555547:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713147392:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782217194.555735:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1782217194.555747:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c670700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713146112:0@lo:400:kworker.0 00000100:00100000:2.0:1782217194.555769:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43696680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713146624:0@lo:400:kworker.0 00000100:00100000:3.0:1782217194.555901:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43fec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713147520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782217194.555930:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1782217194.555963:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782217194.555967:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782217194.555969:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782217194.555971:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782217194.555979:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713147520 00000100:00100000:3.0:1782217194.555982:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713147520 00000100:00100000:3.0:1782217194.556005:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782217194.556010:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43feea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713147520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782217194.556021:0:18704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1782217194.556046:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43feea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713147520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217194.556052:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782217194.556077:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43fec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713147520:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782217194.556178:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782217194.556187:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43694000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713147648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782217194.556214:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217194.556237:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713147648 00000100:00100000:1.0:1782217194.556241:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713147648 00000100:00100000:1.0:1782217194.556261:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782217194.556266:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43697480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713147648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782217194.556412:0:18704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1782217194.556450:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43697480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713147648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 183us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217194.556455:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782217194.556479:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43694000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713147648:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782217195.386924:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782217195.967775:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217195.967819:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217195.967852:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217195.967873:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217195.967894:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217195.967913:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217195.967929:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217195.967947:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217195.967968:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217195.968009:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693147264 00000100:00100000:0.0:1782217195.968019:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693147264 00000100:00100000:0.0:1782217195.968067:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693147776 00000100:00100000:0.0:1782217195.968070:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693147776 00000100:00100000:0.0:1782217195.968082:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693147392 00000100:00100000:0.0:1782217195.968084:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693147392 00000100:00100000:0.0:1782217195.968094:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693147904 00000100:00100000:0.0:1782217195.968096:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693147904 00000100:00100000:0.0:1782217195.968110:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 47 00000100:00100000:0.0:1782217195.968119:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:909235f0-f9ba-458d-a9aa-26eb22b0f747+6:2404:x1868789693147264:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782217195.968191:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:909235f0-f9ba-458d-a9aa-26eb22b0f747+6:2404:x1868789693147264:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 73us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217195.968198:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 47 00000100:00100000:0.0:1782217195.968216:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 48 00000100:00100000:0.0:1782217195.968223:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+6:2404:x1868789693147776:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782217195.968246:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+6:2404:x1868789693147776:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 25us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217195.968252:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 48 00000100:00100000:0.0:1782217195.968263:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 49 00000100:00100000:0.0:1782217195.968268:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:909235f0-f9ba-458d-a9aa-26eb22b0f747+5:2404:x1868789693147392:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782217195.968288:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:909235f0-f9ba-458d-a9aa-26eb22b0f747+5:2404:x1868789693147392:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 20us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217195.968293:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 49 00000100:00100000:0.0:1782217195.968303:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 50 00000100:00100000:0.0:1782217195.968309:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+5:2404:x1868789693147904:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782217195.968327:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+5:2404:x1868789693147904:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 18us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217195.968338:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 50 00000100:00100000:0.0:1782217195.968356:0:19412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693147520 00000100:00100000:0.0:1782217195.968359:0:19412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693147520 00000100:00100000:0.0:1782217195.968385:0:19412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693148032 00000100:00100000:0.0:1782217195.968388:0:19412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693148032 00000100:00100000:0.0:1782217195.968397:0:19412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693147648 00000100:00100000:0.0:1782217195.968399:0:19412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693147648 00000100:00100000:0.0:1782217195.968409:0:19412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693148160 00000100:00100000:0.0:1782217195.968410:0:19412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693148160 00000100:00100000:0.0:1782217195.968421:0:19412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:0.0:1782217195.968426:0:19412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:909235f0-f9ba-458d-a9aa-26eb22b0f747+5:2404:x1868789693147520:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782217195.968462:0:19412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:909235f0-f9ba-458d-a9aa-26eb22b0f747+5:2404:x1868789693147520:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 35us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217195.968468:0:19412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:0.0:1782217195.968479:0:19412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00100000:0.0:1782217195.968485:0:19412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+6:2404:x1868789693148032:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782217195.968502:0:19412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+6:2404:x1868789693148032:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 18us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217195.968508:0:19412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00100000:0.0:1782217195.968517:0:19412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 11 00000100:00100000:0.0:1782217195.968522:0:19412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:909235f0-f9ba-458d-a9aa-26eb22b0f747+5:2404:x1868789693147648:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782217195.968538:0:19412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:909235f0-f9ba-458d-a9aa-26eb22b0f747+5:2404:x1868789693147648:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 17us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217195.968544:0:19412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 11 00000100:00100000:0.0:1782217195.968551:0:19412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 12 00000100:00100000:0.0:1782217195.968563:0:19412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+6:2404:x1868789693148160:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782217195.968620:0:19412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+6:2404:x1868789693148160:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 56us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217195.968626:0:19412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 12 00000100:00100000:0.0:1782217195.968643:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693147136 00000100:00100000:0.0:1782217195.968646:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693147136 00000100:00100000:0.0:1782217195.968668:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 145 00000100:00100000:0.0:1782217195.968674:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f498600-1642-4d0b-95a1-c3911ac9081c+13:2404:x1868789693147136:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782217195.968693:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f498600-1642-4d0b-95a1-c3911ac9081c+13:2404:x1868789693147136:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 19us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217195.968697:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 145 00000100:00080000:0.0:1782217195.968730:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782217195.968733:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782217195.968735:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782217195.968737:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:1.0:1782217196.098189:0:19516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5dfa9e82-80a8-4410-97a4-7bd2f5d1677e 00000001:00100000:2.0:1782217196.100974:0:18697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5dfa9e82-80a8-4410-97a4-7bd2f5d1677e 00010000:00010000:0.0:1782217196.419838:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782217196.989177:0:20221:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe8769f440 20000000:00000080:0.0:1782217196.989193:0:20221:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff952e4e7b8800 uarg=0000000000000000 20000000:01000000:0.0:1782217196.989243:0:20221:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1782217196.989248:0:20221:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1782217196.989252:0:20221:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1782217196.989821:0:20222:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1782217196.990140:0:20221:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1782217197.003542:0:20221:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1782217197.003571:0:20221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff952d42343200/0x92b8e04cbf5faa12 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217197.003693:0:20221:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952e72e2ce00/0x92b8e04cbf5fa6a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa6a0 expref: 23 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217197.003715:0:20221:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952e4121ce00/0x92b8e04cbf5fa6b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa6ae expref: 23 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217197.003721:0:20221:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952d43072600/0x92b8e04cbf5fa6f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa6ed expref: 23 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217197.003728:0:20221:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952d43073800/0x92b8e04cbf5fa78e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5fa787 expref: 23 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217197.003737:0:20221:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952d42342a00/0x92b8e04cbf5fa9a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9737b0 expref: 12 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217197.003744:0:20221:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff952e72e2dc00/0x92b8e04cbf5fa9e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973820 expref: 12 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217197.003751:0:20221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff952d42343200/0x92b8e04cbf5faa12 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217197.003792:0:20221:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952e72e2dc00/0x92b8e04cbf5fa9e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973820 expref: 12 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217197.003806:0:20221:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff952e72e2dc00/0x92b8e04cbf5fa9e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973820 expref: 12 pid: 17187 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217197.003822:0:20221:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41bf9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20221:1868789713147776:192.168.203.30@tcp:104: 00010000:00010000:0.0:1782217197.003922:0:20221:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952d42342a00/0x92b8e04cbf5fa9a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9737b0 expref: 12 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217197.003930:0:20221:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff952d42342a00/0x92b8e04cbf5fa9a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9737b0 expref: 12 pid: 17186 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217197.003946:0:20221:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41bf9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20221:1868789713147904:192.168.203.30@tcp:104: 00010000:00010000:0.0:1782217197.003978:0:20221:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952d43073800/0x92b8e04cbf5fa78e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5fa787 expref: 23 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217197.003986:0:20221:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff952d43073800/0x92b8e04cbf5fa78e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5fa787 expref: 23 pid: 17189 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217197.003995:0:20221:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41bfaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20221:1868789713148032:0@lo:104: 00000100:00100000:0.0:1782217197.004033:0:20221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782217197.004075:0:20221:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952d43072600/0x92b8e04cbf5fa6f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5fa6ed expref: 23 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217197.004083:0:20221:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff952d43072600/0x92b8e04cbf5fa6f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5fa6ed expref: 23 pid: 17189 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217197.004099:0:20221:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41bfbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20221:1868789713148160:0@lo:104: 00000100:00100000:0.0:1782217197.004126:0:20221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782217197.007899:0:20221:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952e4121ce00/0x92b8e04cbf5fa6b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5fa6ae expref: 23 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217197.007916:0:20221:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff952e4121ce00/0x92b8e04cbf5fa6b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5fa6ae expref: 23 pid: 17186 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217197.007930:0:20221:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41bfa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20221:1868789713148288:0@lo:104: 00000100:00100000:0.0:1782217197.007984:0:20221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782217197.011817:0:20221:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff952e72e2ce00/0x92b8e04cbf5fa6a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x92b8e04cbf5fa6a0 expref: 23 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217197.011834:0:20221:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff952e72e2ce00/0x92b8e04cbf5fa6a7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x92b8e04cbf5fa6a0 expref: 23 pid: 17187 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217197.011848:0:20221:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c670700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20221:1868789713148416:0@lo:104: 00000100:00100000:2.0:1782217197.011899:0:20221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217197.012165:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713148032 00000100:00100000:3.0:1782217197.012172:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713148032 00000100:00100000:0.0:1782217197.013499:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217197.013575:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217197.013634:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693148288 00000100:00100000:0.0:1782217197.013653:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693148288 00010000:00010000:0.0:1782217197.013693:0:17179:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952e72e2dc00/0x92b8e04cbf5fa9e1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973820 expref: 13 pid: 17187 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217197.013722:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693148416 00000100:00100000:0.0:1782217197.013725:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693148416 00010000:00010000:0.0:1782217197.013737:0:17179:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952d42342a00/0x92b8e04cbf5fa9a2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9737b0 expref: 14 pid: 17186 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217197.013751:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:0.0:1782217197.013759:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f498600-1642-4d0b-95a1-c3911ac9081c+14:2403:x1868789693148288:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782217197.013772:0:17179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217197.013777:0:17179:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952e72e2dc00/0x92b8e04cbf5fa9e1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973820 expref: 14 pid: 17187 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217197.013789:0:17179:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952e72e2dc00/0x92b8e04cbf5fa9e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973820 expref: 14 pid: 17187 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217197.013807:0:17179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217197.013852:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f498600-1642-4d0b-95a1-c3911ac9081c+14:2403:x1868789693148288:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 93us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217197.013860:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:0.0:1782217197.013877:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00100000:0.0:1782217197.013884:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f498600-1642-4d0b-95a1-c3911ac9081c+13:2403:x1868789693148416:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782217197.013892:0:17179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217197.013897:0:17179:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952d42342a00/0x92b8e04cbf5fa9a2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9737b0 expref: 13 pid: 17186 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217197.013906:0:17179:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952d42342a00/0x92b8e04cbf5fa9a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9737b0 expref: 13 pid: 17186 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217197.013923:0:17179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217197.013943:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f498600-1642-4d0b-95a1-c3911ac9081c+13:2403:x1868789693148416:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 59us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217197.013950:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00100000:2.0:1782217197.015090:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713148160 00000100:00100000:3.0:1782217197.015313:0:20221:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e45c703c0 going to sleep for 11 seconds 00010000:00010000:3.0:1782217197.015352:0:20221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e72e2dc00/0x92b8e04cbf5fa9e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973820 expref: 12 pid: 17187 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217197.015383:0:20221:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41bf9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20221:1868789713147776:192.168.203.30@tcp:104: 00010000:00010000:3.0:1782217197.015397:0:20221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952d42342a00/0x92b8e04cbf5fa9a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9737b0 expref: 11 pid: 17186 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217197.015411:0:20221:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41bf9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20221:1868789713147904:192.168.203.30@tcp:104: 00000100:00100000:2.0:1782217197.015529:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713148160 00000100:00100000:2.0:1782217197.015551:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713148288 00000100:00100000:2.0:1782217197.015554:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713148288 00000100:00100000:2.0:1782217197.015564:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713148416 00000100:00100000:2.0:1782217197.015567:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713148416 00000100:00100000:2.0:1782217197.015791:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782217197.015803:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bfb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a1470210-3884-42c5-8d09-248d2ed946c2+6:20221:x1868789713148032:12345-0@lo:104: 00010000:00010000:2.0:1782217197.015817:0:17177:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff952e41680800/0x92b8e04cbf5fa787 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5fa78e expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217197.015892:0:17177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782217197.015904:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bfb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a1470210-3884-42c5-8d09-248d2ed946c2+6:20221:x1868789713148032:12345-0@lo:104: Request processed in 105us (11871us total) trans 0 rc 0/0 00010000:00010000:0.0:1782217197.015940:0:17183:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782217197.015947:0:17183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e41680800/0x92b8e04cbf5fa787 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5fa78e expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217197.015956:0:17183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e41680800 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:0.0:1782217197.015961:0:17183:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e41680800/0x92b8e04cbf5fa787 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5fa78e expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217197.015971:0:17183:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e41680800/0x92b8e04cbf5fa787 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5fa78e expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217197.015977:0:20221:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41bfaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20221:1868789713148032:0@lo:104: 10000000:00010000:0.0:1782217197.015981:0:17183:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e41680800/0x92b8e04cbf5fa787 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5fa78e expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782217197.015990:0:17183:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782217197.016037:0:17183:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e41680800/0x92b8e04cbf5fa787 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5fa78e expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217197.016044:0:17183:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782217197.016066:0:17183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e41680800/0x92b8e04cbf5fa787 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5fa78e expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217197.016072:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e41680800/0x92b8e04cbf5fa787 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5fa78e expref: -99 pid: 19515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217197.016104:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217197.016106:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217197.016108:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782217197.016116:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782217197.016129:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a1470210-3884-42c5-8d09-248d2ed946c2:3647:1868789713148544:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782217197.016168:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217197.016202:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713148544 00000100:00100000:0.0:1782217197.016206:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713148544 00010000:00010000:0.0:1782217197.016224:0:17179:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952d43073800/0x92b8e04cbf5fa78e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5fa787 expref: 24 pid: 17189 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217197.016245:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782217197.016252:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1470210-3884-42c5-8d09-248d2ed946c2+24:3647:x1868789713148544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782217197.016261:0:17179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217197.016266:0:17179:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff952d43073800/0x92b8e04cbf5fa78e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5fa787 expref: 24 pid: 17189 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217197.016276:0:17179:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952d43073800/0x92b8e04cbf5fa78e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5fa787 expref: 24 pid: 17189 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217197.016290:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952d43073800/0x92b8e04cbf5fa78e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5fa787 expref: 24 pid: 17189 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217197.016300:0:17179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782217197.016326:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1470210-3884-42c5-8d09-248d2ed946c2+23:3647:x1868789713148544:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217197.016332:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782217197.016359:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a1470210-3884-42c5-8d09-248d2ed946c2:3647:1868789713148544:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782217197.018011:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782217197.018044:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782217197.018056:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bf8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a1470210-3884-42c5-8d09-248d2ed946c2+5:20221:x1868789713148160:12345-0@lo:104: 00010000:00010000:2.0:1782217197.018253:0:17177:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff952e41681600/0x92b8e04cbf5fa6ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5fa6f4 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217197.018377:0:17177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782217197.018383:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bf8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a1470210-3884-42c5-8d09-248d2ed946c2+5:20221:x1868789713148160:12345-0@lo:104: Request processed in 332us (14257us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217197.018390:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782217197.018405:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782217197.018412:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bf8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a1470210-3884-42c5-8d09-248d2ed946c2+4:20221:x1868789713148288:12345-0@lo:104: 00010000:00010000:2.0:1782217197.018420:0:17177:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff952e72e2cc00/0x92b8e04cbf5fa6ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5fa6b5 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217197.018460:0:17177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1782217197.018465:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bf8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a1470210-3884-42c5-8d09-248d2ed946c2+4:20221:x1868789713148288:12345-0@lo:104: Request processed in 55us (10482us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217197.018470:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782217197.018483:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782217197.018488:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c671f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a1470210-3884-42c5-8d09-248d2ed946c2+3:20221:x1868789713148416:12345-0@lo:104: 00010000:00010000:2.0:1782217197.018496:0:17177:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff952d43072a00/0x92b8e04cbf5fa6a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5fa6a7 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217197.018525:0:17177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1782217197.018540:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c671f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a1470210-3884-42c5-8d09-248d2ed946c2+3:20221:x1868789713148416:12345-0@lo:104: Request processed in 52us (6640us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217197.018545:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1782217197.018616:0:17182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1782217197.018623:0:17182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e41681600/0x92b8e04cbf5fa6ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5fa6f4 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217197.018629:0:17182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e41681600 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:1.0:1782217197.018633:0:17182:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e41681600/0x92b8e04cbf5fa6ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5fa6f4 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217197.018641:0:17182:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e41681600/0x92b8e04cbf5fa6ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5fa6f4 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782217197.018648:0:17182:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e41681600/0x92b8e04cbf5fa6ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5fa6f4 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782217197.018654:0:17182:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1782217197.018696:0:17182:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e41681600/0x92b8e04cbf5fa6ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5fa6f4 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217197.018702:0:17182:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782217197.018721:0:17182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e41681600/0x92b8e04cbf5fa6ed lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5fa6f4 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217197.018728:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e41681600/0x92b8e04cbf5fa6ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5fa6f4 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217197.018753:0:17182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782217197.018756:0:17182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952e72e2cc00/0x92b8e04cbf5fa6ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5fa6b5 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217197.018761:0:17182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e72e2cc00 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:1.0:1782217197.018764:0:17182:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952e72e2cc00/0x92b8e04cbf5fa6ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5fa6b5 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217197.018769:0:17182:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952e72e2cc00/0x92b8e04cbf5fa6ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5fa6b5 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782217197.018775:0:17182:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952e72e2cc00/0x92b8e04cbf5fa6ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5fa6b5 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782217197.018779:0:17182:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1782217197.018793:0:17182:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952e72e2cc00/0x92b8e04cbf5fa6ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5fa6b5 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217197.018799:0:17182:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782217197.018805:0:17182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952e72e2cc00/0x92b8e04cbf5fa6ae lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5fa6b5 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217197.018810:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952e72e2cc00/0x92b8e04cbf5fa6ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5fa6b5 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217197.018820:0:17182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782217197.018822:0:17182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff952d43072a00/0x92b8e04cbf5fa6a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x92b8e04cbf5fa6a7 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217197.018837:0:17182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43072a00 already unused, calling callback (ffffffffc1157c20) 10000000:00010000:1.0:1782217197.018840:0:17182:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff952d43072a00/0x92b8e04cbf5fa6a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x92b8e04cbf5fa6a7 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217197.018846:0:17182:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff952d43072a00/0x92b8e04cbf5fa6a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x92b8e04cbf5fa6a7 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782217197.018851:0:17182:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff952d43072a00/0x92b8e04cbf5fa6a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x92b8e04cbf5fa6a7 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782217197.018855:0:17182:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1782217197.018868:0:17182:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff952d43072a00/0x92b8e04cbf5fa6a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5fa6a7 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217197.018873:0:17182:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782217197.018888:0:17182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff952d43072a00/0x92b8e04cbf5fa6a0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5fa6a7 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217197.018894:0:17182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff952d43072a00/0x92b8e04cbf5fa6a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x92b8e04cbf5fa6a7 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217197.018906:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217197.018908:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782217197.018910:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782217197.018923:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43694a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a1470210-3884-42c5-8d09-248d2ed946c2:3650:1868789713148800:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782217197.018959:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217197.018992:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782217197.018998:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43694000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a1470210-3884-42c5-8d09-248d2ed946c2:3650:1868789713148672:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782217197.019030:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217197.019056:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713148800 00000100:00100000:1.0:1782217197.019061:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713148800 00010000:00010000:1.0:1782217197.019083:0:17180:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952e4121ce00/0x92b8e04cbf5fa6b5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5fa6ae expref: 23 pid: 17186 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217197.019112:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713148672 00000100:00100000:1.0:1782217197.019115:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713148672 00010000:00010000:1.0:1782217197.019126:0:17180:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952d43072600/0x92b8e04cbf5fa6f4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5fa6ed expref: 24 pid: 17189 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217197.019138:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782217197.019144:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43694700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1470210-3884-42c5-8d09-248d2ed946c2+24:3650:x1868789713148800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782217197.019153:0:17180:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782217197.019158:0:17180:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff952e4121ce00/0x92b8e04cbf5fa6b5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5fa6ae expref: 24 pid: 17186 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217197.019168:0:17180:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952e4121ce00/0x92b8e04cbf5fa6b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5fa6ae expref: 24 pid: 17186 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217197.019183:0:17180:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782217197.019210:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43694700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1470210-3884-42c5-8d09-248d2ed946c2+24:3650:x1868789713148800:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217197.019216:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782217197.019229:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782217197.019234:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72dfc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1470210-3884-42c5-8d09-248d2ed946c2+23:3650:x1868789713148672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782217197.019241:0:17180:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782217197.019244:0:17180:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff952d43072600/0x92b8e04cbf5fa6f4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5fa6ed expref: 23 pid: 17189 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217197.019263:0:17180:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952d43072600/0x92b8e04cbf5fa6f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5fa6ed expref: 23 pid: 17189 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217197.019271:0:17180:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782217197.019294:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72dfc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1470210-3884-42c5-8d09-248d2ed946c2+23:3650:x1868789713148672:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217197.019300:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782217197.019339:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782217197.019347:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43696300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a1470210-3884-42c5-8d09-248d2ed946c2:3648:1868789713148928:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782217197.019369:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217197.019405:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43694000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a1470210-3884-42c5-8d09-248d2ed946c2:3650:1868789713148672:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782217197.019412:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43694a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a1470210-3884-42c5-8d09-248d2ed946c2:3650:1868789713148800:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782217197.019433:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713148928 00000100:00100000:1.0:1782217197.019436:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713148928 00010000:00010000:1.0:1782217197.019447:0:17180:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff952e72e2ce00/0x92b8e04cbf5fa6a7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5fa6a0 expref: 23 pid: 17187 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217197.019461:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782217197.019466:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43694700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1470210-3884-42c5-8d09-248d2ed946c2+23:3648:x1868789713148928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782217197.019473:0:17180:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782217197.019477:0:17180:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff952e72e2ce00/0x92b8e04cbf5fa6a7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x92b8e04cbf5fa6a0 expref: 23 pid: 17187 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217197.019485:0:17180:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff952e72e2ce00/0x92b8e04cbf5fa6a7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x92b8e04cbf5fa6a0 expref: 23 pid: 17187 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217197.019497:0:17180:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff952d42343200/0x92b8e04cbf5faa12 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217197.019511:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952d42343200/0x92b8e04cbf5faa12 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217197.019525:0:17180:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff952d42343200/0x92b8e04cbf5faa12 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217197.019532:0:17180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff952d42343200/0x92b8e04cbf5faa12 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217197.019539:0:17180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff952d42343200/0x92b8e04cbf5faa12 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217197.019545:0:17180:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff952d42343200/0x92b8e04cbf5faa12 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217197.019550:0:17180:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d42343200 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:1.0:1782217197.019554:0:17180:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff952d42343200/0x92b8e04cbf5faa12 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217197.019560:0:17180:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff952d42343200/0x92b8e04cbf5faa12 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217197.019568:0:17180:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff952d42343200/0x92b8e04cbf5faa12 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217197.019576:0:17180:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782217197.019652:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43694700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1470210-3884-42c5-8d09-248d2ed946c2+23:3648:x1868789713148928:12345-0@lo:103:ldlm_bl.0 Request processed in 184us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217197.019658:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782217197.019695:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43696300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a1470210-3884-42c5-8d09-248d2ed946c2:3648:1868789713148928:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782217197.019918:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217197.019945:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782217197.020557:0:20221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952d43072600/0x92b8e04cbf5fa6f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5fa6ed expref: 22 pid: 17189 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217197.020571:0:20221:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41bfbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20221:1868789713148160:0@lo:104: 00010000:00010000:2.0:1782217197.022865:0:20221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e4121ce00/0x92b8e04cbf5fa6b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5fa6ae expref: 21 pid: 17186 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217197.022884:0:20221:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41bfa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20221:1868789713148288:0@lo:104: 00010000:00010000:2.0:1782217197.022898:0:20221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952e72e2ce00/0x92b8e04cbf5fa6a7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x92b8e04cbf5fa6a0 expref: 20 pid: 17187 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217197.022906:0:20221:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c670700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20221:1868789713148416:0@lo:104: 00010000:00010000:2.0:1782217197.022939:0:20221:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff952d42343200/0x92b8e04cbf5faa12 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217197.022948:0:20221:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff952d42343200/0x92b8e04cbf5faa12 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217197.022954:0:20221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff952d42343200/0x92b8e04cbf5faa12 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217197.022960:0:20221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff952d42343200/0x92b8e04cbf5faa12 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217197.115379:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782217197.115400:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43fec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713149056:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782217197.115470:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217197.119893:0:18842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713149056 00000100:00100000:0.0:1782217197.119906:0:18842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713149056 00000100:00100000:0.0:1782217197.119961:0:18842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1782217197.119971:0:18842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713149056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782217197.120006:0:18842:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1782217197.120203:0:18842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713149056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 233us (4731us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217197.120211:0:18842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1782217197.120362:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43fec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713149056:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782217197.120694:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782217197.120706:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c670700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713149184:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782217197.120751:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217197.120785:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713149184 00000100:00100000:2.0:1782217197.120789:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713149184 00000100:00100000:2.0:1782217197.120817:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1782217197.120823:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c671500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713149184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782217197.120850:0:17199:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1782217197.120880:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c671500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713149184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217197.120886:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1782217197.120915:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c670700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713149184:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1782217197.436797:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782217197.625120:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782217197.625143:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c670700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713149312:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782217197.625212:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217197.625317:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713149312 00000100:00100000:3.0:1782217197.625326:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713149312 00000100:00100000:3.0:1782217197.625395:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782217197.625404:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43696300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713149312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782217197.625434:0:18704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1782217197.625481:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43696300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713149312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217197.625488:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782217197.625540:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c670700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713149312:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1782217197.625790:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782217198.332360:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217198.332397:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693148544 00000100:00100000:3.0:1782217198.332415:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693148544 00000100:00100000:3.0:1782217198.332463:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 146 00000100:00100000:3.0:1782217198.332474:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f498600-1642-4d0b-95a1-c3911ac9081c+11:14927:x1868789693148544:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782217198.332490:0:17189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217198.332507:0:17189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e7b362000/0x92b8e04cbf5faa19 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc65e7963be973858 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217198.332533:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e7b362000/0x92b8e04cbf5faa19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973858 expref: 12 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217198.332543:0:17189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e7b362000/0x92b8e04cbf5faa19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973858 expref: 12 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217198.332551:0:17189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b362000, rc 0) 00000100:00100000:3.0:1782217198.332621:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f498600-1642-4d0b-95a1-c3911ac9081c+12:14927:x1868789693148544:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 150us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217198.332628:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 146 00000100:00100000:1.0:1782217198.337932:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217198.338017:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693148672 00000100:00100000:3.0:1782217198.338028:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693148672 00000100:00100000:3.0:1782217198.338092:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 147 00000100:00100000:3.0:1782217198.338103:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f498600-1642-4d0b-95a1-c3911ac9081c+12:14927:x1868789693148672:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782217198.338255:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f498600-1642-4d0b-95a1-c3911ac9081c+12:14927:x1868789693148672:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 153us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217198.338264:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 147 00000100:00100000:0.0:1782217198.341354:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217198.341385:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693148800 00000100:00100000:0.0:1782217198.341393:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693148800 00000100:00100000:0.0:1782217198.341437:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 148 00000100:00100000:0.0:1782217198.341446:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f498600-1642-4d0b-95a1-c3911ac9081c+12:14927:x1868789693148800:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782217198.341566:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f498600-1642-4d0b-95a1-c3911ac9081c+12:14927:x1868789693148800:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 Request processed in 120us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217198.341574:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 148 00000100:00100000:1.0:1782217198.358356:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217198.358835:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693148928 00000100:00100000:0.0:1782217198.358845:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693148928 00000100:00100000:0.0:1782217198.358932:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 149 00000100:00100000:0.0:1782217198.358942:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f498600-1642-4d0b-95a1-c3911ac9081c+12:14927:x1868789693148928:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782217198.358959:0:17189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217198.358976:0:17189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952d42342400/0x92b8e04cbf5faa20 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc65e7963be97385f expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217198.359003:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952d42342400/0x92b8e04cbf5faa20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97385f expref: 13 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217198.359025:0:17189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952d42342400/0x92b8e04cbf5faa20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97385f expref: 13 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217198.359034:0:17189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d42342400, rc 0) 00000100:00100000:0.0:1782217198.359912:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f498600-1642-4d0b-95a1-c3911ac9081c+13:14927:x1868789693148928:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 146us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217198.359926:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 149 00000100:00100000:0.0:1782217198.366308:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217198.366377:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693149056 00000100:00100000:3.0:1782217198.366386:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693149056 00000100:00100000:3.0:1782217198.366440:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 150 00000100:00100000:3.0:1782217198.366451:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f498600-1642-4d0b-95a1-c3911ac9081c+13:14927:x1868789693149056:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782217198.366627:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f498600-1642-4d0b-95a1-c3911ac9081c+13:14927:x1868789693149056:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 177us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217198.366636:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 150 00000100:00100000:3.0:1782217198.369991:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217198.370064:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693149184 00000100:00100000:1.0:1782217198.370073:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693149184 00000100:00100000:1.0:1782217198.370129:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 151 00000100:00100000:1.0:1782217198.370139:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f498600-1642-4d0b-95a1-c3911ac9081c+13:14927:x1868789693149184:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782217198.370266:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f498600-1642-4d0b-95a1-c3911ac9081c+13:14927:x1868789693149184:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 Request processed in 127us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217198.370275:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 151 10000000:01000000:2.0:1782217198.393669:0:17191:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782217198.393677:0:17191:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff952d430ff000 from 13 10000000:01000000:2.0:1782217198.393682:0:17191:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782217198.393731:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e413fc400/0x92b8e04cbf5faa27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217198.393743:0:17191:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e413fc400/0x92b8e04cbf5faa27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217198.393753:0:17191:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e413fc400/0x92b8e04cbf5faa27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217198.393779:0:17191:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c673480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713149440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782217198.393847:0:17191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217198.393888:0:17191:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e708159c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782217198.394204:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713149440 00000100:00100000:3.0:1782217198.394213:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713149440 00000100:00100000:3.0:1782217198.394265:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1782217198.394275:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c619050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+20:17191:x1868789713149440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782217198.394289:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217198.394301:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e7b363c00/0x92b8e04cbf5faa2e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5faa27 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217198.394323:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e7b363c00/0x92b8e04cbf5faa2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5faa27 expref: 21 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217198.394335:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e7b363c00/0x92b8e04cbf5faa2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5faa27 expref: 21 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217198.394344:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b363c00, rc 0) 00000100:00100000:3.0:1782217198.394394:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c619050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+21:17191:x1868789713149440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217198.394402:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1782217198.394800:0:17191:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c673480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713149440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782217198.394816:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e413fc400/0x92b8e04cbf5faa27 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5faa2e expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217198.394824:0:17191:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e413fc400/0x92b8e04cbf5faa27 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5faa2e expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217198.394882:0:17191:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c673480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713149568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782217198.394923:0:17191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217198.394947:0:17191:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e708159c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782217198.395178:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713149568 00000100:00100000:3.0:1782217198.395183:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713149568 00000100:00100000:3.0:1782217198.395222:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1782217198.395230:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c619450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+21:17191:x1868789713149568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782217198.395340:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c619450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+21:17191:x1868789713149568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217198.395354:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1782217198.395439:0:17191:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c673480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713149568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782217198.395463:0:17191:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c673480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713149696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782217198.395499:0:17191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217198.395548:0:17191:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e708159c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782217198.395970:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713149696 00000100:00100000:0.0:1782217198.395976:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713149696 00000100:00100000:0.0:1782217198.396039:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1782217198.396049:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c61a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+21:17191:x1868789713149696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782217198.396985:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c61a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+21:17191:x1868789713149696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 935us (1482us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217198.396995:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1782217198.397209:0:17191:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c673480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713149696:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1782217198.397914:0:20289:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1782217198.397972:0:17191:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1782217198.397991:0:17191:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782217198.398001:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e413fc400/0x92b8e04cbf5faa27 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5faa2e expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217198.398011:0:17191:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e413fc400/0x92b8e04cbf5faa27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5faa2e expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782217198.398021:0:17191:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782217198.398031:0:17191:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff952e42fe8000 from 13 10000000:01000000:1.0:1782217198.398034:0:17191:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782217198.398064:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e4121ce00/0x92b8e04cbf5faa35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217198.398073:0:17191:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e4121ce00/0x92b8e04cbf5faa35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217198.398216:0:17191:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e4121ce00/0x92b8e04cbf5faa35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217198.398236:0:17191:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43694a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713149824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782217198.398281:0:17191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217198.398311:0:17191:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d426766c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782217198.398327:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713149824 00000100:00100000:1.0:1782217198.398332:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713149824 00000100:00100000:1.0:1782217198.398369:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1782217198.398376:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c61b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+21:17191:x1868789713149824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782217198.398386:0:17189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217198.398397:0:17189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e4121d600/0x92b8e04cbf5faa3c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5faa35 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217198.398419:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e4121d600/0x92b8e04cbf5faa3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5faa35 expref: 22 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217198.398429:0:17189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e4121d600/0x92b8e04cbf5faa3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5faa35 expref: 22 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217198.398438:0:17189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e4121d600, rc 0) 00000100:00100000:1.0:1782217198.398467:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c61b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+22:17191:x1868789713149824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217198.398481:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1782217198.398515:0:17191:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43694a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713149824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782217198.398527:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e4121ce00/0x92b8e04cbf5faa35 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5faa3c expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217198.398534:0:17191:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e4121ce00/0x92b8e04cbf5faa35 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5faa3c expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217198.398577:0:17191:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43694a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713149952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782217198.398633:0:17191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217198.398648:0:17191:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d426766c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782217198.398791:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713149952 00000100:00100000:1.0:1782217198.398795:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713149952 00000100:00100000:1.0:1782217198.398814:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1782217198.398820:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c619c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+22:17191:x1868789713149952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782217198.398921:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c619c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+22:17191:x1868789713149952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217198.398928:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1782217198.398956:0:17191:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43694a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713149952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782217198.398982:0:17191:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43694a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713150080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782217198.399018:0:17191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217198.399031:0:17191:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d426766c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782217198.399042:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713150080 00000100:00100000:1.0:1782217198.399045:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713150080 00000100:00100000:1.0:1782217198.399062:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1782217198.399074:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c61ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+22:17191:x1868789713150080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782217198.399325:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c61ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+22:17191:x1868789713150080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 251us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217198.399331:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1782217198.399552:0:17191:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43694a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713150080:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1782217198.400941:0:20290:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1782217198.401168:0:17191:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1782217198.401192:0:17191:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782217198.401204:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e4121ce00/0x92b8e04cbf5faa35 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5faa3c expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217198.401215:0:17191:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e4121ce00/0x92b8e04cbf5faa35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5faa3c expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782217198.401226:0:17191:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782217198.401229:0:17191:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff952e7c65c000 from 13 10000000:01000000:3.0:1782217198.401232:0:17191:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782217198.401264:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7b363e00/0x92b8e04cbf5faa43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217198.401272:0:17191:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e7b363e00/0x92b8e04cbf5faa43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217198.401283:0:17191:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e7b363e00/0x92b8e04cbf5faa43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217198.401304:0:17191:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43fedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713150208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782217198.401354:0:17191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217198.401427:0:17191:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e58a75780 going to sleep for 11 seconds 00000100:00100000:0.0:1782217198.401461:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713150208 00000100:00100000:0.0:1782217198.401467:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713150208 00000100:00100000:0.0:1782217198.401544:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1782217198.401553:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c61a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+22:17191:x1868789713150208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782217198.401564:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217198.401576:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952d42343000/0x92b8e04cbf5faa4a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5faa43 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217198.401632:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952d42343000/0x92b8e04cbf5faa4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5faa43 expref: 23 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217198.401816:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952d42343000/0x92b8e04cbf5faa4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5faa43 expref: 23 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217198.401825:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d42343000, rc 0) 00000100:00100000:0.0:1782217198.401872:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c61a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+23:17191:x1868789713150208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 320us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217198.401879:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1782217198.401948:0:17191:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43fedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713150208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782217198.401963:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e7b363e00/0x92b8e04cbf5faa43 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5faa4a expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217198.401978:0:17191:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e7b363e00/0x92b8e04cbf5faa43 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5faa4a expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217198.402034:0:17191:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43fedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713150336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782217198.402062:0:17191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217198.402277:0:17191:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e58a75780 going to sleep for 11 seconds 00000100:00100000:1.0:1782217198.402341:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713150336 00000100:00100000:1.0:1782217198.402346:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713150336 00000100:00100000:1.0:1782217198.402372:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1782217198.402379:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+23:17191:x1868789713150336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782217198.402493:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c618c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+23:17191:x1868789713150336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217198.402500:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1782217198.403004:0:17191:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43fedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713150336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782217198.403040:0:17191:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43fedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713150464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782217198.403097:0:17191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217198.403112:0:17191:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e58a75780 going to sleep for 11 seconds 00000100:00100000:1.0:1782217198.403304:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713150464 00000100:00100000:1.0:1782217198.403309:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713150464 00000100:00100000:1.0:1782217198.403333:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1782217198.403341:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c61a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+23:17191:x1868789713150464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782217198.403427:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c61a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+23:17191:x1868789713150464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217198.403434:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1782217198.403501:0:17191:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43fedc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713150464:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1782217198.404506:0:20291:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1782217198.404966:0:17191:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1782217198.404987:0:17191:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782217198.404999:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e7b363e00/0x92b8e04cbf5faa43 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5faa4a expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217198.405011:0:17191:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e7b363e00/0x92b8e04cbf5faa43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5faa4a expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782217198.405022:0:17191:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782217198.405036:0:17191:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff952d43f05800 from 13 10000000:01000000:1.0:1782217198.405040:0:17191:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782217198.405071:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e4121cc00/0x92b8e04cbf5faa51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217198.405090:0:17191:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff952e4121cc00/0x92b8e04cbf5faa51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217198.405100:0:17191:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff952e4121cc00/0x92b8e04cbf5faa51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217198.405119:0:17191:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43694000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713150592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782217198.405171:0:17191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217198.405213:0:17191:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d42676f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782217198.405308:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713150592 00000100:00100000:3.0:1782217198.405315:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713150592 00000100:00100000:3.0:1782217198.405347:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1782217198.405355:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c61bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+23:17191:x1868789713150592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782217198.405368:0:17189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217198.405379:0:17189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff952e7b362a00/0x92b8e04cbf5faa58 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x92b8e04cbf5faa51 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217198.405406:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff952e7b362a00/0x92b8e04cbf5faa58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x92b8e04cbf5faa51 expref: 24 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217198.405414:0:17189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff952e7b362a00/0x92b8e04cbf5faa58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x92b8e04cbf5faa51 expref: 24 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217198.405434:0:17189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b362a00, rc 0) 00000100:00100000:3.0:1782217198.405478:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c61bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+24:17191:x1868789713150592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217198.405485:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1782217198.405558:0:17191:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43694000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713150592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782217198.405571:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff952e4121cc00/0x92b8e04cbf5faa51 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5faa58 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217198.405619:0:17191:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff952e4121cc00/0x92b8e04cbf5faa51 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x92b8e04cbf5faa58 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217198.405841:0:17191:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43694000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713150720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782217198.405867:0:17191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217198.405920:0:17191:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d42676f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782217198.405971:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713150720 00000100:00100000:0.0:1782217198.405976:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713150720 00000100:00100000:2.0:1782217198.406064:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1782217198.406074:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+24:17191:x1868789713150720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782217198.406190:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c618450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+24:17191:x1868789713150720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217198.406197:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1782217198.406411:0:17191:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43694000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713150720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782217198.406441:0:17191:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c670a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713150848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782217198.406481:0:17191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217198.406526:0:17191:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e70815d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782217198.406567:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713150848 00000100:00100000:0.0:1782217198.406571:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713150848 00000100:00100000:0.0:1782217198.406935:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1782217198.406944:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c61b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+24:17191:x1868789713150848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782217198.407078:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c61b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a1470210-3884-42c5-8d09-248d2ed946c2+24:17191:x1868789713150848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 134us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217198.407093:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1782217198.407222:0:17191:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c670a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a1470210-3884-42c5-8d09-248d2ed946c2:17191:1868789713150848:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1782217198.408329:0:20292:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1782217198.409514:0:17191:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1782217198.409545:0:17191:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782217198.409557:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff952e4121cc00/0x92b8e04cbf5faa51 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5faa58 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217198.409887:0:17191:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff952e4121cc00/0x92b8e04cbf5faa51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x92b8e04cbf5faa58 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217198.462015:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217199.486553:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782217199.673814:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782217199.673847:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43fedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713150976:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782217199.673945:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217199.674060:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713150976 00000100:00100000:3.0:1782217199.674071:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713150976 00000100:00100000:3.0:1782217199.674152:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782217199.674164:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713150976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782217199.674202:0:18705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1782217199.674259:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713150976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217199.674280:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782217199.674758:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782217199.674773:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c670a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713151104:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782217199.674815:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217199.674937:0:19988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713151104 00000100:00100000:2.0:1782217199.674943:0:19988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713151104 00000100:00100000:2.0:1782217199.674980:0:19988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782217199.674988:0:19988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43697800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713151104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782217199.675004:0:19988:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1782217199.675043:0:19988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43697800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713151104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217199.675070:0:19988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782217199.675090:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782217199.675100:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e7c673480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713151232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782217199.675129:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217199.675155:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713151232 00000100:00100000:2.0:1782217199.675159:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713151232 00000100:00100000:2.0:1782217199.675184:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782217199.675190:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c670700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713151232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782217199.675211:0:18704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1782217199.675245:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c670700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713151232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217199.675251:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782217199.675410:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c670a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713151104:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782217199.675448:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e7c673480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713151232:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782217199.675619:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782217199.675624:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782217199.675652:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43fedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713150976:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782217199.676014:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43fedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713151744:0@lo:400:kworker.0 00000100:00100000:0.0:1782217199.676058:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217199.676090:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43fee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1868789713152256:0@lo:400:kworker.0 00000100:00100000:0.0:1782217199.676130:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217199.676159:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1782217199.676164:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43feed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a1470210-3884-42c5-8d09-248d2ed946c2:3649:1868789713151360:0@lo:400:kworker.0 00000100:00100000:0.0:1782217199.676195:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217199.676225:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43fec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713151872:0@lo:400:kworker.0 00000100:00100000:0.0:1782217199.676252:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217199.676469:0:18842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713151744 00000100:00100000:1.0:1782217199.676476:0:18842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713151744 00000100:00100000:1.0:1782217199.676521:0:18842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1782217199.676530:0:18842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713151744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217199.676652:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43fef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713151488:0@lo:400:kworker.0 00000100:00100000:3.0:1782217199.677346:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713152256 00000100:00100000:3.0:1782217199.677355:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713152256 00000100:00100000:3.0:1782217199.677413:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1782217199.677424:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1868789713152256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217199.679626:0:18842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713151744:12345-0@lo:400:kworker.0 Request processed in 3082us (3552us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217199.679753:0:18842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1782217199.679859:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713151360 00000100:00100000:1.0:1782217199.679990:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713151360 00000100:00100000:1.0:1782217199.680053:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1782217199.680062:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c618050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+24:3649:x1868789713151360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217199.680126:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c618050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a1470210-3884-42c5-8d09-248d2ed946c2+24:3649:x1868789713151360:12345-0@lo:400:kworker.0 Request processed in 65us (3930us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217199.680134:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1782217199.680186:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43fedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1868789713151616:0@lo:400:kworker.0 00000100:00100000:0.0:1782217199.680226:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1868789713152384:0@lo:400:kworker.0 00000100:00100000:1.0:1782217199.681551:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217199.681640:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43fec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1868789713152128:0@lo:400:kworker.0 00000100:00100000:0.0:1782217199.681677:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713151616 00000100:00100000:0.0:1782217199.681686:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713151616 00000100:00100000:0.0:1782217199.681739:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1782217199.681749:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1868789713151616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217199.681808:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217199.681863:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1868789713152256:12345-0@lo:400:kworker.0 Request processed in 4437us (5726us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217199.681875:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1782217199.681899:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713152128 00000100:00100000:3.0:1782217199.681902:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713152128 00000100:00100000:3.0:1782217199.681924:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1782217199.681930:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1868789713152128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217199.682020:0:19412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713151872 00000100:00100000:2.0:1782217199.682022:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217199.682028:0:19412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713151872 00000100:00100000:2.0:1782217199.682058:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43feca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1868789713152000:0@lo:400:kworker.0 00000100:00100000:1.0:1782217199.682076:0:19412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782217199.682087:0:19412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713151872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217199.682095:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217199.682112:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1868789713152512:0@lo:400:kworker.0 00000100:00100000:1.0:1782217199.682139:0:19412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713151872:12345-0@lo:400:kworker.0 Request processed in 55us (5885us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217199.682149:0:19412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782217199.682150:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1782217199.682175:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782217199.682182:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782217199.682186:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782217199.682189:0:19301:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1782217199.682200:0:19301:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1782217199.682224:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713151488 00000100:00100000:2.0:1782217199.682229:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713151488 00000100:00100000:2.0:1782217199.682256:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1782217199.682282:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c673480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713151488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217199.682334:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c673480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713151488:12345-0@lo:400:kworker.0 Request processed in 52us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217199.682341:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1782217199.682523:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43fef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713151488:0@lo:400:kworker.0 00000100:00100000:2.0:1782217199.682600:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713152000 00000100:00100000:2.0:1782217199.682604:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713152000 00000100:00100000:2.0:1782217199.682624:0:19301:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1782217199.682629:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713152512 00000100:00100000:2.0:1782217199.682631:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713152512 00000100:00100000:2.0:1782217199.682656:0:19301:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1782217199.682663:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1782217199.682670:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c670a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1868789713152000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782217199.682707:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c670a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1868789713152000:12345-0@lo:400:kworker.0 Request processed in 38us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217199.682714:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1782217199.682724:0:19301:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1782217199.682729:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1782217199.682735:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1868789713152512:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1782217199.682760:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782217199.682767:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1868789713152512:12345-0@lo:400:kworker.0 Request processed in 31us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217199.682774:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1782217199.682788:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217199.682808:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43feca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1868789713152000:0@lo:400:kworker.0 00000100:00100000:1.0:1782217199.682817:0:19301:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1782217199.682825:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713152384 00010000:00080000:2.0:1782217199.682828:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d41be7b80 x1868789713152512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782217199.682830:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713152384 00000100:00100000:2.0:1782217199.682843:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1868789713152512:0@lo:400:kworker.0 00000100:00100000:1.0:1782217199.682858:0:19301:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1782217199.682868:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1782217199.683055:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1868789713152384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217199.683092:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1868789713152384:12345-0@lo:400:kworker.0 Request processed in 41us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217199.683283:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1782217199.686672:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1868789713152128:12345-0@lo:400:kworker.0 Request processed in 4725us (4848us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217199.686720:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1782217199.687627:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1868789713151616:12345-0@lo:400:kworker.0 Request processed in 5871us (6073us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217199.687641:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1782217199.688454:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782217199.688531:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1868789713152384:0@lo:400:kworker.0 00000100:00100000:1.0:1782217199.688553:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43fedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713151744:0@lo:400:kworker.0 00010000:00080000:1.0:1782217199.688608:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43fee680 x1868789713152256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782217199.688621:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43fee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1868789713152256:0@lo:400:kworker.0 00000100:00100000:1.0:1782217199.690467:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43feed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a1470210-3884-42c5-8d09-248d2ed946c2:3649:1868789713151360:0@lo:400:kworker.0 00000100:00100000:1.0:1782217199.690508:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43fec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713151872:0@lo:400:kworker.0 00000100:00100000:2.0:1782217199.693955:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43fedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1868789713151616:0@lo:400:kworker.0 00000100:00100000:2.0:1782217199.693978:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43fec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1868789713152128:0@lo:400:kworker.0 00000100:00100000:2.0:1782217200.470022:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217200.470487:0:20335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693149312 00000100:00100000:3.0:1782217200.470501:0:20335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693149312 00000100:00100000:3.0:1782217200.470941:0:20335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 23 00000100:00100000:3.0:1782217200.470953:0:20335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:909235f0-f9ba-458d-a9aa-26eb22b0f747+6:15592:x1868789693149312:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782217200.470979:0:20335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217200.471006:0:20335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362800/0x92b8e04cbf5faa5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973866 expref: -99 pid: 20335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.471100:0:20335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5faa66 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.471117:0:20335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5faa66 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.471132:0:20335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5faa66 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.471146:0:20335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363200/0x92b8e04cbf5faa6d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.471153:0:20335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363200/0x92b8e04cbf5faa6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.471160:0:20335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363200/0x92b8e04cbf5faa6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1782217200.471240:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782217200.471264:0:20335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363000/0x92b8e04cbf5faa74 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.471296:0:20335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363000/0x92b8e04cbf5faa74 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.471304:0:20335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363000/0x92b8e04cbf5faa74 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217200.471343:0:20335:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1782217200.471347:0:20335:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782217200.471392:0:20335:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363000/0x92b8e04cbf5faa74 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.471405:0:20335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5faa66 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.471412:0:20335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5faa66 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.471420:0:20335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5faa66 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.471427:0:20335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b363a00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217200.471432:0:20335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5faa66 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.471441:0:20335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5faa66 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.471455:0:20335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d427f5300) 00010000:00010000:3.0:1782217200.471458:0:20335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217200.471464:0:20335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5faa66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.471482:0:20335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5faa66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.471499:0:20335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363200/0x92b8e04cbf5faa6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.471504:0:20335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363200/0x92b8e04cbf5faa6d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.471510:0:20335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363200/0x92b8e04cbf5faa6d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.473099:0:20335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b363200 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217200.473108:0:20335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363200/0x92b8e04cbf5faa6d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.473118:0:20335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363200/0x92b8e04cbf5faa6d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.473135:0:20335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff952e46d74000) 00010000:00010000:3.0:1782217200.473138:0:20335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217200.473143:0:20335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363200/0x92b8e04cbf5faa6d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.473150:0:20335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363200/0x92b8e04cbf5faa6d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.473222:0:20335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362800/0x92b8e04cbf5faa5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973866 expref: 8 pid: 20335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.473263:0:20335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363000/0x92b8e04cbf5faa74 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973866 expref: 7 pid: 20335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.473272:0:20335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff952e46d74f00) 00010000:00010000:3.0:1782217200.473274:0:20335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782217200.473287:0:20335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b363000, rc 0) 00000100:00100000:3.0:1782217200.473387:0:20335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:909235f0-f9ba-458d-a9aa-26eb22b0f747+7:15592:x1868789693149312:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 2434us (3377us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217200.473398:0:20335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 23 00000100:00100000:1.0:1782217200.485184:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217200.487273:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693149440 00000100:00100000:0.0:1782217200.488737:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693149440 00000100:00100000:0.0:1782217200.488842:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5 00000100:00100000:0.0:1782217200.488854:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43696d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:909235f0-f9ba-458d-a9aa-26eb22b0f747+7:15592:x1868789693149440:12345-192.168.203.30@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1782217200.489033:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43696d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:909235f0-f9ba-458d-a9aa-26eb22b0f747+7:15592:x1868789693149440:12345-192.168.203.30@tcp:900:lhsmtool_posix.0 Request processed in 180us (3861us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217200.489041:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5 00000100:00100000:2.0:1782217200.494016:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217200.494126:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693149696 00000100:00100000:1.0:1782217200.494139:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693149696 00000100:00100000:1.0:1782217200.494212:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 24 00000100:00100000:1.0:1782217200.494224:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:909235f0-f9ba-458d-a9aa-26eb22b0f747+7:15592:x1868789693149696:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782217200.494251:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217200.494280:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5faa7b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be97386d expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.494374:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d200/0x92b8e04cbf5faa82 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.494393:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d200/0x92b8e04cbf5faa82 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.494409:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d200/0x92b8e04cbf5faa82 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.496155:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c800/0x92b8e04cbf5faa89 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.496181:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c800/0x92b8e04cbf5faa89 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.496194:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c800/0x92b8e04cbf5faa89 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.496976:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5faa90 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.496989:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5faa90 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.496997:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5faa90 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782217200.497007:0:19301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1782217200.497154:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d200/0x92b8e04cbf5faa82 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.497161:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d200/0x92b8e04cbf5faa82 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.497167:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d200/0x92b8e04cbf5faa82 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.497172:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121d200 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217200.497176:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d200/0x92b8e04cbf5faa82 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.497184:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d200/0x92b8e04cbf5faa82 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.497196:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff952e46d74f00) 00010000:00010000:1.0:1782217200.497199:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217200.497203:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d200/0x92b8e04cbf5faa82 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.497219:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121d200/0x92b8e04cbf5faa82 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.497232:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c800/0x92b8e04cbf5faa89 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.497237:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c800/0x92b8e04cbf5faa89 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.497242:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c800/0x92b8e04cbf5faa89 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.497246:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e4121c800 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217200.497249:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c800/0x92b8e04cbf5faa89 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.497254:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c800/0x92b8e04cbf5faa89 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.497261:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff952e48856b00) 00010000:00010000:1.0:1782217200.497263:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217200.497266:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c800/0x92b8e04cbf5faa89 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.497271:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121c800/0x92b8e04cbf5faa89 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.501936:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e4121ca00/0x92b8e04cbf5faa7b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97386d expref: 10 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.501977:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072600/0x92b8e04cbf5faa90 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97386d expref: 9 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.501987:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff952e48856700) 00010000:00010000:1.0:1782217200.501990:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217200.501993:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43072600, rc 0) 00000100:00100000:1.0:1782217200.502199:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:909235f0-f9ba-458d-a9aa-26eb22b0f747+9:15592:x1868789693149696:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 7975us (8194us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1782217200.502208:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 24 00010000:00010000:1.0:1782217200.504850:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782217200.508493:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217200.508814:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693149824 00000100:00100000:0.0:1782217200.508825:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693149824 00000100:00100000:0.0:1782217200.508887:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 25 00000100:00100000:0.0:1782217200.508898:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:909235f0-f9ba-458d-a9aa-26eb22b0f747+9:15592:x1868789693149824:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1782217200.509748:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:909235f0-f9ba-458d-a9aa-26eb22b0f747+9:15592:x1868789693149824:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 Request processed in 127us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217200.509759:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 25 00000100:00100000:0.0:1782217200.510192:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217200.512898:0:20335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693149952 00000100:00100000:3.0:1782217200.512912:0:20335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693149952 00000100:00100000:3.0:1782217200.512984:0:20335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 26 00000100:00100000:3.0:1782217200.512996:0:20335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:909235f0-f9ba-458d-a9aa-26eb22b0f747+5:15592:x1868789693149952:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 00000100:00080000:1.0:1782217200.513167:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1782217200.519466:0:20335:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 6430us 00000100:00100000:2.0:1782217200.526279:0:20335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:909235f0-f9ba-458d-a9aa-26eb22b0f747+5:15592:x1868789693149952:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 Request processed in 13278us (16081us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217200.526293:0:20335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 26 00000100:00100000:2.0:1782217200.563053:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217200.563123:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693150080 00000100:00100000:1.0:1782217200.563132:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693150080 00000100:00100000:1.0:1782217200.563182:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 27 00000100:00100000:1.0:1782217200.563190:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:909235f0-f9ba-458d-a9aa-26eb22b0f747+9:15598:x1868789693150080:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1782217200.563209:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217200.563225:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5faa9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973874 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.563280:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5faaa5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.563294:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5faaa5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.563305:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5faaa5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.563334:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5faaac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.563341:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5faaac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.563348:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5faaac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.563388:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5faaa5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.563395:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5faaa5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.563402:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5faaa5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.563408:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43073400 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217200.563412:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5faaa5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.563418:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5faaa5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.563445:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d427f5300) 00010000:00010000:1.0:1782217200.563449:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217200.563453:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5faaa5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.563459:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5faaa5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.563477:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5faaac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.563483:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5faaac lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.563489:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5faaac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.563494:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43073e00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217200.563497:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5faaac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.563503:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5faaac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.563510:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff952e48856b00) 00010000:00010000:1.0:1782217200.563512:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217200.563514:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5faaac lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.563520:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5faaac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.563548:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5faa9e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973874 expref: 10 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.563556:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d427f5300) 00010000:00010000:1.0:1782217200.563558:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217200.563579:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073800/0x92b8e04cbf5faa9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973874 expref: 10 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.563650:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43073800, rc 0) 00000100:00100000:0.0:1782217200.563993:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:909235f0-f9ba-458d-a9aa-26eb22b0f747+9:15598:x1868789693150080:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 801us (946us total) trans 0 rc 301/301 00000100:00100000:0.0:1782217200.564003:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 27 00000100:00100000:1.0:1782217200.572296:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217200.574091:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693150208 00000100:00100000:2.0:1782217200.574105:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693150208 00000100:00100000:2.0:1782217200.574165:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:2.0:1782217200.574174:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43694000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:909235f0-f9ba-458d-a9aa-26eb22b0f747+9:15598:x1868789693150208:12345-192.168.203.30@tcp:700:lfs.0 00000100:00100000:2.0:1782217200.574257:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43694000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:909235f0-f9ba-458d-a9aa-26eb22b0f747+9:15598:x1868789693150208:12345-192.168.203.30@tcp:700:lfs.0 Request processed in 84us (1970us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217200.574264:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:0.0:1782217200.577232:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217200.577453:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693150464 00000100:00100000:2.0:1782217200.577463:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693150464 00000100:00100000:2.0:1782217200.577517:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 28 00000100:00100000:2.0:1782217200.577527:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:909235f0-f9ba-458d-a9aa-26eb22b0f747+9:15598:x1868789693150464:12345-192.168.203.30@tcp:36:lfs.0 00010000:00010000:2.0:1782217200.577635:0:17195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217200.577667:0:17195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342200/0x92b8e04cbf5fa9cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9737e1 expref: 9 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217200.577691:0:17195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d427f5300) 00010000:00010000:2.0:1782217200.577707:0:17195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782217200.577772:0:17195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc200/0x92b8e04cbf5faab3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217200.577786:0:17195:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5faa0b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973851 expref: 5 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217200.577794:0:17195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc200/0x92b8e04cbf5faab3 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217200.577825:0:17195:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5faa0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973851 expref: 5 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217200.577839:0:17195:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5faa0b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973851 expref: 5 pid: 17196 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217200.577853:0:17195:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43feed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17195:1868789713152640:192.168.203.30@tcp:104: 00000100:00100000:2.0:1782217200.577922:0:17195:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e7c793c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782217200.581517:0:17195:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43feed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17195:1868789713152640:192.168.203.30@tcp:104: 00010000:00010000:2.0:1782217200.581545:0:17195:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc200/0x92b8e04cbf5faab3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217200.582270:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217200.582342:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693150592 00000100:00100000:1.0:1782217200.582349:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693150592 00010000:00010000:1.0:1782217200.582396:0:17180:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5faa0b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973851 expref: 6 pid: 17196 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217200.582436:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 15 00000100:00100000:1.0:1782217200.582445:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+6:2402:x1868789693150592:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782217200.582460:0:17180:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782217200.582466:0:17180:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5faa0b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973851 expref: 6 pid: 17196 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.582477:0:17180:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5faa0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973851 expref: 6 pid: 17196 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.582498:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e72e2ca00/0x92b8e04cbf5faa0b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973851 expref: 6 pid: 17196 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.582513:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d427f5300) 00010000:00010000:1.0:1782217200.582518:0:17180:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc200/0x92b8e04cbf5faab3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.582528:0:17180:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc200/0x92b8e04cbf5faab3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.582550:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc200/0x92b8e04cbf5faab3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.582609:0:17180:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782217200.582662:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+5:2402:x1868789693150592:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 217us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217200.582670:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 15 00010000:00010000:3.0:1782217200.582800:0:17195:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc200/0x92b8e04cbf5faab3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.582809:0:17195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc200/0x92b8e04cbf5faab3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.582833:0:17195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362800/0x92b8e04cbf5faaba lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.582841:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362800/0x92b8e04cbf5faaba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.582848:0:17195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362800/0x92b8e04cbf5faaba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1782217200.583324:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782217200.597294:0:17195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363200/0x92b8e04cbf5faac1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.597317:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363200/0x92b8e04cbf5faac1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.597329:0:17195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363200/0x92b8e04cbf5faac1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782217200.597347:0:17195:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000edcb7693 reply state 00000000e245e961 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363200/0x92b8e04cbf5faac1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.597359:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363200/0x92b8e04cbf5faac1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.597366:0:17195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff952e46d74400) 00010000:00010000:3.0:1782217200.597369:0:17195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782217200.597373:0:17195:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1782217200.597378:0:17195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1782217200.597386:0:17195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc200/0x92b8e04cbf5faab3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.597392:0:17195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc200/0x92b8e04cbf5faab3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.597399:0:17195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc200/0x92b8e04cbf5faab3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.597404:0:17195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e413fc200 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217200.597409:0:17195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc200/0x92b8e04cbf5faab3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.597427:0:17195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc200/0x92b8e04cbf5faab3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.597439:0:17195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d427f5300) 00010000:00010000:3.0:1782217200.597442:0:17195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217200.597445:0:17195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc200/0x92b8e04cbf5faab3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.597451:0:17195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc200/0x92b8e04cbf5faab3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782217200.597470:0:17195:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000edcb7693 reply state 00000000e245e961 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362800/0x92b8e04cbf5faaba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.597479:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362800/0x92b8e04cbf5faaba lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.597484:0:17195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff952e46d74000) 00010000:00010000:3.0:1782217200.597486:0:17195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782217200.597488:0:17195:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1782217200.597623:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:909235f0-f9ba-458d-a9aa-26eb22b0f747+10:15598:x1868789693150464:12345-192.168.203.30@tcp:36:lfs.0 Request processed in 20091us (20393us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1782217200.597632:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 28 00000100:00100000:0.0:1782217200.697151:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217200.697266:0:20335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693150720 00000100:00100000:2.0:1782217200.697276:0:20335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693150720 00000100:00100000:2.0:1782217200.697336:0:20335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 29 00000100:00100000:2.0:1782217200.697347:0:20335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:909235f0-f9ba-458d-a9aa-26eb22b0f747+10:15607:x1868789693150720:12345-192.168.203.30@tcp:101:lctl.0 00010000:00010000:2.0:1782217200.697383:0:20335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217200.697724:0:20335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc600/0x92b8e04cbf5faac8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be97387b expref: -99 pid: 20335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217200.697791:0:20335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fde00/0x92b8e04cbf5faacf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217200.697804:0:20335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fde00/0x92b8e04cbf5faacf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217200.697815:0:20335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fde00/0x92b8e04cbf5faacf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217200.697858:0:20335:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1782217200.697863:0:20335:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782217200.697896:0:20335:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fde00/0x92b8e04cbf5faacf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217200.697920:0:20335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc600/0x92b8e04cbf5faac8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97387b expref: 12 pid: 20335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217200.697939:0:20335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fde00/0x92b8e04cbf5faacf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97387b expref: 11 pid: 20335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217200.697948:0:20335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d410abc00) 00010000:00010000:2.0:1782217200.697952:0:20335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782217200.697956:0:20335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e413fde00, rc 0) 00000100:00100000:2.0:1782217200.698020:0:20335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:909235f0-f9ba-458d-a9aa-26eb22b0f747+11:15607:x1868789693150720:12345-192.168.203.30@tcp:101:lctl.0 Request processed in 675us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217200.699328:0:20335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 29 00000100:00100000:1.0:1782217200.727889:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217200.729528:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693150848 00000100:00100000:0.0:1782217200.729542:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693150848 00000100:00100000:0.0:1782217200.729652:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 30 00000100:00100000:0.0:1782217200.729663:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+5:15608:x1868789693150848:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1782217200.729682:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217200.729703:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342e00/0x92b8e04cbf5faad6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973882 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217200.729764:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d42343c00/0x92b8e04cbf5faadd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217200.729776:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d42343c00/0x92b8e04cbf5faadd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217200.729788:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d42343c00/0x92b8e04cbf5faadd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782217200.729834:0:19301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1782217200.729850:0:19301:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782217200.729876:0:19301:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952d42343c00/0x92b8e04cbf5faadd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217200.729904:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342e00/0x92b8e04cbf5faad6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973882 expref: 7 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217200.729930:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952d42343c00/0x92b8e04cbf5faadd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973882 expref: 6 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217200.729938:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d410abc00) 00010000:00010000:0.0:1782217200.729941:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782217200.729944:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d42343c00, rc 0) 00000100:00100000:0.0:1782217200.730018:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+6:15608:x1868789693150848:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 357us (2140us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217200.730035:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 30 00000100:00100000:1.0:1782217200.737473:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217200.737569:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693150976 00000100:00100000:3.0:1782217200.737580:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693150976 00000100:00100000:3.0:1782217200.737683:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 31 00000100:00100000:3.0:1782217200.737695:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+6:15608:x1868789693150976:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1782217200.737723:0:17195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217200.737744:0:17195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5faae4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973889 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.737818:0:17195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362600/0x92b8e04cbf5faaeb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.737832:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362600/0x92b8e04cbf5faaeb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.737843:0:17195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362600/0x92b8e04cbf5faaeb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.737854:0:17195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363400/0x92b8e04cbf5faaf2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.737862:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363400/0x92b8e04cbf5faaf2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.737868:0:17195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363400/0x92b8e04cbf5faaf2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.737939:0:17195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363800/0x92b8e04cbf5faaf9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.737947:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363800/0x92b8e04cbf5faaf9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.737953:0:17195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363800/0x92b8e04cbf5faaf9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217200.737991:0:17195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1782217200.737995:0:17195:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782217200.738013:0:17195:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363800/0x92b8e04cbf5faaf9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.738037:0:17195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362600/0x92b8e04cbf5faaeb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.738043:0:17195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362600/0x92b8e04cbf5faaeb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.738050:0:17195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362600/0x92b8e04cbf5faaeb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.738056:0:17195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362600 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217200.738060:0:17195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362600/0x92b8e04cbf5faaeb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.738066:0:17195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362600/0x92b8e04cbf5faaeb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.738093:0:17195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d410abc00) 00010000:00010000:3.0:1782217200.738097:0:17195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217200.738100:0:17195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362600/0x92b8e04cbf5faaeb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.738107:0:17195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362600/0x92b8e04cbf5faaeb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.738118:0:17195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363400/0x92b8e04cbf5faaf2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.738124:0:17195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363400/0x92b8e04cbf5faaf2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.738130:0:17195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363400/0x92b8e04cbf5faaf2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.738142:0:17195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b363400 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217200.738145:0:17195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363400/0x92b8e04cbf5faaf2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.738151:0:17195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363400/0x92b8e04cbf5faaf2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.738160:0:17195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff952e46d74000) 00010000:00010000:3.0:1782217200.738162:0:17195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217200.738165:0:17195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363400/0x92b8e04cbf5faaf2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.738171:0:17195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363400/0x92b8e04cbf5faaf2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.738195:0:17195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5faae4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973889 expref: 8 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.738208:0:17195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363800/0x92b8e04cbf5faaf9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973889 expref: 7 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.738214:0:17195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff952e46d74400) 00010000:00010000:3.0:1782217200.738217:0:17195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782217200.738219:0:17195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b363800, rc 0) 00000100:00100000:3.0:1782217200.738278:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+7:15608:x1868789693150976:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 587us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217200.738285:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 31 00000100:00100000:2.0:1782217200.746302:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217200.746409:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693151104 00000100:00100000:0.0:1782217200.746429:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693151104 00000100:00100000:0.0:1782217200.746505:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6 00000100:00100000:0.0:1782217200.746516:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43feed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+5:15608:x1868789693151104:12345-192.168.203.30@tcp:900:lfs.0 00000100:00100000:0.0:1782217200.746633:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43feed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+5:15608:x1868789693151104:12345-192.168.203.30@tcp:900:lfs.0 Request processed in 118us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217200.746641:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6 00000100:00080000:2.0:1782217200.746831:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782217200.755694:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217200.755795:0:20335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693151360 00000100:00100000:2.0:1782217200.755805:0:20335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693151360 00000100:00100000:2.0:1782217200.755864:0:20335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 32 00000100:00100000:2.0:1782217200.755873:0:20335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+7:15608:x1868789693151360:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1782217200.755893:0:20335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217200.755912:0:20335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc000/0x92b8e04cbf5fab00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973890 expref: -99 pid: 20335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217200.756013:0:20335:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1782217200.756122:0:20335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc000/0x92b8e04cbf5fab00 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973890 expref: 9 pid: 20335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217200.756136:0:20335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d410abc00) 00010000:00010000:2.0:1782217200.756139:0:20335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782217200.756143:0:20335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc000/0x92b8e04cbf5fab00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973890 expref: 9 pid: 20335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217200.756158:0:20335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e413fc000, rc 0) 00000100:00100000:2.0:1782217200.756396:0:20335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+8:15608:x1868789693151360:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 346us (534us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1782217200.756405:0:20335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 32 00000100:00100000:3.0:1782217200.763410:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217200.763680:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693151616 00000100:00100000:0.0:1782217200.763691:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693151616 00000100:00100000:0.0:1782217200.764024:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 33 00000100:00100000:0.0:1782217200.764035:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+8:15608:x1868789693151616:12345-192.168.203.30@tcp:36:lfs.0 00010000:00010000:0.0:1782217200.764193:0:19301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217200.764227:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363800/0x92b8e04cbf5faaf9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973889 expref: 8 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217200.764248:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff952e46d74400) 00010000:00010000:0.0:1782217200.764252:0:19301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782217200.764274:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342c00/0x92b8e04cbf5fab0e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217200.764287:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342c00/0x92b8e04cbf5fab0e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217200.764296:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342c00/0x92b8e04cbf5fab0e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782217200.764480:0:19301:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c5674c97 reply state 00000000df45ebe7 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342c00/0x92b8e04cbf5fab0e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217200.764493:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342c00/0x92b8e04cbf5fab0e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217200.764500:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff952e46d74400) 00010000:00010000:0.0:1782217200.764503:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1782217200.764574:0:19301:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1782217200.764659:0:19301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1782217200.764813:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+9:15608:x1868789693151616:12345-192.168.203.30@tcp:36:lfs.0 Request processed in 778us (1410us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1782217200.764821:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 33 00000100:00100000:0.0:1782217200.769141:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217200.771027:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693151872 00000100:00100000:1.0:1782217200.771141:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693151872 00000100:00100000:1.0:1782217200.771286:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2 00000100:00100000:1.0:1782217200.771296:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+9:15608:x1868789693151872:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:1.0:1782217200.771556:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+10:15608:x1868789693151872:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 260us (2422us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1782217200.771573:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2 00000100:00100000:1.0:1782217200.778808:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217200.779301:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693152128 00000100:00100000:3.0:1782217200.779311:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693152128 00000100:00100000:3.0:1782217200.779425:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 34 00000100:00100000:3.0:1782217200.779437:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+10:15608:x1868789693152128:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1782217200.779460:0:17195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217200.779479:0:17195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5fab15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973897 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.779558:0:17195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363400/0x92b8e04cbf5fab1c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.779613:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363400/0x92b8e04cbf5fab1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.779626:0:17195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363400/0x92b8e04cbf5fab1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.779816:0:17195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362600/0x92b8e04cbf5fab23 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.779826:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362600/0x92b8e04cbf5fab23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.779834:0:17195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362600/0x92b8e04cbf5fab23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217200.780023:0:17195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1782217200.780158:0:17195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363400/0x92b8e04cbf5fab1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.780166:0:17195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363400/0x92b8e04cbf5fab1c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.780186:0:17195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363400/0x92b8e04cbf5fab1c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.780191:0:17195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b363400 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217200.780195:0:17195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363400/0x92b8e04cbf5fab1c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.780202:0:17195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363400/0x92b8e04cbf5fab1c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.780214:0:17195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d410abc00) 00010000:00010000:3.0:1782217200.780216:0:17195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217200.780220:0:17195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363400/0x92b8e04cbf5fab1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.780226:0:17195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363400/0x92b8e04cbf5fab1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.780239:0:17195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362600/0x92b8e04cbf5fab23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.780245:0:17195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362600/0x92b8e04cbf5fab23 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.780250:0:17195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362600/0x92b8e04cbf5fab23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.780255:0:17195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362600 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217200.780258:0:17195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362600/0x92b8e04cbf5fab23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.780274:0:17195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362600/0x92b8e04cbf5fab23 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.780281:0:17195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff952e46d74000) 00010000:00010000:3.0:1782217200.780284:0:17195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217200.780287:0:17195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362600/0x92b8e04cbf5fab23 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.780292:0:17195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362600/0x92b8e04cbf5fab23 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.780325:0:17195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5fab15 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973897 expref: 12 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.780335:0:17195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d410abc00) 00010000:00010000:3.0:1782217200.780337:0:17195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782217200.780341:0:17195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5fab15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973897 expref: 12 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.780349:0:17195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b363a00, rc 0) 00000100:00100000:3.0:1782217200.780415:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+11:15608:x1868789693152128:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 980us (1618us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1782217200.780423:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 34 00000100:00100000:0.0:1782217200.792897:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217200.793282:0:20335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693152256 00000100:00100000:2.0:1782217200.793292:0:20335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693152256 00000100:00100000:2.0:1782217200.793398:0:20335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 35 00000100:00100000:2.0:1782217200.793418:0:20335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+11:15608:x1868789693152256:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1782217200.793451:0:20335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217200.793486:0:20335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fcc00/0x92b8e04cbf5fab31 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be97389e expref: -99 pid: 20335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217200.793636:0:20335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc800/0x92b8e04cbf5fab38 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217200.793651:0:20335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc800/0x92b8e04cbf5fab38 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217200.793661:0:20335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc800/0x92b8e04cbf5fab38 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217200.793686:0:20335:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1782217200.793690:0:20335:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782217200.793707:0:20335:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc800/0x92b8e04cbf5fab38 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217200.793731:0:20335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fcc00/0x92b8e04cbf5fab31 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97389e expref: 13 pid: 20335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217200.793750:0:20335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc800/0x92b8e04cbf5fab38 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97389e expref: 12 pid: 20335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217200.793760:0:20335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff952e46d74400) 00010000:00010000:2.0:1782217200.793763:0:20335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782217200.793766:0:20335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e413fc800, rc 0) 00000100:00100000:2.0:1782217200.793825:0:20335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+12:15608:x1868789693152256:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 416us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217200.793833:0:20335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 35 00000100:00100000:2.0:1782217200.808299:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217200.808399:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693152384 00000100:00100000:3.0:1782217200.808409:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693152384 00000100:00100000:3.0:1782217200.808521:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3 00000100:00100000:3.0:1782217200.808532:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+12:15608:x1868789693152384:12345-192.168.203.30@tcp:37:lfs.0 00000100:00100000:3.0:1782217200.811974:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+12:15608:x1868789693152384:12345-192.168.203.30@tcp:37:lfs.0 Request processed in 3434us (3675us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217200.811988:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3 00000100:00100000:0.0:1782217200.816015:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217200.816200:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693152640 00000100:00100000:1.0:1782217200.816210:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693152640 00000100:00100000:1.0:1782217200.816294:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 4 00000100:00100000:1.0:1782217200.816304:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e23c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+12:15608:x1868789693152640:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:1.0:1782217200.816628:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e23c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+13:15608:x1868789693152640:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 324us (620us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1782217200.816636:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 4 00000040:00080000:3.0:1782217200.826137:0:17230:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1782217200.903229:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217200.906812:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693152768 00000100:00100000:0.0:1782217200.906842:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693152768 00000100:00100000:0.0:1782217200.906972:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 36 00000100:00100000:0.0:1782217200.906993:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:909235f0-f9ba-458d-a9aa-26eb22b0f747+11:15614:x1868789693152768:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:0.0:1782217200.907015:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217200.907038:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342a00/0x92b8e04cbf5fab3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9738a5 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217200.907115:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d42343400/0x92b8e04cbf5fab46 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217200.907130:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d42343400/0x92b8e04cbf5fab46 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217200.907142:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d42343400/0x92b8e04cbf5fab46 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217200.907153:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342000/0x92b8e04cbf5fab4d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217200.907161:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342000/0x92b8e04cbf5fab4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217200.907168:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342000/0x92b8e04cbf5fab4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217200.907260:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d42343200/0x92b8e04cbf5fab54 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217200.907269:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d42343200/0x92b8e04cbf5fab54 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217200.907276:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d42343200/0x92b8e04cbf5fab54 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782217200.907313:0:19301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1782217200.907317:0:19301:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782217200.907347:0:19301:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952d42343200/0x92b8e04cbf5fab54 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217200.907358:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d42343400/0x92b8e04cbf5fab46 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217200.907364:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d42343400/0x92b8e04cbf5fab46 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217200.907370:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d42343400/0x92b8e04cbf5fab46 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217200.907375:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d42343400 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782217200.907379:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d42343400/0x92b8e04cbf5fab46 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217200.907387:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d42343400/0x92b8e04cbf5fab46 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217200.907399:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d410abc00) 00010000:00010000:0.0:1782217200.907401:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217200.907405:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d42343400/0x92b8e04cbf5fab46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217200.907411:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d42343400/0x92b8e04cbf5fab46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217200.907428:0:19301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342000/0x92b8e04cbf5fab4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217200.907443:0:19301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342000/0x92b8e04cbf5fab4d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217200.907449:0:19301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342000/0x92b8e04cbf5fab4d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217200.907453:0:19301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d42342000 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782217200.907457:0:19301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342000/0x92b8e04cbf5fab4d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217200.907463:0:19301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342000/0x92b8e04cbf5fab4d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217200.907470:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff952e46d74000) 00010000:00010000:0.0:1782217200.907472:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217200.907475:0:19301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342000/0x92b8e04cbf5fab4d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217200.907481:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342000/0x92b8e04cbf5fab4d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217200.907523:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342a00/0x92b8e04cbf5fab3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738a5 expref: 13 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217200.907539:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952d42343200/0x92b8e04cbf5fab54 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738a5 expref: 12 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217200.907546:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff952e46d74400) 00010000:00010000:0.0:1782217200.907548:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1782217200.907556:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d42343200, rc 0) 00000100:00100000:0.0:1782217200.909328:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:909235f0-f9ba-458d-a9aa-26eb22b0f747+12:15614:x1868789693152768:12345-192.168.203.30@tcp:101:bash.0 Request processed in 2336us (6108us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217200.909341:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 36 00000100:00100000:1.0:1782217200.914469:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217200.914662:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693152896 00000100:00100000:2.0:1782217200.914672:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693152896 00000100:00100000:2.0:1782217200.914842:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:2.0:1782217200.914853:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43695880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:909235f0-f9ba-458d-a9aa-26eb22b0f747+5:15614:x1868789693152896:12345-192.168.203.30@tcp:900:bash.0 00000100:00100000:2.0:1782217200.914938:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43695880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:909235f0-f9ba-458d-a9aa-26eb22b0f747+5:15614:x1868789693152896:12345-192.168.203.30@tcp:900:bash.0 Request processed in 86us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217200.914946:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:2.0:1782217200.919811:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217200.920130:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693153152 00000100:00100000:3.0:1782217200.920139:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693153152 00000100:00100000:3.0:1782217200.920197:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 37 00000100:00100000:3.0:1782217200.920206:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43feca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:909235f0-f9ba-458d-a9aa-26eb22b0f747+12:15614:x1868789693153152:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:3.0:1782217200.920228:0:17195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217200.920247:0:17195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5fab5b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9738ac expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.920347:0:17195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362600/0x92b8e04cbf5fab62 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.920363:0:17195:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc800/0x92b8e04cbf5fab38 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97389e expref: 12 pid: 20335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.920371:0:17195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362600/0x92b8e04cbf5fab62 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.920407:0:17195:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc800/0x92b8e04cbf5fab38 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97389e expref: 12 pid: 20335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.920421:0:17195:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc800/0x92b8e04cbf5fab38 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97389e expref: 12 pid: 20335 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217200.920435:0:17195:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17195:1868789713152768:192.168.203.30@tcp:104: 00000100:00100000:3.0:1782217200.920690:0:17195:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e46069240 going to sleep for 11 seconds 00000100:00100000:3.0:1782217200.925367:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217200.925730:0:17195:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17195:1868789713152768:192.168.203.30@tcp:104: 00010000:00010000:2.0:1782217200.925757:0:17195:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362600/0x92b8e04cbf5fab62 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217200.925967:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693153280 00000100:00100000:0.0:1782217200.925975:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693153280 00010000:00010000:1.0:1782217200.926202:0:17179:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc800/0x92b8e04cbf5fab38 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97389e expref: 13 pid: 20335 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217200.926330:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:1.0:1782217200.926341:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+13:2403:x1868789693153280:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782217200.926355:0:17179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782217200.926362:0:17179:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc800/0x92b8e04cbf5fab38 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97389e expref: 13 pid: 20335 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.926374:0:17179:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc800/0x92b8e04cbf5fab38 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97389e expref: 13 pid: 20335 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.926395:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc800/0x92b8e04cbf5fab38 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97389e expref: 13 pid: 20335 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.926412:0:17179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff952e46d74400) 00010000:00010000:1.0:1782217200.926417:0:17179:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362600/0x92b8e04cbf5fab62 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.926426:0:17179:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362600/0x92b8e04cbf5fab62 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.926434:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362600/0x92b8e04cbf5fab62 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217200.926462:0:17179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782217200.926524:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+12:2403:x1868789693153280:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 183us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217200.926532:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 16 00010000:00010000:3.0:1782217200.926604:0:17195:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362600/0x92b8e04cbf5fab62 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.926611:0:17195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362600/0x92b8e04cbf5fab62 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.926634:0:17195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363400/0x92b8e04cbf5fab69 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.926654:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363400/0x92b8e04cbf5fab69 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.926661:0:17195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363400/0x92b8e04cbf5fab69 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.927281:0:17195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363600/0x92b8e04cbf5fab70 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.927291:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363600/0x92b8e04cbf5fab70 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.927298:0:17195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363600/0x92b8e04cbf5fab70 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217200.927308:0:17195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1782217200.927335:0:17195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362600/0x92b8e04cbf5fab62 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.927342:0:17195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362600/0x92b8e04cbf5fab62 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.927358:0:17195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362600/0x92b8e04cbf5fab62 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.927363:0:17195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362600 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217200.927367:0:17195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362600/0x92b8e04cbf5fab62 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.927375:0:17195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362600/0x92b8e04cbf5fab62 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.927384:0:17195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff952e46d74400) 00010000:00010000:3.0:1782217200.927387:0:17195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217200.927391:0:17195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362600/0x92b8e04cbf5fab62 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.927397:0:17195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362600/0x92b8e04cbf5fab62 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782217200.927408:0:17195:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a752669f reply state 00000000a70176ee transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363400/0x92b8e04cbf5fab69 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.927419:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363400/0x92b8e04cbf5fab69 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.927424:0:17195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff952e46d74c00) 00010000:00010000:3.0:1782217200.927426:0:17195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782217200.927428:0:17195:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782217200.927461:0:17195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5fab5b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738ac expref: 15 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.927474:0:17195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363600/0x92b8e04cbf5fab70 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738ac expref: 14 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217200.927487:0:17195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:3.0:1782217200.927490:0:17195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1782217200.927492:0:17195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b363600, rc 0) 00000100:00100000:3.0:1782217200.927534:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43feca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:909235f0-f9ba-458d-a9aa-26eb22b0f747+15:15614:x1868789693153152:12345-192.168.203.30@tcp:101:bash.0 Request processed in 7329us (7732us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1782217200.927542:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 37 00000100:00100000:1.0:1782217200.943475:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217200.943902:0:20335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693153408 00000100:00100000:2.0:1782217200.943913:0:20335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693153408 00000100:00100000:2.0:1782217200.944009:0:20335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 38 00000100:00100000:2.0:1782217200.944019:0:20335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:909235f0-f9ba-458d-a9aa-26eb22b0f747+15:15614:x1868789693153408:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:2.0:1782217200.944044:0:20335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217200.944071:0:20335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd000/0x92b8e04cbf5fab7e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9738b3 expref: -99 pid: 20335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217200.944138:0:20335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd400/0x92b8e04cbf5fab85 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217200.944153:0:20335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd400/0x92b8e04cbf5fab85 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217200.944164:0:20335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd400/0x92b8e04cbf5fab85 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217200.944241:0:20335:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1782217200.944246:0:20335:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782217200.944267:0:20335:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd400/0x92b8e04cbf5fab85 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217200.944277:0:20335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd400/0x92b8e04cbf5fab85 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217200.944301:0:20335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd000/0x92b8e04cbf5fab7e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738b3 expref: 17 pid: 20335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217200.944318:0:20335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd400/0x92b8e04cbf5fab85 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738b3 expref: 16 pid: 20335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217200.944327:0:20335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:2.0:1782217200.944329:0:20335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782217200.944333:0:20335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e413fd400, rc 0) 00000100:00100000:2.0:1782217200.944395:0:20335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:909235f0-f9ba-458d-a9aa-26eb22b0f747+16:15614:x1868789693153408:12345-192.168.203.30@tcp:101:bash.0 Request processed in 377us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217200.944403:0:20335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 38 00000100:00100000:0.0:1782217200.947915:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217200.948121:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693153664 00000100:00100000:3.0:1782217200.948130:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693153664 00000100:00100000:3.0:1782217200.948213:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5 00000100:00100000:3.0:1782217200.948223:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:909235f0-f9ba-458d-a9aa-26eb22b0f747+16:15614:x1868789693153664:12345-192.168.203.30@tcp:35:bash.0 00000100:00100000:3.0:1782217200.948541:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:909235f0-f9ba-458d-a9aa-26eb22b0f747+17:15614:x1868789693153664:12345-192.168.203.30@tcp:35:bash.0 Request processed in 319us (635us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1782217200.948550:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5 00000100:00100000:0.0:1782217201.018890:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217201.019217:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693153920 00000100:00100000:2.0:1782217201.019227:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693153920 00000100:00100000:2.0:1782217201.019290:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 39 00000100:00100000:2.0:1782217201.019300:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:909235f0-f9ba-458d-a9aa-26eb22b0f747+17:15624:x1868789693153920:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1782217201.019323:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217201.019344:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd000/0x92b8e04cbf5fab8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9738ba expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217201.025958:0:19301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1782217201.026100:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd000/0x92b8e04cbf5fab8c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738ba expref: 19 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.026117:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff952d410abc00) 00010000:00010000:3.0:1782217201.026119:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782217201.026125:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd000/0x92b8e04cbf5fab8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738ba expref: 19 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.026141:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e413fd000, rc 0) 00000100:00100000:3.0:1782217201.026206:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:909235f0-f9ba-458d-a9aa-26eb22b0f747+18:15624:x1868789693153920:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 6907us (7323us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1782217201.026230:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 39 00000100:00100000:0.0:1782217201.029902:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217201.029986:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693154176 00000100:00100000:1.0:1782217201.030021:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693154176 00000100:00100000:1.0:1782217201.030085:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6 00000100:00100000:3.0:1782217201.030091:0:17198:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:3.0:1782217201.030100:0:17198:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:1.0:1782217201.030103:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:909235f0-f9ba-458d-a9aa-26eb22b0f747+18:15624:x1868789693154176:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:1.0:1782217201.030624:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:909235f0-f9ba-458d-a9aa-26eb22b0f747+19:15624:x1868789693154176:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 527us (729us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1782217201.030633:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6 00000100:00100000:0.0:1782217201.074504:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217201.074625:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693154432 00000100:00100000:3.0:1782217201.074634:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693154432 00000100:00100000:3.0:1782217201.074689:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 40 00000100:00100000:3.0:1782217201.074699:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:909235f0-f9ba-458d-a9aa-26eb22b0f747+19:15627:x1868789693154432:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1782217201.074782:0:17195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217201.074803:0:17195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5fab9a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9738c1 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.076775:0:17195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362600/0x92b8e04cbf5faba1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.076797:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362600/0x92b8e04cbf5faba1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.076810:0:17195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362600/0x92b8e04cbf5faba1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217201.076822:0:17195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1782217201.077779:0:17195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5fab9a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738c1 expref: 22 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.077802:0:17195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362600/0x92b8e04cbf5faba1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738c1 expref: 21 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.077812:0:17195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:3.0:1782217201.077827:0:17195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782217201.077831:0:17195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b362600, rc 0) 00000100:00100000:3.0:1782217201.077890:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:909235f0-f9ba-458d-a9aa-26eb22b0f747+21:15627:x1868789693154432:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 3192us (3393us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1782217201.077898:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 40 00000100:00100000:0.0:1782217201.082226:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217201.082318:0:20335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693154560 00000100:00100000:2.0:1782217201.082327:0:20335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693154560 00000100:00100000:2.0:1782217201.082381:0:20335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 41 00000100:00100000:2.0:1782217201.082390:0:20335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:909235f0-f9ba-458d-a9aa-26eb22b0f747+21:15627:x1868789693154560:12345-192.168.203.30@tcp:54:lfs.0 00010000:00010000:2.0:1782217201.082452:0:20335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fcc00/0x92b8e04cbf5fabaf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.082468:0:20335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fcc00/0x92b8e04cbf5fabaf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.082479:0:20335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fcc00/0x92b8e04cbf5fabaf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.082514:0:20335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fcc00/0x92b8e04cbf5fabaf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.082521:0:20335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fcc00/0x92b8e04cbf5fabaf lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.082527:0:20335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fcc00/0x92b8e04cbf5fabaf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.082533:0:20335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e413fcc00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782217201.082537:0:20335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fcc00/0x92b8e04cbf5fabaf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.082544:0:20335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fcc00/0x92b8e04cbf5fabaf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.082556:0:20335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:2.0:1782217201.082613:0:20335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782217201.082619:0:20335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fcc00/0x92b8e04cbf5fabaf lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.082626:0:20335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fcc00/0x92b8e04cbf5fabaf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217201.082768:0:20335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:909235f0-f9ba-458d-a9aa-26eb22b0f747+21:15627:x1868789693154560:12345-192.168.203.30@tcp:54:lfs.0 Request processed in 377us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217201.082776:0:20335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 41 00000100:00100000:0.0:1782217201.083303:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217201.083487:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693154688 00000100:00100000:2.0:1782217201.083493:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693154688 00000100:00100000:2.0:1782217201.083654:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:2.0:1782217201.083663:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:909235f0-f9ba-458d-a9aa-26eb22b0f747+21:2402:x1868789693154688:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782217201.083675:0:17181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217201.083693:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362600/0x92b8e04cbf5faba1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738c1 expref: 21 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.084323:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:2.0:1782217201.084331:0:17181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217201.084383:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:909235f0-f9ba-458d-a9aa-26eb22b0f747+20:2402:x1868789693154688:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 719us (1079us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217201.084392:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:1.0:1782217201.090228:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217201.090316:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217201.090434:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217201.090468:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217201.090499:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693154816 00000100:00100000:2.0:1782217201.090517:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693154816 00000100:00100000:2.0:1782217201.090575:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 165 00000100:00100000:2.0:1782217201.090603:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c61b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f498600-1642-4d0b-95a1-c3911ac9081c+13:2405:x1868789693154816:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1782217201.090674:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c61b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f498600-1642-4d0b-95a1-c3911ac9081c+13:2405:x1868789693154816:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 91us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217201.090697:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 165 00000100:00100000:0.0:1782217201.091298:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693154944 00000100:00100000:0.0:1782217201.091304:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693154944 00000100:00100000:0.0:1782217201.091349:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693155200 00000100:00100000:0.0:1782217201.091353:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693155200 00000100:00100000:0.0:1782217201.091382:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 14 00000100:00100000:0.0:1782217201.091389:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43695500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:909235f0-f9ba-458d-a9aa-26eb22b0f747+5:2405:x1868789693154944:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782217201.091428:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43695500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:909235f0-f9ba-458d-a9aa-26eb22b0f747+5:2405:x1868789693154944:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 39us (1209us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217201.091434:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 14 00000100:00100000:0.0:1782217201.091447:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 15 00000100:00100000:0.0:1782217201.091453:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43695c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+5:2405:x1868789693155200:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782217201.091474:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43695c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+5:2405:x1868789693155200:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 21us (1158us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217201.091480:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 15 00000100:00080000:2.0:1782217201.091872:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782217201.092113:0:19412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693155072 00000100:00100000:1.0:1782217201.092120:0:19412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693155072 00000100:00100000:1.0:1782217201.092160:0:19412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:1.0:1782217201.092167:0:19412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43696a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:909235f0-f9ba-458d-a9aa-26eb22b0f747+5:2405:x1868789693155072:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1782217201.092213:0:19412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43696a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:909235f0-f9ba-458d-a9aa-26eb22b0f747+5:2405:x1868789693155072:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 46us (1743us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217201.092219:0:19412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:1.0:1782217201.092264:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217201.092333:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00080000:2.0:1782217201.092647:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782217201.092828:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693155328 00000100:00100000:0.0:1782217201.092853:0:18702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693155328 00000100:00100000:0.0:1782217201.092898:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:0.0:1782217201.092905:0:18702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+5:2405:x1868789693155328:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1782217201.092941:0:18702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5dfa9e82-80a8-4410-97a4-7bd2f5d1677e+5:2405:x1868789693155328:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 36us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217201.092948:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:0.0:1782217201.093012:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693155584 00000100:00100000:0.0:1782217201.093016:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693155584 00000100:00100000:0.0:1782217201.093043:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:0.0:1782217201.093049:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:909235f0-f9ba-458d-a9aa-26eb22b0f747+20:15627:x1868789693155584:12345-192.168.203.30@tcp:35:lfs.0 00000100:00080000:2.0:1782217201.093306:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782217201.093679:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:909235f0-f9ba-458d-a9aa-26eb22b0f747+21:15627:x1868789693155584:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 628us (1343us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1782217201.093686:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 7 00000040:00080000:1.0:1782217201.273448:0:17948:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1782217201.412644:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217201.412831:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693155840 00000100:00100000:3.0:1782217201.412840:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693155840 00000100:00100000:3.0:1782217201.412898:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 42 00000100:00100000:3.0:1782217201.412908:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:909235f0-f9ba-458d-a9aa-26eb22b0f747+21:15658:x1868789693155840:12345-192.168.203.30@tcp:101:cat.0 00010000:00010000:3.0:1782217201.412933:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217201.412952:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5fabb6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9738c8 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.415282:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362600/0x92b8e04cbf5fabbd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.415304:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362600/0x92b8e04cbf5fabbd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.415316:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362600/0x92b8e04cbf5fabbd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217201.415333:0:19301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1782217201.415457:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5fabb6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738c8 expref: 24 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.415476:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362600/0x92b8e04cbf5fabbd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738c8 expref: 23 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.416366:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:3.0:1782217201.416371:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782217201.416375:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b362600, rc 0) 00000100:00100000:3.0:1782217201.416567:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:909235f0-f9ba-458d-a9aa-26eb22b0f747+23:15658:x1868789693155840:12345-192.168.203.30@tcp:101:cat.0 Request processed in 3650us (3932us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1782217201.416575:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 42 00000100:00100000:1.0:1782217201.423211:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217201.423386:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693155968 00000100:00100000:2.0:1782217201.423396:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693155968 00000100:00100000:2.0:1782217201.423458:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1 00000100:00100000:2.0:1782217201.423468:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:909235f0-f9ba-458d-a9aa-26eb22b0f747+23:2402:x1868789693155968:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782217201.423482:0:17179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217201.423506:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362600/0x92b8e04cbf5fabbd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738c8 expref: 23 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.423524:0:17179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:2.0:1782217201.423529:0:17179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217201.423631:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:909235f0-f9ba-458d-a9aa-26eb22b0f747+22:2402:x1868789693155968:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 163us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217201.423639:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1 00000100:00100000:1.0:1782217201.424651:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217201.425007:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693156224 00000100:00100000:3.0:1782217201.425025:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693156224 00000100:00100000:3.0:1782217201.425075:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 8 00000100:00100000:3.0:1782217201.425084:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:909235f0-f9ba-458d-a9aa-26eb22b0f747+22:15658:x1868789693156224:12345-192.168.203.30@tcp:35:cat.0 00000100:00100000:3.0:1782217201.425342:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:909235f0-f9ba-458d-a9aa-26eb22b0f747+23:15658:x1868789693156224:12345-192.168.203.30@tcp:35:cat.0 Request processed in 257us (694us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1782217201.425351:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 8 00000100:00100000:2.0:1782217201.501122:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217201.501222:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693156480 00000100:00100000:3.0:1782217201.501234:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693156480 00000100:00100000:3.0:1782217201.501290:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 43 00000100:00100000:3.0:1782217201.501299:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43fee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:909235f0-f9ba-458d-a9aa-26eb22b0f747+23:15664:x1868789693156480:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:3.0:1782217201.501321:0:17195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217201.501340:0:17195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5fabcb lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9738cf expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.501447:0:17195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363800/0x92b8e04cbf5fabd2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.501473:0:17195:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363600/0x92b8e04cbf5fab70 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738ac expref: 24 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.501494:0:17195:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd400/0x92b8e04cbf5fab85 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738b3 expref: 24 pid: 20335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.501502:0:17195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363800/0x92b8e04cbf5fabd2 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.501535:0:17195:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd400/0x92b8e04cbf5fab85 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738b3 expref: 24 pid: 20335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.501546:0:17195:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd400/0x92b8e04cbf5fab85 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738b3 expref: 24 pid: 20335 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217201.501568:0:17195:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17195:1868789713152896:192.168.203.30@tcp:104: 00010000:00010000:3.0:1782217201.502167:0:17195:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363600/0x92b8e04cbf5fab70 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738ac expref: 24 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.502179:0:17195:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363600/0x92b8e04cbf5fab70 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738ac expref: 24 pid: 17195 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217201.502189:0:17195:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17195:1868789713153024:192.168.203.30@tcp:104: 00000100:00100000:3.0:1782217201.502237:0:17195:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d426ccf00 going to sleep for 11 seconds 00000100:00100000:3.0:1782217201.504479:0:17195:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17195:1868789713152896:192.168.203.30@tcp:104: 00000100:00100000:3.0:1782217201.505982:0:17195:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17195:1868789713153024:192.168.203.30@tcp:104: 00010000:00010000:3.0:1782217201.506012:0:17195:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363800/0x92b8e04cbf5fabd2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217201.507983:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217201.508081:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693156608 00000100:00100000:2.0:1782217201.508091:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693156608 00010000:00010000:2.0:1782217201.508127:0:17181:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd400/0x92b8e04cbf5fab85 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738b3 expref: 25 pid: 20335 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217201.508170:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:2.0:1782217201.508179:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bf9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:909235f0-f9ba-458d-a9aa-26eb22b0f747+25:2403:x1868789693156608:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782217201.508225:0:17181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217201.508233:0:17181:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd400/0x92b8e04cbf5fab85 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738b3 expref: 25 pid: 20335 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.508245:0:17181:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd400/0x92b8e04cbf5fab85 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738b3 expref: 25 pid: 20335 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.508267:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd400/0x92b8e04cbf5fab85 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738b3 expref: 25 pid: 20335 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.508282:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:2.0:1782217201.508287:0:17181:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363800/0x92b8e04cbf5fabd2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.508295:0:17181:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363800/0x92b8e04cbf5fabd2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.508301:0:17181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217201.508356:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bf9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:909235f0-f9ba-458d-a9aa-26eb22b0f747+24:2403:x1868789693156608:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 178us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217201.508364:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:1.0:1782217201.514232:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217201.514324:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693156736 00000100:00100000:2.0:1782217201.514334:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693156736 00010000:00010000:2.0:1782217201.514372:0:17180:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363600/0x92b8e04cbf5fab70 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738ac expref: 24 pid: 17195 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217201.514415:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 18 00000100:00100000:2.0:1782217201.514425:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72dfc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:909235f0-f9ba-458d-a9aa-26eb22b0f747+24:2402:x1868789693156736:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782217201.514451:0:17180:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217201.514458:0:17180:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363600/0x92b8e04cbf5fab70 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738ac expref: 24 pid: 17195 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.514480:0:17180:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363600/0x92b8e04cbf5fab70 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738ac expref: 24 pid: 17195 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.514500:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363600/0x92b8e04cbf5fab70 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738ac expref: 24 pid: 17195 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.514517:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:2.0:1782217201.514521:0:17180:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363800/0x92b8e04cbf5fabd2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.514530:0:17180:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363800/0x92b8e04cbf5fabd2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.514538:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363800/0x92b8e04cbf5fabd2 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.514574:0:17180:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217201.514673:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72dfc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:909235f0-f9ba-458d-a9aa-26eb22b0f747+23:2402:x1868789693156736:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 248us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217201.514681:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 18 00010000:00010000:3.0:1782217201.515302:0:17195:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363800/0x92b8e04cbf5fabd2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.515312:0:17195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363800/0x92b8e04cbf5fabd2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217201.515331:0:17195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1782217201.515479:0:17195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5fabcb lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738cf expref: 24 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.515495:0:17195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363800/0x92b8e04cbf5fabd2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738cf expref: 23 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.515503:0:17195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:3.0:1782217201.515506:0:17195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1782217201.515509:0:17195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b363800, rc 0) 00000100:00100000:3.0:1782217201.515553:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43fee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:909235f0-f9ba-458d-a9aa-26eb22b0f747+23:15664:x1868789693156480:12345-192.168.203.30@tcp:101:dd.0 Request processed in 14255us (14439us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1782217201.515571:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 43 00000100:00100000:1.0:1782217201.520375:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217201.520632:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693156864 00000100:00100000:0.0:1782217201.520642:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693156864 00000100:00100000:0.0:1782217201.520697:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 44 00000100:00100000:0.0:1782217201.520707:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:909235f0-f9ba-458d-a9aa-26eb22b0f747+23:15664:x1868789693156864:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:0.0:1782217201.520731:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217201.520751:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342600/0x92b8e04cbf5fabe0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9738d6 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217201.520782:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d42343e00/0x92b8e04cbf5fabe7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217201.520796:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d42343e00/0x92b8e04cbf5fabe7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217201.520807:0:17194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d42343e00/0x92b8e04cbf5fabe7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217201.520929:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342600/0x92b8e04cbf5fabe0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738d6 expref: 25 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217201.520954:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952d42343e00/0x92b8e04cbf5fabe7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738d6 expref: 24 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217201.520962:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:0.0:1782217201.520965:0:17194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782217201.520968:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d42343e00, rc 0) 00000100:00100000:0.0:1782217201.521015:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:909235f0-f9ba-458d-a9aa-26eb22b0f747+24:15664:x1868789693156864:12345-192.168.203.30@tcp:101:dd.0 Request processed in 309us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217201.521023:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 44 00000100:00100000:2.0:1782217201.526716:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217201.526809:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693157120 00000100:00100000:3.0:1782217201.526818:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693157120 00000100:00100000:3.0:1782217201.526871:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 45 00000100:00100000:3.0:1782217201.526881:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:909235f0-f9ba-458d-a9aa-26eb22b0f747+24:15664:x1868789693157120:12345-192.168.203.30@tcp:36:dd.0 00010000:00010000:3.0:1782217201.527135:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5fabee lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.527151:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5fabee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.527174:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5fabee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782217201.527575:0:19301:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1782217201.527633:0:19301:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000061990971 reply state 00000000c098b27d transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5fabee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.527646:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5fabee lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.527653:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:3.0:1782217201.527657:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782217201.527661:0:19301:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782217201.527755:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:909235f0-f9ba-458d-a9aa-26eb22b0f747+27:15664:x1868789693157120:12345-192.168.203.30@tcp:36:dd.0 Request processed in 875us (1047us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1782217201.527763:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 45 00000020:00080000:3.0:1782217201.527768:0:19301:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1782217201.529049:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782217201.541083:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217201.546477:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693157248 00000100:00100000:2.0:1782217201.546492:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693157248 00000100:00100000:2.0:1782217201.546596:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 46 00000100:00100000:2.0:1782217201.546608:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:909235f0-f9ba-458d-a9aa-26eb22b0f747+27:15664:x1868789693157248:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:2.0:1782217201.546660:0:17195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217201.546682:0:17195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc000/0x92b8e04cbf5fabf5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9738dd expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.546732:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc000/0x92b8e04cbf5fabf5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738dd expref: 28 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.546745:0:17195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc000/0x92b8e04cbf5fabf5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738dd expref: 28 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.546761:0:17195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:2.0:1782217201.546764:0:17195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782217201.546767:0:17195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e413fc000, rc 0) 00000100:00100000:2.0:1782217201.546839:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:909235f0-f9ba-458d-a9aa-26eb22b0f747+28:15664:x1868789693157248:12345-192.168.203.30@tcp:101:dd.0 Request processed in 234us (5764us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217201.546846:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 46 00000100:00100000:1.0:1782217201.571456:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217201.571747:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693157504 00000100:00100000:2.0:1782217201.571757:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693157504 00000100:00100000:2.0:1782217201.571817:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2 00000100:00100000:2.0:1782217201.571827:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41bf9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:909235f0-f9ba-458d-a9aa-26eb22b0f747+28:15664:x1868789693157504:12345-192.168.203.30@tcp:103:dd.0 00010000:00010000:2.0:1782217201.571843:0:17179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217201.571866:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc000/0x92b8e04cbf5fabf5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738dd expref: 28 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.571884:0:17179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:2.0:1782217201.572048:0:17179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217201.572139:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41bf9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:909235f0-f9ba-458d-a9aa-26eb22b0f747+27:15664:x1868789693157504:12345-192.168.203.30@tcp:103:dd.0 Request processed in 311us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217201.572160:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2 00000100:00100000:0.0:1782217201.579122:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217201.579207:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693157632 00000100:00100000:2.0:1782217201.579218:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693157632 00000100:00100000:2.0:1782217201.579272:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 47 00000100:00100000:2.0:1782217201.579281:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:909235f0-f9ba-458d-a9aa-26eb22b0f747+27:15664:x1868789693157632:12345-192.168.203.30@tcp:58:dd.0 00010000:00010000:2.0:1782217201.579386:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc600/0x92b8e04cbf5fabfc lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.579404:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc600/0x92b8e04cbf5fabfc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.579415:0:17194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc600/0x92b8e04cbf5fabfc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782217201.580872:0:17194:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782217201.582723:0:17194:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1782217201.582898:0:17194:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1782217201.583007:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:909235f0-f9ba-458d-a9aa-26eb22b0f747+27:15664:x1868789693157632:12345-192.168.203.30@tcp:58:dd.0 Request processed in 3722us (3888us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217201.583019:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 47 00000100:00100000:1.0:1782217201.595921:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217201.596763:0:20335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693157760 00000100:00100000:2.0:1782217201.596774:0:20335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693157760 00000100:00100000:2.0:1782217201.596840:0:20335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 48 00000100:00100000:2.0:1782217201.596849:0:20335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:909235f0-f9ba-458d-a9aa-26eb22b0f747+27:15664:x1868789693157760:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:2.0:1782217201.596869:0:20335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217201.596895:0:20335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc000/0x92b8e04cbf5fac03 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9738e4 expref: -99 pid: 20335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.596963:0:20335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc600/0x92b8e04cbf5fabfc lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.596974:0:20335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc000/0x92b8e04cbf5fac03 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738e4 expref: 28 pid: 20335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.596991:0:20335:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc600/0x92b8e04cbf5fabfc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.597002:0:20335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc000/0x92b8e04cbf5fac03 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738e4 expref: 28 pid: 20335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.597016:0:20335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:2.0:1782217201.597019:0:20335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782217201.597022:0:20335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc000/0x92b8e04cbf5fac03 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738e4 expref: 28 pid: 20335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.597030:0:20335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e413fc000, rc 0) 00000100:00100000:2.0:1782217201.597142:0:20335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:909235f0-f9ba-458d-a9aa-26eb22b0f747+28:15664:x1868789693157760:12345-192.168.203.30@tcp:101:dd.0 Request processed in 292us (1228us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217201.597149:0:20335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 48 00000040:00080000:2.0:1782217201.848798:0:17230:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1782217201.848807:0:17230:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782217201.848831:0:17230:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1782217201.848838:0:17230:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1782217201.848975:0:17230:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e72e8dc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17230:1868789713153152:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1782217201.849058:0:17230:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e58a75780 going to sleep for 11 seconds 00000100:00100000:1.0:1782217201.856070:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217201.856138:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693157888 00000100:00100000:3.0:1782217201.856151:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693157888 00000100:00100000:3.0:1782217201.856214:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 49 00000100:00100000:3.0:1782217201.856224:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43d92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:909235f0-f9ba-458d-a9aa-26eb22b0f747+29:15665:x1868789693157888:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1782217201.856255:0:17196:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1782217201.856389:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43d92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:909235f0-f9ba-458d-a9aa-26eb22b0f747+29:15665:x1868789693157888:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 165us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217201.856396:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 49 00000100:00100000:2.0:1782217201.856677:0:17230:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e72e8dc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17230:1868789713153152:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1782217201.860679:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217201.860776:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693158016 00000100:00100000:2.0:1782217201.860785:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693158016 00000100:00100000:2.0:1782217201.860846:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 50 00000100:00100000:2.0:1782217201.860856:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:909235f0-f9ba-458d-a9aa-26eb22b0f747+28:15665:x1868789693158016:12345-192.168.203.30@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1782217201.860922:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc200/0x92b8e04cbf5fac0a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.860939:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc200/0x92b8e04cbf5fac0a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.860950:0:17194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc200/0x92b8e04cbf5fac0a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.861007:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fda00/0x92b8e04cbf5fac11 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.861015:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fda00/0x92b8e04cbf5fac11 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.861022:0:17194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fda00/0x92b8e04cbf5fac11 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.861043:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd800/0x92b8e04cbf5fac18 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.861051:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd800/0x92b8e04cbf5fac18 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.861069:0:17194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd800/0x92b8e04cbf5fac18 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782217201.861135:0:17194:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1782217201.861139:0:17194:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782217201.861153:0:17194:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd800/0x92b8e04cbf5fac18 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.861165:0:17194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc200/0x92b8e04cbf5fac0a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.861172:0:17194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc200/0x92b8e04cbf5fac0a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.861180:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc200/0x92b8e04cbf5fac0a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.861187:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e413fc200 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782217201.861191:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc200/0x92b8e04cbf5fac0a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.861199:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc200/0x92b8e04cbf5fac0a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.861212:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff952e48856700) 00010000:00010000:2.0:1782217201.861215:0:17194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217201.861220:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc200/0x92b8e04cbf5fac0a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.861227:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc200/0x92b8e04cbf5fac0a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.861242:0:17194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fda00/0x92b8e04cbf5fac11 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.861258:0:17194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fda00/0x92b8e04cbf5fac11 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.861264:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fda00/0x92b8e04cbf5fac11 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.861269:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e413fda00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782217201.861272:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fda00/0x92b8e04cbf5fac11 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.861279:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fda00/0x92b8e04cbf5fac11 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.861287:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff952d410ab900) 00010000:00010000:2.0:1782217201.861290:0:17194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217201.861292:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fda00/0x92b8e04cbf5fac11 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.861298:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fda00/0x92b8e04cbf5fac11 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.861312:0:17194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd800/0x92b8e04cbf5fac18 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.861318:0:17194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd800/0x92b8e04cbf5fac18 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.861323:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd800/0x92b8e04cbf5fac18 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.861328:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e413fd800 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782217201.861337:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd800/0x92b8e04cbf5fac18 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.861343:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd800/0x92b8e04cbf5fac18 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.861350:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:2.0:1782217201.861353:0:17194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782217201.861356:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd800/0x92b8e04cbf5fac18 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.861362:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd800/0x92b8e04cbf5fac18 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217201.861538:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:909235f0-f9ba-458d-a9aa-26eb22b0f747+28:15665:x1868789693158016:12345-192.168.203.30@tcp:34:lhsmtool_posix.0 Request processed in 683us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217201.861547:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 50 00000100:00100000:0.0:1782217201.872273:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217201.872425:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693158272 00000100:00100000:3.0:1782217201.872435:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693158272 00000100:00100000:3.0:1782217201.872493:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 51 00000100:00100000:3.0:1782217201.872517:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:909235f0-f9ba-458d-a9aa-26eb22b0f747+28:15665:x1868789693158272:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782217201.872539:0:17195:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782217201.872569:0:17195:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fac1f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9738eb expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.872847:0:17195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5fac26 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.872863:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5fac26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.872874:0:17195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5fac26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782217201.872885:0:17195:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1782217201.872962:0:17195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5fac26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.872970:0:17195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5fac26 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.872977:0:17195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5fac26 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.872983:0:17195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362c00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217201.872987:0:17195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5fac26 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.872996:0:17195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5fac26 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.873009:0:17195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:3.0:1782217201.873019:0:17195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782217201.873024:0:17195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5fac26 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.873030:0:17195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362c00/0x92b8e04cbf5fac26 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.873201:0:17195:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fac1f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738eb expref: 30 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.873213:0:17195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff952e48856700) 00010000:00010000:3.0:1782217201.873216:0:17195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782217201.873220:0:17195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362e00/0x92b8e04cbf5fac1f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738eb expref: 30 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.873230:0:17195:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e7b362e00, rc 0) 00000100:00100000:3.0:1782217201.873388:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:909235f0-f9ba-458d-a9aa-26eb22b0f747+29:15665:x1868789693158272:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 873us (1123us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1782217201.873396:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 51 00000100:00100000:1.0:1782217201.879874:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217201.879951:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693158400 00000100:00100000:3.0:1782217201.879961:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693158400 00000100:00100000:3.0:1782217201.880061:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 52 00000100:00100000:3.0:1782217201.880081:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4379a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:909235f0-f9ba-458d-a9aa-26eb22b0f747+29:15665:x1868789693158400:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1782217201.880117:0:17196:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1782217201.880235:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4379a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:909235f0-f9ba-458d-a9aa-26eb22b0f747+29:15665:x1868789693158400:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 155us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217201.880242:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 52 00000100:00100000:1.0:1782217201.885504:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217201.885882:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693158656 00000100:00100000:2.0:1782217201.885892:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693158656 00000100:00100000:2.0:1782217201.885955:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 53 00000100:00100000:2.0:1782217201.885966:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4379ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:909235f0-f9ba-458d-a9aa-26eb22b0f747+29:15665:x1868789693158656:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782217201.885987:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217201.886006:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd800/0x92b8e04cbf5fac34 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9738f2 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782217201.886394:0:17194:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6:0x0], count =28 00000004:00080000:2.0:1782217201.886402:0:17194:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x6:0x0]+28 in llog 00000004:00080000:2.0:1782217201.886423:0:17194:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:2.0:1782217201.886580:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fda00/0x92b8e04cbf5fac3b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.886634:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fda00/0x92b8e04cbf5fac3b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.886646:0:17194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fda00/0x92b8e04cbf5fac3b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.886705:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd800/0x92b8e04cbf5fac34 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738f2 expref: 32 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.886724:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fda00/0x92b8e04cbf5fac3b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738f2 expref: 31 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.886733:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff952d410ab900) 00010000:00010000:2.0:1782217201.886736:0:17194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782217201.886739:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e413fda00, rc 0) 00000100:00100000:2.0:1782217201.886803:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4379ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:909235f0-f9ba-458d-a9aa-26eb22b0f747+31:15665:x1868789693158656:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 839us (1308us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1782217201.886812:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 53 00000100:00100000:0.0:1782217201.894647:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217201.894705:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693158912 00000100:00100000:3.0:1782217201.894727:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693158912 00000100:00100000:0.0:1782217201.896063:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 54 00000100:00100000:0.0:1782217201.896075:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:909235f0-f9ba-458d-a9aa-26eb22b0f747+31:15665:x1868789693158912:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1782217201.896132:0:17195:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217201.896160:0:17195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fda00/0x92b8e04cbf5fac3b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738f2 expref: 31 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217201.896179:0:17195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff952d410ab900) 00010000:00010000:0.0:1782217201.896189:0:17195:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782217201.896221:0:17195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342000/0x92b8e04cbf5fac49 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217201.896235:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342000/0x92b8e04cbf5fac49 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217201.896244:0:17195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342000/0x92b8e04cbf5fac49 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217201.896307:0:17195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342a00/0x92b8e04cbf5fac50 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x8b69681d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217201.896316:0:17195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342a00/0x92b8e04cbf5fac50 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x8b69681d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217201.896323:0:17195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342a00/0x92b8e04cbf5fac50 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x8b69681d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217201.896370:0:17195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342000/0x92b8e04cbf5fac49 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217201.896377:0:17195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342000/0x92b8e04cbf5fac49 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217201.896384:0:17195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342000/0x92b8e04cbf5fac49 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217201.896390:0:17195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d42342000 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782217201.896394:0:17195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342000/0x92b8e04cbf5fac49 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217201.896402:0:17195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342000/0x92b8e04cbf5fac49 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217201.896422:0:17195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff952e46d74400) 00010000:00010000:0.0:1782217201.896425:0:17195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217201.896429:0:17195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342000/0x92b8e04cbf5fac49 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217201.896436:0:17195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342000/0x92b8e04cbf5fac49 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217201.896452:0:17195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342a00/0x92b8e04cbf5fac50 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x8b69681d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217201.896458:0:17195:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342a00/0x92b8e04cbf5fac50 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x8b69681d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217201.896465:0:17195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342a00/0x92b8e04cbf5fac50 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x8b69681d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217201.896471:0:17195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d42342a00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782217201.896474:0:17195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342a00/0x92b8e04cbf5fac50 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x8b69681d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217201.896479:0:17195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342a00/0x92b8e04cbf5fac50 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x8b69681d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217201.896486:0:17195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x8b69681d (ffff952d423bbd00) 00010000:00010000:0.0:1782217201.896488:0:17195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782217201.896491:0:17195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342a00/0x92b8e04cbf5fac50 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x8b69681d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217201.896497:0:17195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342a00/0x92b8e04cbf5fac50 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x8b69681d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217201.896630:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:909235f0-f9ba-458d-a9aa-26eb22b0f747+30:15665:x1868789693158912:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 556us (1989us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782217201.896638:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 54 00000100:00100000:1.0:1782217201.903067:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217201.910174:0:20335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693159040 00000100:00100000:2.0:1782217201.910189:0:20335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693159040 00000100:00100000:1.0:1782217201.910375:0:20335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 55 00000100:00100000:1.0:1782217201.910385:0:20335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4379b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:909235f0-f9ba-458d-a9aa-26eb22b0f747+30:15665:x1868789693159040:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782217201.910404:0:20335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782217201.910424:0:20335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5fac57 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be9738f9 expref: -99 pid: 20335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217201.910454:0:20335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fac5e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217201.910467:0:20335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fac5e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217201.910477:0:20335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fac5e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217201.910624:0:20335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073e00/0x92b8e04cbf5fac57 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738f9 expref: 32 pid: 20335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217201.910642:0:20335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43073400/0x92b8e04cbf5fac5e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738f9 expref: 31 pid: 20335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217201.910650:0:20335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff952e48856b00) 00010000:00010000:1.0:1782217201.910672:0:20335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782217201.910676:0:20335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d43073400, rc 0) 00000100:00100000:1.0:1782217201.910755:0:20335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4379b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:909235f0-f9ba-458d-a9aa-26eb22b0f747+31:15665:x1868789693159040:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 371us (7697us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217201.910763:0:20335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 55 00000100:00100000:1.0:1782217201.917146:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217201.917398:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693159296 00000100:00100000:0.0:1782217201.917409:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693159296 00000100:00100000:0.0:1782217201.917464:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 56 00000100:00100000:0.0:1782217201.917473:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4379b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:909235f0-f9ba-458d-a9aa-26eb22b0f747+31:15665:x1868789693159296:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1782217201.917563:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342a00/0x92b8e04cbf5fac65 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217201.917578:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342a00/0x92b8e04cbf5fac65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217201.917609:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342a00/0x92b8e04cbf5fac65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782217201.917777:0:19301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:0.0:1782217201.917788:0:19301:0:(osp_sync.c:1862:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 564901204624ns, next at 565901201216ns, rc = 0 00000004:00010000:0.0:1782217201.917832:0:19301:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f3326137 reply state 00000000f0ab65a9 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342a00/0x92b8e04cbf5fac65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217201.917844:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342a00/0x92b8e04cbf5fac65 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217201.917851:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff952e48856b00) 00010000:00010000:0.0:1782217201.917854:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1782217201.917858:0:19301:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782217201.917951:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4379b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:909235f0-f9ba-458d-a9aa-26eb22b0f747+33:15665:x1868789693159296:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 477us (812us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1782217201.917974:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 56 00000100:00100000:1.0:1782217201.925202:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217201.925264:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693159424 00000100:00100000:2.0:1782217201.925273:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693159424 00000100:00100000:2.0:1782217201.925329:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 57 00000100:00100000:2.0:1782217201.925339:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:909235f0-f9ba-458d-a9aa-26eb22b0f747+33:15665:x1868789693159424:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782217201.925361:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217201.925380:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd800/0x92b8e04cbf5fac6c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973900 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.925452:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd800/0x92b8e04cbf5fac6c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973900 expref: 34 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.925467:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd800/0x92b8e04cbf5fac6c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973900 expref: 34 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.925484:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff952e48856b00) 00010000:00010000:2.0:1782217201.925487:0:17194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782217201.925491:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e413fd800, rc 0) 00000100:00100000:2.0:1782217201.925550:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:909235f0-f9ba-458d-a9aa-26eb22b0f747+34:15665:x1868789693159424:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 212us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217201.925567:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 57 00000100:00100000:1.0:1782217201.932704:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217201.932928:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693159552 00000100:00100000:0.0:1782217201.932937:0:18702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693159552 00000100:00100000:0.0:1782217201.933002:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00100000:0.0:1782217201.933012:0:18702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4379aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:909235f0-f9ba-458d-a9aa-26eb22b0f747+5:2403:x1868789693159552:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1782217201.933247:0:18702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4379aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:909235f0-f9ba-458d-a9aa-26eb22b0f747+6:2403:x1868789693159552:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 Request processed in 236us (551us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1782217201.933255:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00100000:1.0:1782217201.936502:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217201.936613:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693159808 00000100:00100000:0.0:1782217201.936622:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693159808 00000100:00100000:0.0:1782217201.936690:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:0.0:1782217201.936700:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4379b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:909235f0-f9ba-458d-a9aa-26eb22b0f747+34:15665:x1868789693159808:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1782217201.936906:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4379b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:909235f0-f9ba-458d-a9aa-26eb22b0f747+35:15665:x1868789693159808:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 206us (411us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1782217201.936914:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:1.0:1782217201.939268:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217201.939355:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693160064 00000100:00100000:0.0:1782217201.939363:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693160064 00000100:00100000:0.0:1782217201.939414:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 58 00000100:00100000:0.0:1782217201.939423:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:909235f0-f9ba-458d-a9aa-26eb22b0f747+35:15665:x1868789693160064:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1782217201.939530:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:909235f0-f9ba-458d-a9aa-26eb22b0f747+35:15665:x1868789693160064:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 107us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217201.939537:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 58 00000100:00100000:2.0:1782217201.947406:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217201.947500:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693160192 00000100:00100000:0.0:1782217201.947510:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693160192 00000100:00100000:0.0:1782217201.947636:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 59 00000100:00100000:0.0:1782217201.947646:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72e8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:909235f0-f9ba-458d-a9aa-26eb22b0f747+35:15665:x1868789693160192:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782217201.947666:0:19301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217201.947685:0:19301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342000/0x92b8e04cbf5fac73 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973907 expref: -99 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217201.947752:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952d42343400/0x92b8e04cbf5fac7a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217201.947767:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d42343400/0x92b8e04cbf5fac7a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217201.947778:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d42343400/0x92b8e04cbf5fac7a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782217201.947824:0:19301:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782217201.947842:0:19301:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff952d42343400/0x92b8e04cbf5fac7a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217201.947868:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342000/0x92b8e04cbf5fac73 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973907 expref: 37 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217201.947891:0:19301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952d42343400/0x92b8e04cbf5fac7a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973907 expref: 36 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217201.947900:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff952e48856b00) 00010000:00010000:0.0:1782217201.947903:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1782217201.947907:0:19301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d42343400, rc 0) 00000100:00100000:0.0:1782217201.947964:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72e8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:909235f0-f9ba-458d-a9aa-26eb22b0f747+36:15665:x1868789693160192:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 320us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217201.947981:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 59 00000100:00100000:2.0:1782217201.955859:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217201.956539:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693160320 00000100:00100000:0.0:1782217201.956550:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693160320 00000100:00100000:0.0:1782217201.956646:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:0.0:1782217201.956656:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72e8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:909235f0-f9ba-458d-a9aa-26eb22b0f747+6:2403:x1868789693160320:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782217201.956673:0:18700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782217201.956694:0:18700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000097eb117/0x92b8e04cbf5fac81 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be97390e expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782217201.956717:0:18700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a3a79f1, blocks: 0x0 00010000:00010000:0.0:1782217201.956736:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=564s v=(0 0) 00010000:00010000:0.0:1782217201.956740:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217201.956749:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000097eb117/0x92b8e04cbf5fac81 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97390e expref: 7 pid: 18700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217201.956767:0:18700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000097eb117/0x92b8e04cbf5fac81 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97390e expref: 7 pid: 18700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217201.956778:0:18700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952d42342800, rc 0) 00000100:00100000:0.0:1782217201.956839:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72e8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:909235f0-f9ba-458d-a9aa-26eb22b0f747+7:2403:x1868789693160320:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 184us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217201.956846:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:1.0:1782217201.962144:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217201.962287:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693160576 00000100:00100000:2.0:1782217201.962296:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693160576 00000100:00100000:2.0:1782217201.962354:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 60 00000100:00100000:2.0:1782217201.962364:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:909235f0-f9ba-458d-a9aa-26eb22b0f747+36:15665:x1868789693160576:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1782217201.962469:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:909235f0-f9ba-458d-a9aa-26eb22b0f747+36:15665:x1868789693160576:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 105us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217201.962477:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 60 00000100:00100000:2.0:1782217201.965250:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217201.965345:0:20335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693160704 00000100:00100000:1.0:1782217201.965354:0:20335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693160704 00000100:00100000:1.0:1782217201.965406:0:20335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 61 00000100:00100000:1.0:1782217201.965416:0:20335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72e8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:909235f0-f9ba-458d-a9aa-26eb22b0f747+36:15665:x1868789693160704:12345-192.168.203.30@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1782217201.967316:0:17174:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:0.0:1782217201.967329:0:17174:0:(osp_sync.c:1827:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:3.0:1782217201.967469:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362800/0x92b8e04cbf5faaba lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.967481:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362800/0x92b8e04cbf5faaba lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.967488:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362800/0x92b8e04cbf5faaba lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.967495:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b362800 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217201.967499:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362800/0x92b8e04cbf5faaba lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.967507:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362800/0x92b8e04cbf5faaba lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.967523:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff952e46d74000) 00010000:00010000:3.0:1782217201.967527:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217201.967531:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362800/0x92b8e04cbf5faaba lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.967538:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b362800/0x92b8e04cbf5faaba lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.967567:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363200/0x92b8e04cbf5faac1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.967573:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363200/0x92b8e04cbf5faac1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.967579:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363200/0x92b8e04cbf5faac1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.967619:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b363200 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217201.967622:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363200/0x92b8e04cbf5faac1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.967628:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363200/0x92b8e04cbf5faac1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.967636:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff952e46d74400) 00010000:00010000:3.0:1782217201.967638:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217201.967640:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363200/0x92b8e04cbf5faac1 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.967645:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363200/0x92b8e04cbf5faac1 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.967676:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363400/0x92b8e04cbf5fab69 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.967682:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363400/0x92b8e04cbf5fab69 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.967688:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363400/0x92b8e04cbf5fab69 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.967694:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b363400 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217201.967697:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363400/0x92b8e04cbf5fab69 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.967703:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363400/0x92b8e04cbf5fab69 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.967721:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff952e46d74c00) 00010000:00010000:3.0:1782217201.967724:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217201.967727:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363400/0x92b8e04cbf5fab69 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.967733:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363400/0x92b8e04cbf5fab69 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17195 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.967747:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5fabee lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.967752:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5fabee lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.967758:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5fabee lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.967763:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b363a00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217201.967765:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5fabee lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.967771:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5fabee lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.967778:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:3.0:1782217201.967780:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782217201.967783:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5fabee lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.967788:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363a00/0x92b8e04cbf5fabee lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.967807:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342a00/0x92b8e04cbf5fac65 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.967813:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342a00/0x92b8e04cbf5fac65 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.967819:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342a00/0x92b8e04cbf5fac65 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.967824:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d42342a00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:3.0:1782217201.967826:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342a00/0x92b8e04cbf5fac65 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.967832:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342a00/0x92b8e04cbf5fac65 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.967839:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff952e48856b00) 00010000:00010000:3.0:1782217201.967841:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782217201.967843:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342a00/0x92b8e04cbf5fac65 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217201.967849:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342a00/0x92b8e04cbf5fac65 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217201.967900:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713153280:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1782217201.968785:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217201.968906:0:18701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713153280 00000100:00100000:1.0:1782217201.968914:0:18701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713153280 00000100:00100000:1.0:1782217201.968982:0:18701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000001:00080000:0.0:1782217201.968983:0:17174:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:1.0:1782217201.968991:0:18701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713153280:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1782217201.969122:0:18701:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1782217201.969125:0:18701:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1782217201.969128:0:18701:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1782217201.969130:0:18701:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1782217201 -> 1782217201 00002000:00010000:1.0:1782217201.969132:0:18701:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1782217201.969188:0:18701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1868789713153280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 198us (405us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1782217201.969195:0:18701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782217201.969305:0:20335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72e8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:909235f0-f9ba-458d-a9aa-26eb22b0f747+15:15665:x1868789693160704:12345-192.168.203.30@tcp:44:lhsmtool_posix.0 Request processed in 3889us (4062us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217201.969313:0:20335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 61 00000100:00080000:3.0:1782217201.970036:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1782217201.970431:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff952d43798e00/2, rc 0, transno 8589934596 00000100:00100000:0.0:1782217201.970440:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713153280:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1782217201.971011:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342c00/0x92b8e04cbf5fab0e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.971023:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342c00/0x92b8e04cbf5fab0e lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.971036:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342c00/0x92b8e04cbf5fab0e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.971041:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d42342c00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:2.0:1782217201.971045:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342c00/0x92b8e04cbf5fab0e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.971053:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342c00/0x92b8e04cbf5fab0e lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.971069:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff952e46d74400) 00010000:00010000:2.0:1782217201.971072:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1782217201.971077:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342c00/0x92b8e04cbf5fab0e lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.971083:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342c00/0x92b8e04cbf5fab0e lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217201.976628:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217201.976770:0:19778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693160832 00000100:00100000:2.0:1782217201.976779:0:19778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693160832 00000100:00100000:2.0:1782217201.976826:0:19778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 23 00000100:00100000:2.0:1782217201.976835:0:19778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4379a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:909235f0-f9ba-458d-a9aa-26eb22b0f747+7:2402:x1868789693160832:12345-192.168.203.30@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1782217201.976935:0:19778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4379a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:909235f0-f9ba-458d-a9aa-26eb22b0f747+7:2402:x1868789693160832:12345-192.168.203.30@tcp:16:lhsmtool_posix.0 Request processed in 100us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217201.976942:0:19778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 23 00000100:00100000:1.0:1782217201.985747:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217201.985847:0:19301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693161088 00000100:00100000:0.0:1782217201.985857:0:19301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693161088 00000100:00100000:0.0:1782217201.985920:0:19301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 62 00000100:00100000:0.0:1782217201.985930:0:19301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:909235f0-f9ba-458d-a9aa-26eb22b0f747+15:15665:x1868789693161088:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1782217201.985981:0:19301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782217201.986008:0:19301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d42343400/0x92b8e04cbf5fac7a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973907 expref: 15 pid: 19301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217201.986033:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff952e48856b00) 00010000:00010000:0.0:1782217201.986038:0:19301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782217201.986075:0:19301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342000/0x92b8e04cbf5fac88 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217201.986088:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342000/0x92b8e04cbf5fac88 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217201.986096:0:19301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342000/0x92b8e04cbf5fac88 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782217201.986211:0:19301:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003255aa95 reply state 00000000fc50403c transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342000/0x92b8e04cbf5fac88 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217201.986225:0:19301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342000/0x92b8e04cbf5fac88 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217201.986232:0:19301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff952e48856b00) 00010000:00010000:0.0:1782217201.986235:0:19301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782217201.986249:0:19301:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782217201.986338:0:19301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:909235f0-f9ba-458d-a9aa-26eb22b0f747+16:15665:x1868789693161088:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 408us (599us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1782217201.986345:0:19301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 62 00000100:00100000:1.0:1782217201.991352:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217201.991442:0:19412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693161216 00000100:00100000:2.0:1782217201.991452:0:19412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693161216 00000100:00100000:2.0:1782217201.991506:0:19412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 24 00000100:00100000:2.0:1782217201.991516:0:19412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:909235f0-f9ba-458d-a9aa-26eb22b0f747+7:15665:x1868789693161216:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782217201.991547:0:19412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217201.991576:0:19412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8da30e3/0x92b8e04cbf5fac8f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be973915 expref: -99 pid: 19412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.991644:0:19412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000097eb117/0x92b8e04cbf5fac81 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97390e expref: 8 pid: 18700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.991653:0:19412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782217201.991657:0:19412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782217201.991662:0:19412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8da30e3/0x92b8e04cbf5fac8f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973915 expref: 8 pid: 19412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.991695:0:19412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000097eb117/0x92b8e04cbf5fac81 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97390e expref: 8 pid: 18700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.991707:0:19412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000097eb117/0x92b8e04cbf5fac81 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97390e expref: 8 pid: 18700 timeout: 664 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217201.991721:0:19412:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e72e8f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:19412:1868789713153408:192.168.203.30@tcp:104: 00000100:00100000:2.0:1782217201.991805:0:19412:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e7c7d1f00 going to sleep for 11 seconds 00000100:00100000:2.0:1782217201.994346:0:19412:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e72e8f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:19412:1868789713153408:192.168.203.30@tcp:104: 00010000:00010000:2.0:1782217201.994377:0:19412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d8da30e3/0x92b8e04cbf5fac8f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973915 expref: 8 pid: 19412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.994396:0:19412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e413fc200, rc 0) 00000100:00100000:2.0:1782217201.994463:0:19412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:909235f0-f9ba-458d-a9aa-26eb22b0f747+8:15665:x1868789693161216:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 2947us (3119us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217201.994472:0:19412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 24 00000100:00100000:3.0:1782217201.995075:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217201.996452:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693161344 00000100:00100000:2.0:1782217201.996462:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693161344 00010000:00010000:2.0:1782217201.996505:0:17180:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000097eb117/0x92b8e04cbf5fac81 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97390e expref: 8 pid: 18700 timeout: 664 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217201.996550:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:2.0:1782217201.996569:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:909235f0-f9ba-458d-a9aa-26eb22b0f747+8:2403:x1868789693161344:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782217201.996616:0:17180:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217201.996638:0:17180:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000097eb117/0x92b8e04cbf5fac81 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97390e expref: 8 pid: 18700 timeout: 664 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.996652:0:17180:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000097eb117/0x92b8e04cbf5fac81 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97390e expref: 8 pid: 18700 timeout: 664 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.996680:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000097eb117/0x92b8e04cbf5fac81 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be97390e expref: 8 pid: 18700 timeout: 664 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.996702:0:17180:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782217201.996707:0:17180:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782217201.996714:0:17180:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d8da30e3/0x92b8e04cbf5fac8f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973915 expref: 7 pid: 19412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.996725:0:17180:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8da30e3/0x92b8e04cbf5fac8f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973915 expref: 7 pid: 19412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217201.996773:0:17180:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d8da30e3/0x92b8e04cbf5fac8f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973915 expref: 7 pid: 19412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217201.996788:0:17180:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e72e8f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:17180:1868789713153536:192.168.203.30@tcp:105: 00000100:00100000:2.0:1782217201.996863:0:17180:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e7c7d1f00 going to sleep for 11 seconds 00000100:00100000:2.0:1782217202.003248:0:17180:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e72e8f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:17180:1868789713153536:192.168.203.30@tcp:105: 00010000:00010000:2.0:1782217202.003272:0:17180:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217202.003329:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:909235f0-f9ba-458d-a9aa-26eb22b0f747+7:2403:x1868789693161344:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 6761us (8256us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217202.003340:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:1.0:1782217202.005369:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217202.005457:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693161472 00000100:00100000:0.0:1782217202.005467:0:18702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693161472 00000100:00100000:0.0:1782217202.005520:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 25 00000100:00100000:0.0:1782217202.005529:0:18702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e476fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:909235f0-f9ba-458d-a9aa-26eb22b0f747+7:2402:x1868789693161472:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1782217202.005717:0:18702:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1782217202.005721:0:18702:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1782217201 00002000:00010000:0.0:1782217202.005724:0:18702:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1782217200 00002000:00010000:0.0:1782217202.005726:0:18702:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1782217201 -> 1782217201 00002000:00010000:0.0:1782217202.005728:0:18702:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1782217202.005777:0:18702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e476fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:909235f0-f9ba-458d-a9aa-26eb22b0f747+8:2402:x1868789693161472:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 Request processed in 249us (415us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1782217202.005785:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 25 00000100:00100000:3.0:1782217202.008094:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217202.008224:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693161600 00000100:00100000:0.0:1782217202.008232:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693161600 00000100:00100000:0.0:1782217202.008282:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 26 00000100:00100000:0.0:1782217202.008292:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:909235f0-f9ba-458d-a9aa-26eb22b0f747+8:2404:x1868789693161600:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1782217202.008332:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004f125c0b/0x92b8e04cbf5fac96 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217202.008350:0:18700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d8da30e3/0x92b8e04cbf5fac8f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973915 expref: 8 pid: 19412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217202.008359:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217202.008375:0:18700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782217202.008380:0:18700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f125c0b/0x92b8e04cbf5fac96 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217202.008414:0:18700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d8da30e3/0x92b8e04cbf5fac8f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973915 expref: 8 pid: 19412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217202.008427:0:18700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d8da30e3/0x92b8e04cbf5fac8f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973915 expref: 8 pid: 19412 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217202.008444:0:18700:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18700:1868789713153664:192.168.203.30@tcp:104: 00000100:00100000:0.0:1782217202.008521:0:18700:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e520b03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782217202.011541:0:18700:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18700:1868789713153664:192.168.203.30@tcp:104: 00010000:00010000:0.0:1782217202.011595:0:18700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004f125c0b/0x92b8e04cbf5fac96 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217202.012778:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217202.013271:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693161728 00000100:00100000:2.0:1782217202.013280:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693161728 00010000:00010000:2.0:1782217202.013315:0:17179:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d8da30e3/0x92b8e04cbf5fac8f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973915 expref: 9 pid: 19412 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217202.013358:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00100000:2.0:1782217202.013367:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:909235f0-f9ba-458d-a9aa-26eb22b0f747+9:2403:x1868789693161728:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782217202.013382:0:17179:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217202.013401:0:17179:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d8da30e3/0x92b8e04cbf5fac8f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973915 expref: 9 pid: 19412 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217202.013415:0:17179:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d8da30e3/0x92b8e04cbf5fac8f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973915 expref: 9 pid: 19412 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217202.013451:0:17179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8da30e3/0x92b8e04cbf5fac8f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973915 expref: 9 pid: 19412 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217202.013470:0:17179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782217202.013474:0:17179:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782217202.013480:0:17179:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004f125c0b/0x92b8e04cbf5fac96 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217202.013490:0:17179:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f125c0b/0x92b8e04cbf5fac96 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217202.013525:0:17179:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217202.013621:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:909235f0-f9ba-458d-a9aa-26eb22b0f747+8:2403:x1868789693161728:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 254us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217202.013629:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 20 00010000:00010000:3.0:1782217202.014450:0:18700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004f125c0b/0x92b8e04cbf5fac96 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217202.014464:0:18700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f125c0b/0x92b8e04cbf5fac96 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217202.014486:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004f125c0b/0x92b8e04cbf5fac96 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217202.014494:0:18700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f125c0b/0x92b8e04cbf5fac96 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217202.014508:0:18700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f125c0b/0x92b8e04cbf5fac96 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217202.014516:0:18700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d42343400 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:3.0:1782217202.014520:0:18700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f125c0b/0x92b8e04cbf5fac96 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217202.014528:0:18700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f125c0b/0x92b8e04cbf5fac96 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217202.014543:0:18700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f125c0b/0x92b8e04cbf5fac96 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217202.014550:0:18700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f125c0b/0x92b8e04cbf5fac96 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217202.014674:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:909235f0-f9ba-458d-a9aa-26eb22b0f747+7:2404:x1868789693161600:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 Request processed in 6381us (6586us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217202.014682:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 26 00000100:00100000:3.0:1782217202.017020:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217202.017144:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693161984 00000100:00100000:2.0:1782217202.017152:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693161984 00000100:00100000:2.0:1782217202.017426:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 63 00000100:00100000:2.0:1782217202.017437:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:909235f0-f9ba-458d-a9aa-26eb22b0f747+16:15665:x1868789693161984:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1782217202.017522:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd400/0x92b8e04cbf5fac9d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217202.017540:0:17194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952d42343e00/0x92b8e04cbf5fabe7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738d6 expref: 16 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217202.017550:0:17194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd400/0x92b8e04cbf5fac9d lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217202.017645:0:17194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff952d42343e00/0x92b8e04cbf5fabe7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738d6 expref: 16 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217202.017659:0:17194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff952d42343e00/0x92b8e04cbf5fabe7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738d6 expref: 16 pid: 17194 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217202.017674:0:17194:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e72e8f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17194:1868789713153792:192.168.203.30@tcp:104: 00000100:00100000:2.0:1782217202.017753:0:17194:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e7c7d1f00 going to sleep for 11 seconds 00000100:00080000:3.0:1782217202.019857:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782217202.020033:0:17194:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e72e8f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17194:1868789713153792:192.168.203.30@tcp:104: 00010000:00010000:2.0:1782217202.020068:0:17194:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd400/0x92b8e04cbf5fac9d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782217202.023219:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217202.023437:0:17180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693162112 00000100:00100000:2.0:1782217202.023447:0:17180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693162112 00010000:00010000:2.0:1782217202.023486:0:17180:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d42343e00/0x92b8e04cbf5fabe7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738d6 expref: 17 pid: 17194 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217202.023543:0:17180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:2.0:1782217202.023561:0:17180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:909235f0-f9ba-458d-a9aa-26eb22b0f747+17:2403:x1868789693162112:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782217202.023577:0:17180:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217202.023622:0:17180:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff952d42343e00/0x92b8e04cbf5fabe7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738d6 expref: 17 pid: 17194 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217202.023645:0:17180:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff952d42343e00/0x92b8e04cbf5fabe7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738d6 expref: 17 pid: 17194 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217202.023687:0:17180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d42343e00/0x92b8e04cbf5fabe7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738d6 expref: 17 pid: 17194 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217202.023711:0:17180:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:2.0:1782217202.023716:0:17180:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc000/0x92b8e04cbf5fac03 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738e4 expref: 16 pid: 20335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217202.023726:0:17180:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd400/0x92b8e04cbf5fac9d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217202.023733:0:17180:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd400/0x92b8e04cbf5fac9d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217202.023739:0:17180:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd400/0x92b8e04cbf5fac9d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217202.023759:0:17180:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217202.023812:0:17180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:909235f0-f9ba-458d-a9aa-26eb22b0f747+16:2403:x1868789693162112:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 260us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217202.023820:0:17180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 21 00010000:00010000:0.0:1782217202.023963:0:17194:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd400/0x92b8e04cbf5fac9d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217202.023971:0:17194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd400/0x92b8e04cbf5fac9d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217202.024169:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342e00/0x92b8e04cbf5faca4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217202.024181:0:17194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd800/0x92b8e04cbf5fac6c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be973900 expref: 16 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217202.024201:0:17194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342e00/0x92b8e04cbf5faca4 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217202.024246:0:17194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd800/0x92b8e04cbf5fac6c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973900 expref: 16 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217202.024258:0:17194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd800/0x92b8e04cbf5fac6c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973900 expref: 16 pid: 17194 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217202.024270:0:17194:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17194:1868789713153920:192.168.203.30@tcp:104: 00000100:00100000:0.0:1782217202.024323:0:17194:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e51ece900 going to sleep for 11 seconds 00000100:00100000:1.0:1782217202.033041:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217202.033173:0:17194:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17194:1868789713153920:192.168.203.30@tcp:104: 00010000:00010000:0.0:1782217202.033199:0:17194:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342e00/0x92b8e04cbf5faca4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217202.033620:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693162240 00000100:00100000:2.0:1782217202.033628:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693162240 00010000:00010000:2.0:1782217202.033676:0:17181:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd800/0x92b8e04cbf5fac6c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973900 expref: 17 pid: 17194 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217202.033712:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 22 00000100:00100000:2.0:1782217202.033725:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43798000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:909235f0-f9ba-458d-a9aa-26eb22b0f747+17:2402:x1868789693162240:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782217202.033757:0:17181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782217202.033764:0:17181:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd800/0x92b8e04cbf5fac6c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973900 expref: 17 pid: 17194 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217202.033776:0:17181:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd800/0x92b8e04cbf5fac6c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973900 expref: 17 pid: 17194 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217202.033802:0:17181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd800/0x92b8e04cbf5fac6c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xc65e7963be973900 expref: 17 pid: 17194 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217202.033816:0:17181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff952e48856b00) 00010000:00010000:2.0:1782217202.033821:0:17181:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342e00/0x92b8e04cbf5faca4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217202.033830:0:17181:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342e00/0x92b8e04cbf5faca4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217202.033838:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342e00/0x92b8e04cbf5faca4 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217202.033861:0:17181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782217202.033914:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43798000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:909235f0-f9ba-458d-a9aa-26eb22b0f747+16:2402:x1868789693162240:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 189us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217202.033921:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 22 00010000:00010000:0.0:1782217202.034978:0:17194:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342e00/0x92b8e04cbf5faca4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217202.034990:0:17194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342e00/0x92b8e04cbf5faca4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782217202.035109:0:17194:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1782217202.035235:0:17194:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1782217202.035272:0:17194:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1782217202.035364:0:17194:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17194:1868789713154048:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1782217202.035415:0:17194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217202.035448:0:17194:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e708150c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782217202.035612:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713154048 00000100:00100000:1.0:1782217202.035619:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713154048 00000100:00100000:1.0:1782217202.035670:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1782217202.035679:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43df2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17194:x1868789713154048:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1782217202.035753:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43df2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17194:x1868789713154048:12345-0@lo:1000:mdt00_000.0 Request processed in 74us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217202.035760:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1782217202.036025:0:17194:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17194:1868789713154048:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1782217202.036465:0:17194:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1782217202.036513:0:17194:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43df3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17194:1868789713154176:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1782217202.036548:0:17194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217202.036606:0:17194:0:(client.c:2701:ptlrpc_set_wait()) set ffff952e58a75780 going to sleep for 11 seconds 00000100:00100000:2.0:1782217202.036768:0:18842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713154176 00000100:00100000:2.0:1782217202.036774:0:18842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713154176 00000100:00100000:2.0:1782217202.036814:0:18842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1782217202.036823:0:18842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e46da7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17194:x1868789713154176:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1782217202.036955:0:18842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e46da7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:17194:x1868789713154176:12345-0@lo:1000:mdt00_000.0 Request processed in 133us (405us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1782217202.036970:0:18842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1782217202.037084:0:17194:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43df3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17194:1868789713154176:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1782217202.037120:0:17194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342e00/0x92b8e04cbf5faca4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217202.037130:0:17194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342e00/0x92b8e04cbf5faca4 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217202.037137:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342e00/0x92b8e04cbf5faca4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217202.037144:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d42342e00 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782217202.037148:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342e00/0x92b8e04cbf5faca4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217202.037156:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342e00/0x92b8e04cbf5faca4 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217202.037170:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff952e48856b00) 00010000:00010000:0.0:1782217202.037173:0:17194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782217202.037178:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342e00/0x92b8e04cbf5faca4 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217202.037184:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d42342e00/0x92b8e04cbf5faca4 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217202.037217:0:17194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc600/0x92b8e04cbf5fabfc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217202.037231:0:17194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc600/0x92b8e04cbf5fabfc lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217202.037237:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc600/0x92b8e04cbf5fabfc lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217202.037242:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e413fc600 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:0.0:1782217202.037245:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc600/0x92b8e04cbf5fabfc lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217202.037251:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc600/0x92b8e04cbf5fabfc lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217202.037261:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:0.0:1782217202.037263:0:17194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782217202.037270:0:17194:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc000/0x92b8e04cbf5fac03 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738e4 expref: 19 pid: 20335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217202.037281:0:17194:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc000/0x92b8e04cbf5fac03 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738e4 expref: 19 pid: 20335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217202.037290:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc000/0x92b8e04cbf5fac03 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738e4 expref: 19 pid: 20335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217202.037316:0:17194:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc000/0x92b8e04cbf5fac03 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be9738e4 expref: 19 pid: 20335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217202.037327:0:17194:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da5500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17194:1868789713154304:192.168.203.30@tcp:105: 00000100:00100000:0.0:1782217202.037461:0:17194:0:(client.c:2701:ptlrpc_set_wait()) set ffff952d43d1c180 going to sleep for 11 seconds 00000100:00100000:3.0:1782217202.046380:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1782217202.046628:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693162368 00000100:00100000:1.0:1782217202.046640:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693162368 00000100:00100000:1.0:1782217202.046711:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00100000:1.0:1782217202.046721:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e22850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:909235f0-f9ba-458d-a9aa-26eb22b0f747+20:15664:x1868789693162368:12345-192.168.203.30@tcp:49:dd.0 00000100:00100000:1.0:1782217202.046846:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e22850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:909235f0-f9ba-458d-a9aa-26eb22b0f747+20:15664:x1868789693162368:12345-192.168.203.30@tcp:49:dd.0 Request processed in 126us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217202.046854:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00100000:1.0:1782217202.052106:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1782217202.052493:0:20335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693162496 00000100:00100000:2.0:1782217202.052503:0:20335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693162496 00000100:00100000:2.0:1782217202.052574:0:20335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 64 00000100:00100000:2.0:1782217202.052617:0:20335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4379b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:909235f0-f9ba-458d-a9aa-26eb22b0f747+20:15664:x1868789693162496:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:2.0:1782217202.052637:0:20335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782217202.052656:0:20335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd800/0x92b8e04cbf5facab lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc65e7963be97391c expref: -99 pid: 20335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217202.052690:0:20335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc200/0x92b8e04cbf5facb2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217202.052701:0:20335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd400/0x92b8e04cbf5fac9d lrc: 2/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217202.052709:0:20335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc200/0x92b8e04cbf5facb2 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217202.052725:0:20335:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd400/0x92b8e04cbf5fac9d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217202.052737:0:20335:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc200/0x92b8e04cbf5facb2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217202.053190:0:17194:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da5500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17194:1868789713154304:192.168.203.30@tcp:105: 00010000:00010000:0.0:1782217202.053275:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc600/0x92b8e04cbf5fabfc lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217202.053285:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc600/0x92b8e04cbf5fabfc lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217202.055453:0:17194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072400/0x92b8e04cbf5facb9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217202.055475:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072400/0x92b8e04cbf5facb9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217202.055502:0:17194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072400/0x92b8e04cbf5facb9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217202.055516:0:17194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072400/0x92b8e04cbf5facb9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217202.055523:0:17194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072400/0x92b8e04cbf5facb9 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217202.055531:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072400/0x92b8e04cbf5facb9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217202.055537:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d43072400 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217202.055542:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072400/0x92b8e04cbf5facb9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217202.055549:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072400/0x92b8e04cbf5facb9 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217202.055574:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:1.0:1782217202.055578:0:17194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782217202.055754:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072400/0x92b8e04cbf5facb9 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217202.055763:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952d43072400/0x92b8e04cbf5facb9 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217202.055779:0:17194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd400/0x92b8e04cbf5fac9d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217202.055785:0:17194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd400/0x92b8e04cbf5fac9d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217202.055797:0:17194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd400/0x92b8e04cbf5fac9d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217202.055803:0:17194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e413fd400 already unused, calling callback (ffffffffc17684f0) 00010000:00010000:1.0:1782217202.055806:0:17194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd400/0x92b8e04cbf5fac9d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217202.055812:0:17194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd400/0x92b8e04cbf5fac9d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217202.055821:0:17194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:1.0:1782217202.055823:0:17194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782217202.055826:0:17194:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc200/0x92b8e04cbf5facb2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217202.055834:0:17194:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc200/0x92b8e04cbf5facb2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217202.055840:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc200/0x92b8e04cbf5facb2 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217202.055872:0:17194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd400/0x92b8e04cbf5fac9d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217202.055878:0:17194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd400/0x92b8e04cbf5fac9d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 17194 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217202.055903:0:20335:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc200/0x92b8e04cbf5facb2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217202.055924:0:20335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc200/0x92b8e04cbf5facb2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217202.056071:0:20335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fd800/0x92b8e04cbf5facab lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97391c expref: 22 pid: 20335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217202.056088:0:20335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff952e413fc200/0x92b8e04cbf5facb2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc65e7963be97391c expref: 21 pid: 20335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782217202.056097:0:20335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff952e46d74d00) 00010000:00010000:2.0:1782217202.056100:0:20335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782217202.056104:0:20335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff952e413fc200, rc 0) 00000100:00100000:1.0:1782217202.056106:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:909235f0-f9ba-458d-a9aa-26eb22b0f747+21:15665:x1868789693161984:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 38668us (39090us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1782217202.056118:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 63 00000100:00100000:2.0:1782217202.056139:0:20335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4379b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:909235f0-f9ba-458d-a9aa-26eb22b0f747+21:15664:x1868789693162496:12345-192.168.203.30@tcp:101:dd.0 Request processed in 3557us (4041us total) trans 0 rc 0/0 00000020:00080000:1.0:1782217202.056832:0:17194:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1782217202.059693:0:20335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 64 00000040:00080000:3.0:1782217202.062943:0:17230:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1782217202.062951:0:17230:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782217202.062974:0:17230:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1782217202.062980:0:17230:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1782217202.074602:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1782217202.077673:0:20337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693162752 00000100:00100000:3.0:1782217202.077686:0:20337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693162752 00000100:00100000:3.0:1782217202.077762:0:20337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 11 00000100:00100000:3.0:1782217202.077773:0:20337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4379bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:909235f0-f9ba-458d-a9aa-26eb22b0f747+20:15665:x1868789693162752:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1782217202.078049:0:20337:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1782217202.078082:0:20337:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:3.0:1782217202.078120:0:20337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363400/0x92b8e04cbf5facc0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217202.078137:0:20337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363400/0x92b8e04cbf5facc0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 20337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217202.078147:0:20337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363400/0x92b8e04cbf5facc0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 20337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217202.078156:0:20337:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363400/0x92b8e04cbf5facc0 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 20337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217202.078175:0:20337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363400/0x92b8e04cbf5facc0 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 20337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217202.078181:0:20337:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363400/0x92b8e04cbf5facc0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 20337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782217202.078206:0:20337:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782217202.078311:0:20337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4379bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:909235f0-f9ba-458d-a9aa-26eb22b0f747+22:15665:x1868789693162752:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 539us (3732us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1782217202.078319:0:20337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 11 00000020:00080000:3.0:1782217202.078325:0:20337:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1782217202.080160:0:17183:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782217202.080171:0:17183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363400/0x92b8e04cbf5facc0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 20337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217202.080181:0:17183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952e7b363400 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:0.0:1782217202.080186:0:17183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363400/0x92b8e04cbf5facc0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 20337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217202.080195:0:17183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363400/0x92b8e04cbf5facc0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 20337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217202.080222:0:17183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff952e48856b00) 00010000:00010000:0.0:1782217202.080226:0:17183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782217202.080231:0:17183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363400/0x92b8e04cbf5facc0 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 20337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217202.080237:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff952e7b363400/0x92b8e04cbf5facc0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 20337 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217202.080252:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217202.080254:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782217202.080256:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782217202.233263:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713154432:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782217202.233341:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217202.234230:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713154432 00000100:00100000:3.0:1782217202.234240:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713154432 00000100:00100000:3.0:1782217202.234300:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1782217202.234310:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713154432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782217202.234345:0:17200:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1782217202.234414:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713154432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217202.234422:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1782217202.234579:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713154432:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782217202.235277:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713154560:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782217202.235323:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217202.235395:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713154560 00000100:00100000:1.0:1782217202.235401:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713154560 00000100:00100000:1.0:1782217202.235445:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1782217202.235453:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72e8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713154560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782217202.235478:0:17199:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1782217202.237445:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72e8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713154560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1984us (2112us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217202.237459:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1782217202.241309:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713154560:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782217202.267396:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217202.267516:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693162880 00000100:00100000:0.0:1782217202.267525:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693162880 00000100:00100000:0.0:1782217202.267618:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:0.0:1782217202.267628:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72e8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:909235f0-f9ba-458d-a9aa-26eb22b0f747+7:2404:x1868789693162880:12345-192.168.203.30@tcp:4:dd.0 00002000:00010000:0.0:1782217202.267684:0:18706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a3a79f1, atime: 0x6a3a79f0, ctime: 0x6a3a79f1, blocks: 0x0 00010000:00010000:0.0:1782217202.267693:0:18706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e219a2c0/0x92b8e04cbf5facc7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217202.267708:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=565s v=(0 0) 00010000:00010000:0.0:1782217202.267713:0:18706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217202.267719:0:18706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e219a2c0/0x92b8e04cbf5facc7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217202.267734:0:18706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e219a2c0/0x92b8e04cbf5facc7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782217202.291480:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1782217202.291542:0:18708:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1782217202.291564:0:18708:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1782217202.293008:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789693163008 00000100:00100000:2.0:1782217202.293020:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789693163008 00000100:00100000:0.0:1782217202.294756:0:20338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1 00000100:00100000:0.0:1782217202.295041:0:20338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72e8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:909235f0-f9ba-458d-a9aa-26eb22b0f747+9:2404:x1868789693163008:12345-192.168.203.30@tcp:4:dd.0 00010000:00010000:0.0:1782217202.295081:0:20338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ced0a8d/0x92b8e04cbf5facce lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217202.295098:0:20338:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217202.295102:0:20338:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782217202.295108:0:20338:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ced0a8d/0x92b8e04cbf5facce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217202.295134:0:20338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ced0a8d/0x92b8e04cbf5facce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782217202.379830:0:19516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:3.0:1782217202.379992:0:19516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:0.0:1782217202.389239:0:18706:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:0.0:1782217202.389250:0:18706:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1782217201 -> 1782217202 00002000:00010000:0.0:1782217202.389253:0:18706:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1782217201 -> 1782217202 00002000:00010000:0.0:1782217202.389255:0:18706:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 14952 00010000:00010000:0.0:1782217202.389278:0:18706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e219a2c0/0x92b8e04cbf5facc7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217202.389291:0:18706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e219a2c0/0x92b8e04cbf5facc7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217202.389301:0:18706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e219a2c0/0x92b8e04cbf5facc7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217202.389309:0:18706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d42342e00 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:0.0:1782217202.389314:0:18706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e219a2c0/0x92b8e04cbf5facc7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217202.389323:0:18706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e219a2c0/0x92b8e04cbf5facc7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217202.389345:0:18706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e219a2c0/0x92b8e04cbf5facc7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782217202.389373:0:18706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e219a2c0/0x92b8e04cbf5facc7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782217202.389492:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72e8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:909235f0-f9ba-458d-a9aa-26eb22b0f747+7:2404:x1868789693162880:12345-192.168.203.30@tcp:4:dd.0 Request processed in 121859us (122099us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1782217202.389504:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 0 00000001:00080000:3.0:1782217202.402101:0:19516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00010000:00010000:1.0:1782217202.402297:0:20338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ced0a8d/0x92b8e04cbf5facce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217202.402314:0:20338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ced0a8d/0x92b8e04cbf5facce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217202.402324:0:20338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ced0a8d/0x92b8e04cbf5facce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217202.402332:0:20338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff952d42342600 already unused, calling callback (ffffffffc0b5ece0) 00010000:00010000:1.0:1782217202.402338:0:20338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ced0a8d/0x92b8e04cbf5facce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217202.402346:0:20338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ced0a8d/0x92b8e04cbf5facce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217202.402384:0:20338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ced0a8d/0x92b8e04cbf5facce lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782217202.402391:0:20338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ced0a8d/0x92b8e04cbf5facce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782217202.402506:0:20338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72e8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:909235f0-f9ba-458d-a9aa-26eb22b0f747+5:2404:x1868789693163008:12345-192.168.203.30@tcp:4:dd.0 Request processed in 107469us (111029us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1782217202.402520:0:20338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1 00010000:00010000:1.0:1782217202.554245:0:17182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782217202.745072:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713154688:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782217202.745151:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217202.745216:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713154688 00000100:00100000:2.0:1782217202.745224:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713154688 00000100:00100000:2.0:1782217202.745296:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1782217202.745307:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d41be4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713154688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782217202.745337:0:18704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00080000:1.0:1782217202.746244:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782217202.761157:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d41be4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713154688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 15843us (15997us total) trans 0 rc 0/0 00000100:00100000:2.0:1782217202.761190:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1782217202.763452:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713154688:0@lo:13:osp-pre-0-1.0 00000040:00080000:1.0:1782217203.321252:0:17948:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1782217203.577735:0:18349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782217203.878246:0:20375:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:0.0:1782217204.600889:0:17183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782217204.792752:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e46da5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713154816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782217204.792815:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a1470210-3884-42c5-8d09-248d2ed946c2:3649:1868789713154944:0@lo:400:kworker.0 00000100:00100000:0.0:1782217204.792820:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217204.792861:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713155328:0@lo:400:kworker.0 00000100:00100000:0.0:1782217204.792885:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217204.792902:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713155840:0@lo:400:kworker.0 00000100:00100000:0.0:1782217204.792922:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217204.792926:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217204.792936:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43316d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1868789713156352:0@lo:400:kworker.0 00000100:00100000:3.0:1782217204.792950:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1868789713155456:0@lo:400:kworker.0 00000100:00100000:0.0:1782217204.792956:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782217204.792971:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713155200:0@lo:400:kworker.0 00000100:00100000:3.0:1782217204.792991:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217204.792992:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713154816 00000100:00100000:0.0:1782217204.792999:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713154816 00000100:00100000:3.0:1782217204.793006:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713155712:0@lo:400:kworker.0 00000100:00100000:3.0:1782217204.793024:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217204.793180:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782217204.793190:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c6f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713154816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782217204.793218:0:18705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1782217204.793260:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c6f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713154816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217204.793278:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782217204.793299:0:19412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713155328 00000100:00100000:0.0:1782217204.793304:0:19412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713155328 00000100:00100000:0.0:1782217204.793325:0:19412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713155840 00000100:00100000:0.0:1782217204.793328:0:19412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713155840 00000100:00100000:0.0:1782217204.793339:0:19412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713155200 00000100:00100000:0.0:1782217204.793341:0:19412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713155200 00000100:00100000:0.0:1782217204.793351:0:19412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713155712 00000100:00100000:0.0:1782217204.793352:0:19412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713155712 00000100:00100000:0.0:1782217204.793364:0:19412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782217204.793369:0:19412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d4441c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713155328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217204.793381:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43315500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1868789713156224:0@lo:400:kworker.0 00000100:00100000:0.0:1782217204.793401:0:19412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d4441c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1868789713155328:12345-0@lo:400:kworker.0 Request processed in 32us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217204.793403:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217204.793407:0:19412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782217204.793419:0:19412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782217204.793425:0:19412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713155840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217204.793430:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713155072:0@lo:400:kworker.0 00000100:00100000:3.0:1782217204.793451:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217204.793451:0:19412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1868789713155840:12345-0@lo:400:kworker.0 Request processed in 27us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217204.793456:0:19412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1782217204.793465:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d41be5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713155584:0@lo:400:kworker.0 00000100:00100000:0.0:1782217204.793467:0:19412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782217204.793472:0:19412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43316680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713155200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217204.793483:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217204.793496:0:19412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43316680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713155200:12345-0@lo:400:kworker.0 Request processed in 24us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217204.793498:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43314a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1868789713156096:0@lo:400:kworker.0 00000100:00100000:0.0:1782217204.793501:0:19412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782217204.793511:0:19412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782217204.793516:0:19412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43314000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713155712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217204.793541:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782217204.793561:0:19412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43314000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1868789713155712:12345-0@lo:400:kworker.0 Request processed in 45us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1782217204.793567:0:19412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782217204.793569:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713154944 00000100:00100000:3.0:1782217204.793572:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713154944 00000100:00080000:1.0:1782217204.793682:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782217204.793687:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782217204.793697:0:18842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713155072 00000100:00100000:1.0:1782217204.793700:0:18842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713155072 00000100:00100000:1.0:1782217204.793724:0:18842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713155584 00000100:00100000:1.0:1782217204.793727:0:18842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713155584 00000100:00100000:1.0:1782217204.793740:0:18842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1782217204.793745:0:18842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43315880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713155072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217204.793785:0:18842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43315880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1868789713155072:12345-0@lo:400:kworker.0 Request processed in 40us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217204.793791:0:18842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1782217204.793803:0:18842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1782217204.793808:0:18842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43314380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713155584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217204.793845:0:18842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43314380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1868789713155584:12345-0@lo:400:kworker.0 Request processed in 37us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217204.793851:0:18842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1782217204.793886:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1868789713155072:0@lo:400:kworker.0 00000100:00100000:1.0:1782217204.793896:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1868789713155584:0@lo:400:kworker.0 00000100:00100000:3.0:1782217204.794126:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1782217204.794134:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e7c618850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+24:3649:x1868789713154944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217204.794166:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e7c618850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a1470210-3884-42c5-8d09-248d2ed946c2+24:3649:x1868789713154944:12345-0@lo:400:kworker.0 Request processed in 34us (1239us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217204.794172:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1782217204.794563:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713155200:0@lo:400:kworker.0 00000100:00100000:2.0:1782217204.794575:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1868789713155712:0@lo:400:kworker.0 00000100:00100000:3.0:1782217204.794695:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713156352 00000100:00100000:0.0:1782217204.794696:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713156224 00000100:00100000:3.0:1782217204.794700:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713156352 00000100:00100000:0.0:1782217204.794700:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713156224 00000100:00100000:3.0:1782217204.794731:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713156096 00000100:00100000:3.0:1782217204.794735:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713156096 00000100:00100000:2.0:1782217204.794802:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217204.794828:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43317100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1868789713155968:0@lo:400:kworker.0 00000100:00100000:2.0:1782217204.794858:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217204.794870:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43315180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1868789713156480:0@lo:400:kworker.0 00000100:00100000:2.0:1782217204.794889:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217204.794910:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a1470210-3884-42c5-8d09-248d2ed946c2:3649:1868789713154944:0@lo:400:kworker.0 00000100:00100000:2.0:1782217204.794919:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782217204.794925:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952e72e8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713156608:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782217204.794946:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782217204.794970:0:20335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713155456 00000100:00100000:2.0:1782217204.794973:0:20335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713155456 00000100:00100000:2.0:1782217204.794992:0:20335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713155968 00000100:00100000:2.0:1782217204.794994:0:20335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713155968 00000100:00100000:2.0:1782217204.795005:0:20335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713156480 00000100:00100000:2.0:1782217204.795082:0:20335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713156480 00000100:00100000:1.0:1782217204.796300:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1782217204.796317:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43e90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1868789713156352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217204.796384:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43e90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1868789713156352:12345-0@lo:400:kworker.0 Request processed in 74us (3426us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217204.796391:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1782217204.796411:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1782217204.796418:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72e8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1868789713155456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217204.796453:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72e8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1868789713155456:12345-0@lo:400:kworker.0 Request processed in 36us (1651us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217204.796460:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1782217204.796473:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1782217204.796478:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72e8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1868789713155968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782217204.796506:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72e8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1868789713155968:12345-0@lo:400:kworker.0 Request processed in 28us (1647us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217204.796512:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1782217204.796574:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1868789713155456:0@lo:400:kworker.0 00000100:00100000:1.0:1782217204.796615:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43317100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1868789713155968:0@lo:400:kworker.0 00000100:00100000:1.0:1782217204.796649:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff952d43799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713156736:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782217204.796693:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782217204.796729:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713156608 00000100:00100000:1.0:1782217204.796735:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713156608 00000100:00100000:1.0:1782217204.796758:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868789713156736 00000100:00100000:1.0:1782217204.796761:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868789713156736 00000100:00100000:1.0:1782217204.796772:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782217204.796778:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713156608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782217204.796793:0:18705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1782217204.796828:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1868789713156608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (1880us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217204.796834:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782217204.796845:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782217204.796851:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43799500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713156736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782217204.796867:0:18705:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1782217204.796895:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43799500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1868789713156736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1782217204.796902:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782217204.796930:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e72e8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1868789713156608:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782217204.796953:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1868789713156736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782217204.799970:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1782217204.799985:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43317800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1868789713156096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217204.800088:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43317800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1868789713156096:12345-0@lo:400:kworker.0 Request processed in 108us (6555us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217204.800096:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1782217204.800112:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1782217204.800118:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952d43317b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1868789713156224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217204.800150:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952d43317b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1868789713156224:12345-0@lo:400:kworker.0 Request processed in 33us (6745us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217204.800156:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1782217204.800407:0:3648:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:0.0:1782217204.800414:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff952d43798e00, transno 8589934596 00000004:00080000:0.0:1782217204.800424:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:0.0:1782217204.800446:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713155328:0@lo:400:kworker.0 00000100:00100000:0.0:1782217204.800461:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d41be7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1868789713155840:0@lo:400:kworker.0 00000100:00100000:0.0:1782217204.800472:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43316d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1868789713156352:0@lo:400:kworker.0 00000100:00100000:0.0:1782217204.800489:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952e46da5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1868789713154816:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1782217204.800576:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782217204.800602:0:17190:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782217204.800718:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43314a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1868789713156096:0@lo:400:kworker.0 00010000:00080000:1.0:1782217204.804033:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43315500 x1868789713156224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782217204.804052:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43315500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1868789713156224:0@lo:400:kworker.0 00000100:00100000:2.0:1782217204.805570:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1782217204.806476:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff952e72e8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1868789713156480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782217204.806786:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff952e72e8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1868789713156480:12345-0@lo:400:kworker.0 Request processed in 1204us (11892us total) trans 0 rc 0/0 00000100:00100000:3.0:1782217204.806795:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:2.0:1782217204.806914:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff952d43315180 x1868789713156480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782217220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782217204.806927:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff952d43315180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1868789713156480:0@lo:400:kworker.0 Debug log: 42055 lines, 42055 kept, 0 dropped, 0 bad.